Updated 2d ago
by gordonmurray
data-engineering-skills
Expert knowledge skills for Claude Code to help with specific technologies and tools.
47 GitHub stars (47)
+8 in 30 days
| Period | New stars |
|---|---|
| Oct 1 | 0 |
| Oct 2 | 0 |
| Oct 3 | 0 |
| Oct 4 | 0 |
| Oct 5 | +1 |
| Oct 6 | 0 |
| Oct 7 | 0 |
| Oct 8 | 0 |
| Oct 9 | 0 |
| Oct 10 | 0 |
| Oct 11 | 0 |
| Oct 12 | 0 |
| Oct 13 | 0 |
| Oct 14 | 0 |
| Oct 15 | 0 |
| Oct 16 | 0 |
| Oct 17 | 0 |
| Oct 18 | 0 |
| Oct 19 | 0 |
| Oct 20 | 0 |
| Oct 21 | +1 |
| Oct 22 | 0 |
| Oct 23 | 0 |
| Oct 24 | 0 |
| Oct 25 | 0 |
| Oct 26 | 0 |
| Oct 27 | 0 |
| Oct 28 | 0 |
| Oct 29 | +1 |
| Oct 30 | 0 |
| Oct 31 | 0 |
| Nov 1 | 0 |
| Nov 2 | 0 |
| Nov 3 | 0 |
| Nov 4 | +3 |
| Nov 5 | +3 |
- 9 skills (9 skills found in its SKILL.md files)
- 4 forks (4 forks)
- 2d ago last update (Last updated 2d ago)
Install
Skills CLI
npx skills add gordonmurray/data-engineering-skills
Asks which skills and agents to install. Just one: npx skills add gordonmurray/data-engineering-skills --skill docker-compose — add -g for every project.
Claude Code
git clone https://github.com/gordonmurray/data-engineering-skillscp -r "data-engineering-skills/docker-compose" ~/.claude/skills/
Copies the docker-compose skill into ~/.claude/skills/ for every project (use .claude/skills/ for one project). Repeat for the other skills listed below.
Plugin
/plugin marketplace add gordonmurray/data-engineering-skills
Run inside Claude Code if the repository ships a plugin marketplace, then pick plugins from /plugin.
Skills can run code on your machine — read the SKILL.md first.
What it does
In the author's own words, from each skill's SKILL.md.
-
docker-compose
Write, review, and modernize Docker Compose files against the current Compose Specification and the docker compose CLI. Use for authoring compose.yaml or docker-compose.yml, service dependency and healthcheck ordering, profiles, networks, volumes, secrets and configs, build contexts, migrating off V1 and the obsolete version key, or containers that fail to start, restart-loop, report unhealthy, o…
docker-compose/SKILL.md on GitHub (opens in a new tab) -
firn
Design, deploy, use, and troubleshoot Firn, the object-storage-backed multi-tenant vector and full-text search engine. Use for Firn REST API or embedded Python work, LanceDB-backed vector, BM25, hybrid, or multivector search, S3/GCS/MinIO storage, RAM/NVMe/object-storage caching, ingestion and index-build workflows, namespace isolation, auth, metrics, latency, or cache correctness.
firn/SKILL.md on GitHub (opens in a new tab) -
flink-agents
Design, integrate, upgrade, and troubleshoot Apache Flink Agents applications in streaming pipelines. Use for Flink Agents Actions, Events, Resources, ReAct agents, Java/Python/YAML definitions, runtime Skills and MCP, durable calls, Kafka or Fluss Action State Stores, agent memory, or 0.3 to 0.4 migrations. Not for ordinary Flink SQL jobs or general coding-agent skill authoring.
flink-agents/SKILL.md on GitHub (opens in a new tab) -
flink
Architect, implement, deploy, upgrade, and troubleshoot Apache Flink stream processing jobs. Use for Flink SQL, Table API, or DataStream implementation, 1.x to 2.x migration, savepoint and state compatibility, checkpoint failures, backpressure, watermark and late-data problems, Kubernetes Operator deployment, Flink CDC pipelines, or Iceberg, Paimon, and Fluss connector work.
flink/SKILL.md on GitHub (opens in a new tab) -
fluss
Design, deploy, and operate Apache Fluss streaming storage. Use for Fluss log or primary-key tables, retention and bucket sizing, tiering to Paimon, Iceberg, or Hudi, Flink integration and Delta Join, $changelog and $binlog virtual tables, Spark access, REST Gateway, native client SDKs, or hot storage for real-time analytics and AI context.
fluss/SKILL.md on GitHub (opens in a new tab) -
iceberg
Design, migrate, tune, and maintain Apache Iceberg tables across query engines. Use for Iceberg schema and partition evolution, v2 to v3 upgrades, catalog selection, time travel and rollback, row-level deletes, snapshot expiry, orphan file cleanup, small-file compaction, or slow queries and metadata bloat on a lakehouse table. Covers Spark, Flink, Trino, Athena, Snowflake, REST catalogs, Polaris,…
iceberg/SKILL.md on GitHub (opens in a new tab) -
iggy
Deploy, configure, and build clients against Apache Iggy, a Rust-native message streaming platform. Use for Iggy Docker, Compose, or Kubernetes deployments, stream and topic design, retention and consumer groups, QUIC, TCP, HTTP, or WebSocket transport, apache-iggy Python clients, MCP and connectors, 0.8 to 0.9 migration, or container connectivity and persistence problems.
iggy/SKILL.md on GitHub (opens in a new tab) -
lance
Design, index, query, and tune Lance datasets and LanceDB tables for ML and AI workloads. Use for vector index selection such as IVF_PQ or IVF_HNSW_FLAT, ANN recall and latency tuning, full-text and hybrid search, scalar indexes and prefiltering, dataset versioning and compaction, embedding and multimodal storage, slow vector search on object storage, or migrating ML data from Parquet. Covers bot…
lance/SKILL.md on GitHub (opens in a new tab) -
paimon
Design, ingest into, tune, and operate Apache Paimon tables for streaming lakehouses and multimodal data. Use for Paimon primary-key or append-only table design, bucket sizing, changelog producer choice, Flink CDC ingestion, compaction backlog, lookup joins, PyPaimon, blob and vector storage, Spark reads, or Iceberg compatibility.
paimon/SKILL.md on GitHub (opens in a new tab)
No skill matches that filter.
Review before you install
A skill is a set of instructions and scripts your agent will follow, and it can run code on your machine. Read the SKILL.md and any scripts first — this listing is not a security review.