Updated today
by DataWithBaraa
claude-code-data-engineering-skills
16 Claude Code skills for data engineers: profile a new source, investigate a failed run, review a change, document the platform. Most end in a page you can share.
81 GitHub stars (81)
+81 in 9 days
| Period | New stars |
|---|---|
| Oct 31 | +5 |
| Nov 1 | +6 |
| Nov 2 | +8 |
| Nov 3 | +8 |
| Nov 4 | +1 |
| Nov 5 | +7 |
| Nov 6 | +3 |
| Nov 7 | +4 |
- 16 skills (16 skills found in its SKILL.md files)
- 29 forks (29 forks)
- Today last update (Last updated today)
Install
Skills CLI
npx skills add DataWithBaraa/claude-code-data-engineering-skills
Asks which skills and agents to install. Just one: npx skills add DataWithBaraa/claude-code-data-engineering-skills --skill big-review — add -g for every project.
Claude Code
git clone https://github.com/DataWithBaraa/claude-code-data-engineering-skillscp -r "claude-code-data-engineering-skills/skills/big-review" ~/.claude/skills/
Copies the big-review skill into ~/.claude/skills/ for every project (use .claude/skills/ for one project). Repeat for the other skills listed below.
Plugin
/plugin marketplace add DataWithBaraa/claude-code-data-engineering-skills
Run inside Claude Code if the repository ships a plugin marketplace, then pick plugins from /plugin.
Skills can run code on your machine — read the SKILL.md first.
What it does
In the author's own words, from each skill's SKILL.md.
-
big-review
Use once a month, or when the platform feels slow, heavy or cluttered, to review the whole platform from the query logs and the repo, and propose improvements with effort and risk.
skills/big-review/ on GitHub (opens in a new tab)SKILL.md -
contract
Use when a new source is connected or a source changes how it delivers, to write the data contract with the source system, the format, the schema, the quality rules, the delivery, the owner and the change process.
skills/contract/ on GitHub (opens in a new tab)SKILL.md -
cost-review
Use for the monthly cost review of the platform, to see where the compute and the storage money goes, per job, pipeline and table, and what to cut.
skills/cost-review/ on GitHub (opens in a new tab)SKILL.md -
data-product
Use when a table is served to consumers, released or changed, to build everything a consumer needs as a data product, the guide, the data model, the metrics, the starter queries, the quality, the releases and the data contract.
skills/data-product/ on GitHub (opens in a new tab)SKILL.md -
docs
Use after a change or a release, to write and refresh the runbook and the how-to guides of the project, so the runbook and the guides match the code.
skills/docs/ on GitHub (opens in a new tab)SKILL.md -
impact
Use before you change a table, a column or a function, to see what it is built from, what depends on it, who reads it, which checks cover it, and the safe order of the change.
skills/impact/ on GitHub (opens in a new tab)SKILL.md -
incident
Use when a job run failed with an error, to walk the incident from the error to the root cause, the workaround, two solutions, the future risks, the email drafts and the log entry.
skills/incident/ on GitHub (opens in a new tab)SKILL.md -
knowledge-refresh
Use after a release, to compare the knowledge Claude Code reads, CLAUDE.md, the standards, the source pages and the incident log, with the code and the data, and propose what is stale, missing or wrong.
skills/knowledge-refresh/ on GitHub (opens in a new tab)SKILL.md -
metadata
Use when the metadata of a source has to be built or extended, to describe every table and column, the names and types from the data with a script, the descriptions from the documents, never guessed.
skills/metadata/ on GitHub (opens in a new tab)SKILL.md -
migration
Use when an old estate of jobs and tables has to move to a new platform, to inventory it, rate it, and write the migration plan with scenarios, acceptance numbers, the parallel run and the rollback.
skills/migration/ on GitHub (opens in a new tab)SKILL.md -
pr-review
Use before a pull request or another change goes in, on a file, the current diff or a branch, to review it pass by pass against the project's own standards, with pushback.
skills/pr-review/ on GitHub (opens in a new tab)SKILL.md -
profile
Use when a new source or new files arrive, to profile them before any data contract or pipeline code is written, the file formats, the schema, the data quality, the bad records, the relationships, the gaps and the personal data.
skills/profile/ on GitHub (opens in a new tab)SKILL.md -
quality
Use to see which checks failed or warned, what was quarantined, how fresh the tables are, and whether each table is safe to use today.
skills/quality/ on GitHub (opens in a new tab)SKILL.md -
reconcile
Use when two numbers that should agree do not, a report against its source, a rollup against its detail, two systems for the same table, to find where they diverge and why.
skills/reconcile/ on GitHub (opens in a new tab)SKILL.md -
test-data
Use when a new function or a new table needs tests, to write test data with the edge cases and the expected result written first, never from production data.
skills/test-data/ on GitHub (opens in a new tab)SKILL.md -
toolkit
Use to build or rebuild the documentation site of the project from the repo, the architecture, the data lineage, the call graph, the data model, the data quality, the runs and the data catalog.
skills/toolkit/ on GitHub (opens in a new tab)SKILL.md
No skill matches that filter.
Review before you install
A skill is a set of instructions and scripts your agent will follow, and it can run code on your machine. Read the SKILL.md and any scripts first — this listing is not a security review.