Senior Data Engineer
Designs, builds, and optimizes scalable data pipelines & infrastructure for complex analytical needs.
Install on your platform
We auto-selected Claude Code based on this skill’s supported platforms.
Run in terminal (recommended)
claude mcp add senior-data-engineer npx -- -y @trustedskills/senior-data-engineer
Or manually add to ~/.claude/settings.json
{
"mcpServers": {
"senior-data-engineer": {
"command": "npx",
"args": [
"-y",
"@trustedskills/senior-data-engineer"
]
}
}
}Requires Claude Code (claude CLI). Run claude --version to verify your install.
About This Skill
What it does
The senior-data-engineer skill provides advanced capabilities for designing, building, and maintaining large-scale data processing systems. It includes expertise in ETL processes, data pipeline orchestration, and optimizing data storage solutions.
When to use it
- When developing complex data pipelines that require high performance and reliability
- For managing big data workflows across distributed computing frameworks like Spark or Hadoop
- When integrating data from multiple sources into a unified analytics platform
Key capabilities
- Designing scalable ETL processes
- Implementing data pipeline orchestration tools (e.g., Apache Airflow)
- Optimizing query performance on large datasets
- Ensuring data quality and integrity in distributed systems
Example prompts
- "Design an ETL pipeline for processing real-time user activity logs."
- "Optimize this Spark job to reduce execution time by 30%."
- "Set up a data warehouse schema that supports multi-dimensional analytics."
Tips & gotchas
- Ensure you have access to the necessary infrastructure (e.g., cloud platforms, cluster resources) before deploying pipelines.
- Data lineage and documentation are crucial for maintaining complex systems—make them a priority from the start.
Tags
TrustedSkills Verification
Unlike other registries that point to live repositories, TrustedSkills pins every skill to a verified commit hash. This protects you from malicious updates — what you install today is exactly what was reviewed and verified.
Security Audits
| Gen Agent Trust Hub | Pass |
| Socket | Pass |
| Snyk | Pass |
🌐 Community
Passed automated security scans.