Databricks Performance Tuning
Optimizes Databricks cluster performance and query execution using expert techniques from Jeremy Longshore.
Install on your platform
We auto-selected Claude Code based on this skill’s supported platforms.
Run in terminal (recommended)
claude mcp add jeremylongshore-databricks-performance-tuning npx -- -y @trustedskills/jeremylongshore-databricks-performance-tuning
Or manually add to ~/.claude/settings.json
{
"mcpServers": {
"jeremylongshore-databricks-performance-tuning": {
"command": "npx",
"args": [
"-y",
"@trustedskills/jeremylongshore-databricks-performance-tuning"
]
}
}
}Requires Claude Code (claude CLI). Run claude --version to verify your install.
About This Skill
What it does
This skill helps optimize Databricks workloads for improved performance. It can identify bottlenecks in Spark jobs, suggest configuration changes to enhance resource utilization, and provide guidance on query optimization within the Databricks environment. Ultimately, this leads to faster processing times and reduced costs associated with running data pipelines.
When to use it
- You're experiencing slow execution times for your Databricks notebooks or Spark jobs.
- Your Databricks cluster is consistently hitting resource limits (CPU, memory).
- You want to reduce the cost of running your Databricks workloads by improving efficiency.
- You need assistance in understanding and resolving performance issues related to specific SQL queries within Databricks.
Key capabilities
- Spark job bottleneck identification
- Databricks cluster configuration optimization suggestions
- Query optimization guidance for improved performance
- Resource utilization enhancement recommendations
Example prompts
- "Analyze this Spark job and identify any performance bottlenecks: [job details]"
- "My Databricks cluster is running slowly. What configurations should I adjust?"
- "Optimize this SQL query in Databricks: [SQL query]"
Tips & gotchas
This skill requires access to the Databricks environment and relevant job or query information for analysis. The accuracy of recommendations depends on the completeness and correctness of the provided data.
Tags
TrustedSkills Verification
Unlike other registries that point to live repositories, TrustedSkills pins every skill to a verified commit hash. This protects you from malicious updates — what you install today is exactly what was reviewed and verified.
Security Audits
| Gen Agent Trust Hub | Pass |
| Socket | Pass |
| Snyk | Pass |
🌐 Community
Passed automated security scans.