Python Performance Optimization

What it does

This skill helps optimize Python code for better performance, including reducing execution time and memory usage. It provides actionable insights on algorithm selection, data structure optimization, and leveraging built-in libraries or tools like NumPy and Cython.

When to use it

• Your Python script is running slowly and needs a performance boost.
• You're working with large datasets and need more efficient memory handling.
• You want to refactor code for scalability in high-load environments.
• You’re preparing an application for deployment and need to ensure optimal resource usage.

Key capabilities

• Identifies inefficient algorithms or loops that can be vectorized or parallelized.
• Recommends appropriate data structures (e.g., using sets over lists for faster lookups).
• Suggests use of optimized libraries like NumPy, Pandas, or Cython.
• Provides profiling guidance to pinpoint bottlenecks in code execution.

Example prompts

• "Optimize this Python script that processes large CSV files."
• "How can I reduce the runtime of my machine learning training loop?"
• "Suggest ways to improve memory efficiency in this data processing pipeline."

Tips & gotchas

• Profiling your code with tools like cProfile or timeit is essential before optimization.
• Not all optimizations are worth it—focus on bottlenecks that have the most impact on performance.