Senior Data Scientist

What it does

This skill provides access to a suite of tools and expertise emulating that of a senior data scientist, focused on building and deploying production-grade AI/ML systems. It enables an agent to design experiments, engineer features, evaluate models, and implement best practices for scalable and optimized data solutions. The skill leverages Python scripts and configuration files to automate key processes within the machine learning lifecycle.

When to use it

• When needing assistance with designing and implementing machine learning experiments.
• To optimize feature engineering pipelines for improved model performance.
• For evaluating and deploying machine learning models into production environments.
• When requiring guidance on MLOps and DataOps best practices at scale.

Key capabilities

• Experiment design using experiment_designer.py
• Feature engineering pipeline analysis with feature_engineering_pipeline.py
• Model evaluation and deployment via model_evaluation_suite.py
• Expertise in advanced production patterns, scalable system design, performance optimization, MLOps/DataOps, real-time processing, distributed computing, model deployment & monitoring, security, cost optimization, team leadership, and mentoring.
• Proficiency across a wide range of technologies including Python, SQL, R, Scala, Go, PyTorch, TensorFlow, Spark, Airflow, dbt, Kafka, Databricks, LangChain, LlamaIndex, DSPy, Docker, Kubernetes, AWS/GCP/Azure, MLflow, Weights & Biases, Prometheus, PostgreSQL, BigQuery, Snowflake, and Pinecone.

Example prompts

• "Design an experiment to test the impact of feature X on model Y."
• "Analyze this dataset and suggest features for a predictive model."
• "Evaluate the performance of my existing machine learning model and prepare it for deployment."

Tips & gotchas

• The skill relies on Python scripts, so ensure the agent has access to a suitable Python environment.
• Familiarity with data science concepts and terminology will improve interaction effectiveness.
• Refer to the reference documentation (references/statistical_methods_advanced.md, references/experiment_design_frameworks.md) for more detailed guidance on specific techniques.