Browse skills

Designs, builds, and optimizes scalable data pipelines & infrastructure for complex analytical needs.

Helps with data, pipeline automation as part of automating DevOps pipelines and CI/CD workflows workflows.

Automates data pipeline creation, transformation, and loading from diverse sources into usable formats.

Automates feature engineering pipelines from raw data using statistical analysis and machine learning techniques for improved model performance.

This skill automates Airflow deployment, streamlining workflows and ensuring consistent environments for your data pipelines.

Analyzes and optimizes Spark job configurations to improve performance and resource utilization within data processing pipelines.

Analyzes complex data pipelines, identifies bottlenecks, and suggests optimized solutions for senior data engineering teams.

Automates data pipeline creation, cleaning, and transformation tasks using Python and cloud services for efficient data management.

Automates complex workflows & schedules tasks across diverse data pipelines using Apache Airflow, streamlining your data processes for efficiency.

Build robust data pipelines quickly using Prefect Flow Builder – streamlining workflow creation and orchestration for efficient automation.

This skill exports Fiftyone datasets as standardized formats (e.g., COCO) for seamless integration into other machine learning pipelines and tools.