Celery Patterns

What it does

This skill provides patterns and best practices for working with Celery, a distributed task queue. It helps automate complex workflows, handle asynchronous tasks, and improve application scalability by offloading time-consuming operations from the main thread. The skill can generate code snippets, suggest architectural approaches, and troubleshoot common issues related to Celery deployments.

When to use it

• Background Task Processing: You need to process images or videos without blocking user requests.
• Scheduled Tasks: You want to automatically send daily reports or perform database maintenance at night.
• Distributed Workloads: Your application needs to handle a large volume of tasks across multiple worker nodes.
• Asynchronous Communication: You need to decouple components and enable asynchronous communication between them.

Key capabilities

• Celery task definition generation
• Workflow orchestration patterns
• Error handling and retry mechanisms
• Configuration best practices
• Debugging assistance for Celery workers

Example prompts

• "Generate a Celery task to resize an image."
• "Show me how to implement a retrying mechanism for my Celery tasks."
• "What's the best way to configure Celery with Redis?"

Tips & gotchas

This skill assumes some familiarity with Python and Celery concepts. Understanding basic Celery architecture (tasks, workers, brokers) will help you get the most out of it.