Azure Storage File Datalake Py

What it does

This skill allows AI agents to interact with Azure Data Lake Storage Gen2 files using Python. It enables tasks such as listing directories, downloading specific files, and uploading new data into the datalake. This provides programmatic access for managing large datasets stored in Azure's cloud storage solution.

When to use it

• Automating file transfers: Regularly move data between your local environment and Azure Data Lake Storage Gen2.
• Data analysis workflows: Retrieve specific files from a datalake as part of an automated data processing pipeline.
• Backup and recovery: Create backups of critical data stored in the datalake by downloading it to another location.
• Content management: Upload new content or update existing files within your Azure Data Lake Storage Gen2 environment.

Key capabilities

• Listing directories within a specified container.
• Downloading individual files from the datalake.
• Uploading data to the datalake.

Example prompts

• "List all the files in the 'raw_data' directory of my Azure Data Lake Storage Gen2."
• "Download the file named 'sales_report_2023.csv' from the 'processed_data' container."
• "Upload this CSV data to a new file called 'customer_feedback.csv' in the 'staging' folder."

Tips & gotchas

• Requires proper Azure credentials and access permissions configured for the AI agent to interact with your Data Lake Storage Gen2 account. Ensure the agent has appropriate roles assigned.