Serving Llms Vllm
davila7
This skill simplifies running and managing LLMs like VLLM, enabling efficient experimentation and deployment for developers and researchers.
41,264 listings from across the agent ecosystem. None of them have been code-reviewed — check the source before you install.
Looking for what's new? See the repos gaining stars fastest.
27 skills matching “deploy”
davila7
This skill simplifies running and managing LLMs like VLLM, enabling efficient experimentation and deployment for developers and researchers.
davila7
This skill assesses LLM performance within a harness, providing insights into accuracy and efficiency for optimized deployments.
davila7
This skill streamlines LLM integration by automatically deploying and configuring GPT models for your projects, boosting AI capabilities quickly.
Provides deployment guidance and assistance for software development workflows.
orchestra-research
Serves LLMs like VLLM efficiently for experimentation and deployment, streamlining development workflows and scaling AI applications.
ovachiever
This skill efficiently reduces model sizes using BitsAndBytes quantization, enabling faster inference and lower memory requirements – crucial for deployment.
thebushidocollective
Helps with data modeling, deployment as part of automating DevOps pipelines and CI/CD workflows workflows.
ovachiever
Llama Cpp converts Llama model prompts into optimized C++ code for faster inference and deployment in various applications.
ovachiever
This skill streamlines LLM integration by automatically deploying and configuring GPT models for your projects, boosting AI capabilities quickly.
zechenzhangagi
This skill deploys and integrates LLMs like ChatGPT for enhanced conversational AI applications and content generation.
zechenzhangagi
This skill assesses LLM performance within a harness environment, providing insights for optimization and ensuring consistent results across deployments.
truefoundry
Helps with LLMs, deployment as part of software development workflows workflows.
jeremylongshore
This skill automates ML model deployment to various platforms, streamlining workflows and accelerating time-to-value for your AI solutions.
trailofbits
Helps with OpenAI, deployment as part of building AI and machine learning applications workflows.
tondevrel
Automates PyTorch model deployment to cloud environments, streamlining inference serving and scaling workflows.
testany-io
The Guardrails Reviewer analyzes your AI model’s outputs against predefined guardrails, ensuring safety and compliance – crucial for responsible AI deployment.
vllm-project
Quickly deploy vLLM inference endpoints with a single command, simplifying large language model serving.
stakpak
Automates vLLM model deployment and scaling across infrastructure for optimized performance and resource utilization.
claudedjale
Helps with Azure, AI, OpenAI as part of deploying and managing cloud infrastructure workflows.
thebeardedbearsas
Analyzes and optimizes performance metrics from The Bearded Bears' AS (Automated Systems) deployments for improved efficiency.
ghostscientist
This skill automatically deploys your Hugging Face Spaces to production, simplifying deployment and making your models accessible online.
davila7
Reduces LLM file sizes & speeds up inference by quantizing GGuf models – making them more efficient to run and deploy.
Nnsight Remote Interpretability analyzes model behavior in real-time across deployed environments, revealing insights for debugging and trust.
davila7
GPTQ enables faster, smaller language model inference by quantizing weights – crucial for deploying large models on limited hardware.
Can't find what you need?