OthersideAI / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
β10Updated last year
Alternatives and similar repositories for vllm:
Users that are interested in vllm are comparing it to the libraries listed below
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.β37Updated last week
- The Swarm Ecosystemβ18Updated 7 months ago
- πEasyAGI : A generalist agent that can go online and accomplish complex tasks.β23Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minβ¦β26Updated 4 months ago
- Collections of Actions for Custom GPTs (some created by Captain Action)β10Updated last year
- β20Updated last year
- β12Updated 10 months ago
- Tool4AI: A model agnostic, LLM friendly router for tool/function callβ15Updated 7 months ago
- An advanced distributed knowledge fabric for intelligent document processing, featuring multi-document agents, optimized query handling, β¦β26Updated 7 months ago
- β13Updated last year
- β11Updated last year
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, anβ¦β13Updated last week
- A swarm of LLM agents that will help you test, document, and productionize your code!β14Updated last week
- A forest of autonomous agents.β19Updated 2 months ago
- LangChain + LiteLLM that worksβ39Updated last month
- β14Updated 11 months ago
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!β11Updated 2 weeks ago
- a simple create-llama template using llama-index v0.10 and integrated with Ollamaβ10Updated 10 months ago
- An all-new OS that orchestrates autonomous agents as workers to execute tasks.β17Updated 4 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for youβ¦β37Updated 10 months ago
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1β¦β14Updated last year
- Task management for AI agentsβ13Updated last week
- Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Reβ¦β20Updated 2 weeks ago
- A python command-line tool to download & manage MLX AI models from Hugging Face.β17Updated 7 months ago
- The world's first fully automated VC fund.β20Updated last week
- AI Search engineβ12Updated last month
- AutoGPT maintainer/reviewer systemβ16Updated last year
- Apps that run on modal.comβ12Updated 9 months ago
- time based thinking and structure like OpenAI's o1 preview.β10Updated 6 months ago
- Medical Mixture of Experts LLM using Mergekit.β20Updated last year