OthersideAI / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆10Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- Tool4AI: A model agnostic, LLM friendly router for tool/function call☆17Updated 10 months ago
- Collections of Actions for Custom GPTs (some created by Captain Action)☆10Updated last year
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆13Updated 3 weeks ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆17Updated 3 weeks ago
- Task management for AI agents☆15Updated 3 weeks ago
- The Swarm Ecosystem☆21Updated 10 months ago
- ☆11Updated last year
- ☆20Updated last year
- The world's first fully automated VC fund.☆23Updated 3 weeks ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆20Updated 8 months ago
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆40Updated 2 months ago
- An all-new OS that orchestrates autonomous agents as workers to execute tasks.☆18Updated 7 months ago
- time based thinking and structure like OpenAI's o1 preview.☆10Updated 9 months ago
- ☆27Updated last year
- A platform for building configurable, database-backed generative AI agentic assistants.☆24Updated 4 months ago
- GPT4 based personalized ArXiv paper assistant bot☆10Updated last year
- ☆14Updated last year
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆16Updated 3 years ago
- An OS entirely coded by ChatGPT☆16Updated last year
- ☆14Updated last year
- An app for generating prompts☆27Updated 4 months ago
- alternative way to calculating self attention☆18Updated last year
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆24Updated last year
- LangChain + LiteLLM that works☆44Updated last month
- Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.☆12Updated 7 months ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated 7 months ago
- Apps that run on modal.com☆12Updated last year
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆12Updated last week
- AI Multi-agent system for real-time, adaptive supply chain coordination and optimization leveraging responsive AI clusters.☆18Updated last year
- An open-source integration of GraphRAG for Agentic System with NoCode☆12Updated last week