OthersideAI / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆11Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆47Updated 2 weeks ago
- Collections of Actions for Custom GPTs (some created by Captain Action)☆10Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 10 months ago
- A forest of autonomous agents.☆19Updated 8 months ago
- ☆16Updated last year
- 👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)☆24Updated 2 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆17Updated last week
- The world's first fully automated VC fund.☆25Updated last week
- ☆14Updated last year
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆39Updated last year
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆13Updated last week
- GPT4 based personalized ArXiv paper assistant bot☆10Updated last year
- Code Interpreter Replica☆25Updated 2 years ago
- Streamlit app for recommending eval functions using prompt diffs☆29Updated last year
- AutoGPT maintainer/reviewer system☆16Updated 2 years ago
- ☆12Updated 4 months ago
- LangChain + LiteLLM that works☆47Updated last month
- The Swarm Ecosystem☆25Updated last year
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆17Updated 3 years ago
- 🏥 Health monitor for a Petals swarm☆39Updated last year
- Task management for AI agents☆14Updated 3 months ago
- Utility library to work with character cards and roleplay AI in general☆41Updated 2 years ago
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Updated last year
- Examples and guides for using Swarms Framework☆40Updated 3 weeks ago
- ☆20Updated last year
- Tool4AI: A model agnostic, LLM friendly router for tool/function call☆18Updated last year
- Medical Mixture of Experts LLM using Mergekit.☆20Updated last year
- An all-new OS that orchestrates autonomous agents as workers to execute tasks.☆17Updated 10 months ago
- ☆20Updated last year
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆20Updated last year