OthersideAI / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
☆10Updated last year
Alternatives and similar repositories for vllm:
Users that are interested in vllm are comparing it to the libraries listed below
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆37Updated last month
- A swarm of LLM agents that will help you test, document, and productionize your code!☆15Updated 2 weeks ago
- An all-new OS that orchestrates autonomous agents as workers to execute tasks.☆17Updated 5 months ago
- An open-source integration of GraphRAG for Agentic System with NoCode☆12Updated 3 weeks ago
- A simple to use package to call various model providers such as openai, anthropic, and others with utmost reliability, security, and perf…☆13Updated last month
- ☆14Updated last year
- Collections of Actions for Custom GPTs (some created by Captain Action)☆10Updated last year
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆13Updated 2 weeks ago
- An advanced distributed knowledge fabric for intelligent document processing, featuring multi-document agents, optimized query handling, …☆28Updated 8 months ago
- The Swarm Ecosystem☆20Updated 9 months ago
- AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse A…☆19Updated last month
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆25Updated last year
- TaskWeaver Plugins☆12Updated last year
- Apps that run on modal.com☆12Updated 11 months ago
- An AI agent that writes code for you☆11Updated 10 months ago
- LangChain + LiteLLM that works☆39Updated 2 weeks ago
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆12Updated last week
- ☆11Updated last year
- Task management for AI agents☆15Updated 2 weeks ago
- Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Hu…☆17Updated this week
- AI Search engine☆12Updated 2 months ago
- BH hackathon☆14Updated last year
- ☆32Updated last year
- MCP Server implementation for Claude☆25Updated 5 months ago
- 👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)☆23Updated 2 years ago
- NewsAgent is an enterprise-grade news aggregation agent designed to fetch, query, and summarize news from multiple sources at scale.☆16Updated 2 weeks ago
- Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.☆12Updated 5 months ago
- ☆20Updated last year
- A forest of autonomous agents.☆19Updated 3 months ago
- A minimal Model Context Protocol 🖥️ server/client🧑💻with Azure OpenAI and 🌐 web browser control via Playwright.☆18Updated 3 weeks ago