OthersideAI / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆11Updated 2 years ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- A swarm of LLM agents that will help you test, document, and productionize your code!☆17Updated last week
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆48Updated last month
- A forest of autonomous agents.☆19Updated 10 months ago
- The Swarm Ecosystem☆26Updated last year
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆15Updated this week
- CogNetX is an advanced, multimodal neural network architecture inspired by human cognition. It integrates speech, vision, and video proce…☆18Updated last week
- A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!☆41Updated last month
- GPT4 based personalized ArXiv paper assistant bot☆11Updated last year
- ☆14Updated last year
- LangChain + LiteLLM that works☆50Updated 3 months ago
- a suite of finetuned LLMs for atomically precise function calling 🧪☆17Updated last week
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆16Updated last month
- Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.☆16Updated last year
- A simple to use package to call various model providers such as openai, anthropic, and others with utmost reliability, security, and perf…☆13Updated last month
- Tool4AI: A model agnostic, LLM friendly router for tool/function call☆19Updated last year
- ☆11Updated 2 years ago
- The world's first fully automated VC fund.☆25Updated last week
- AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse A…☆23Updated 4 months ago
- Welcome to AGI, the cutting-edge project dedicated to building the core components of Artificial General Intelligence.☆11Updated 2 weeks ago
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Updated last year
- Task management for AI agents☆15Updated 5 months ago
- ATLAS is a sophisticated real-time risk analysis system designed for institutional-grade market risk assessment. Built with high-frequenc…☆11Updated 10 months ago
- NewsAgent is an enterprise-grade news aggregation agent designed to fetch, query, and summarize news from multiple sources at scale.☆23Updated last month
- ☆12Updated 6 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆38Updated last year
- Using GPT-3 and Carrot (GPT-3 for computer vision) to create detailed descriptions of images.☆14Updated 3 years ago
- Examples and guides for using Swarms Framework☆42Updated last month
- Streamlit app for recommending eval functions using prompt diffs☆30Updated last year
- AutoGPT maintainer/reviewer system☆16Updated 2 years ago
- AI Search engine☆12Updated 2 months ago