OthersideAI / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆10Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆35Updated last month
- LangChain + LiteLLM that works☆43Updated last week
- AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse A…☆19Updated 2 months ago
- An all-new OS that orchestrates autonomous agents as workers to execute tasks.☆17Updated 6 months ago
- ☆14Updated last year
- Task management for AI agents☆15Updated this week
- Tool4AI: A model agnostic, LLM friendly router for tool/function call☆17Updated 9 months ago
- ☆11Updated last year
- A swarm of LLM agents that will help you test, document, and productionize your code!☆16Updated this week
- The Swarm Ecosystem☆21Updated 10 months ago
- Collections of Actions for Custom GPTs (some created by Captain Action)☆10Updated last year
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆36Updated last year
- A forest of autonomous agents.☆18Updated 4 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆25Updated 6 months ago
- time based thinking and structure like OpenAI's o1 preview.☆10Updated 8 months ago
- SDK for the Tavily search API which is tailored for LLM agents.☆13Updated 11 months ago
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆12Updated last week
- AutoGPT maintainer/reviewer system☆16Updated 2 years ago
- Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.☆12Updated 6 months ago
- ATLAS is a sophisticated real-time risk analysis system designed for institutional-grade market risk assessment. Built with high-frequenc…☆9Updated 4 months ago
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆13Updated this week
- GPT4 based personalized ArXiv paper assistant bot☆10Updated last year
- ☆20Updated last year
- The world's first fully automated VC fund.☆23Updated last week
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Updated 11 months ago
- Streamlit app for recommending eval functions using prompt diffs☆27Updated last year
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆16Updated last year
- An app for generating prompts☆26Updated 4 months ago
- Streamlit Web UI for AGiXT☆26Updated 3 months ago
- An open-source integration of GraphRAG for Agentic System with NoCode☆12Updated this week