OthersideAI / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆11Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- ☆11Updated last year
- Collections of Actions for Custom GPTs (some created by Captain Action)☆10Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 8 months ago
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆42Updated last week
- The Swarm Ecosystem☆22Updated last year
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆12Updated last week
- A swarm of LLM agents that will help you test, document, and productionize your code!☆18Updated last week
- AutoGPT maintainer/reviewer system☆16Updated 2 years ago
- ☆14Updated last year
- LangChain + LiteLLM that works☆45Updated 2 months ago
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆14Updated last week
- The world's first fully automated VC fund.☆24Updated last week
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- An all-new OS that orchestrates autonomous agents as workers to execute tasks.☆18Updated 8 months ago
- Tool4AI: A model agnostic, LLM friendly router for tool/function call☆18Updated 11 months ago
- ATLAS is a sophisticated real-time risk analysis system designed for institutional-grade market risk assessment. Built with high-frequenc…☆11Updated 6 months ago
- A forest of autonomous agents.☆19Updated 6 months ago
- 👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)☆23Updated 2 years ago
- ☆15Updated last year
- GPT4 based personalized ArXiv paper assistant bot☆10Updated last year
- Examples and guides for using Swarms Framework☆38Updated this week
- AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse A…☆23Updated 2 weeks ago
- Task management for AI agents☆15Updated last month
- Utility library to work with character cards and roleplay AI in general☆34Updated 2 years ago
- A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!☆35Updated last week
- NewsAgent is an enterprise-grade news aggregation agent designed to fetch, query, and summarize news from multiple sources at scale.☆19Updated last week
- ☆11Updated 2 months ago
- AI Search engine☆12Updated 3 weeks ago
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆26Updated last year
- ☆20Updated last year