SakanaAI / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆34Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- A framework making it effortless to convert any llm model into a reasoning agent like o1 or DeepSeek's r1☆21Updated this week
- ☆17Updated 7 months ago
- The next evolution of Agents☆47Updated this week
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆46Updated this week
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆19Updated this week
- A forest of autonomous agents.☆18Updated 8 months ago
- ☆29Updated last year
- ☆18Updated 10 months ago
- Q-Star Agent Code: A reinforcement learning-based framework for intelligent agents using Microsoft AutoGen. It leverages Q-Star, a Q-lear…☆86Updated last year
- Streamlit Web UI for AGiXT☆28Updated 3 months ago
- Enhancement in Multimodal Representation Learning.☆40Updated last year
- A Python library to orchestrate LLMs in a neural network-inspired structure☆50Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆96Updated this week
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆38Updated last year
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆37Updated last year
- ☆116Updated 9 months ago
- Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊☆131Updated this week
- ☆42Updated last year
- The Library for LLM-based multi-agent applications☆90Updated 2 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 8 months ago
- Interactive Textbook Demo☆47Updated last year
- ☆21Updated 11 months ago
- CAMEL framework-based multi-agent system for task-driven and dynamic environments☆104Updated last year
- Democratizing Function Calling Capabilities for Open-Source Language Models☆41Updated last year
- Unofficial implementation and experiments related to Set-of-Mark (SoM) 👁️☆87Updated last year
- Ultra Fast Multi-Modality Vector Database☆17Updated last year
- Personalized all-purpose AI assistance platform based on hierarchical cooperative multi-agent framework which utilizes websocket connecti…☆38Updated last year
- A framework to enable multimodal models to play games on a computer.☆97Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- Data Questionnaire Agent Chatbot☆69Updated 5 months ago