SakanaAI / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆34Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- ☆17Updated 8 months ago
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆19Updated 2 weeks ago
- The next evolution of Agents☆47Updated this week
- ☆18Updated 11 months ago
- A framework making it effortless to convert any llm model into a reasoning agent like o1 or DeepSeek's r1☆22Updated 2 weeks ago
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆47Updated 2 weeks ago
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆15Updated this week
- A framework to enable multimodal models to play games on a computer.☆96Updated last year
- ☆29Updated last year
- Simple Implementation of a Transformer in the new framework MLX by Apple☆18Updated 11 months ago
- Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊☆133Updated last week
- Unofficial implementation and experiments related to Set-of-Mark (SoM) 👁️☆87Updated 2 years ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆99Updated this week
- A forest of autonomous agents.☆17Updated 9 months ago
- Streamlit Web UI for AGiXT☆28Updated 4 months ago
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆16Updated 2 weeks ago
- An automated tool for discovering insights from research papaer corpora☆138Updated last year
- Ultra Fast Multi-Modality Vector Database☆17Updated last year
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆37Updated last year
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…☆24Updated last year
- Hub for Open Source AGiXT Extensions, Chains, Prompts, and Agents.☆17Updated 2 years ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 9 months ago
- Small Multimodal Vision Model "Imp-v1-3b" trained using Phi-2 and Siglip.☆17Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- ☆53Updated last year
- The Next Generation Multi-Modality Superintelligence☆69Updated last year
- Finetune any model on HF in less than 30 seconds☆55Updated last week
- ☆35Updated 2 years ago
- Code for ExploreTom☆86Updated 4 months ago