SakanaAI / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆30Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆19Updated last week
- A framework making it effortless to convert any llm model into a reasoning agent like o1 or DeepSeek's r1☆21Updated last week
- ☆17Updated 3 months ago
- ☆21Updated 7 months ago
- This repository contains a fork from "language-models-trajectory-generators", the goal is to test the same functionality with Mistrals LL…☆21Updated 7 months ago
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…☆23Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆60Updated last week
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆90Updated 4 months ago
- BH hackathon☆14Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆34Updated last year
- LLM reads a paper and produce a working prototype☆57Updated last month
- Code release for the paper, "Proactive Agents for Text-to-Image Generation under Uncertainty"☆35Updated 2 weeks ago
- ☆54Updated last year
- ☆29Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Streamlit Web UI for AGiXT☆26Updated 3 months ago
- Implementation of AutoRT: "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"☆39Updated 6 months ago
- Modified Beam Search with periodical restart☆12Updated 8 months ago
- The next evolution of Agents☆48Updated last week
- 🧠 Societies of Mind & Economy of Minds☆58Updated 2 months ago
- All the world is a play, we are but actors in it.☆50Updated this week
- Finetune any model on HF in less than 30 seconds☆58Updated 2 months ago
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆38Updated 8 months ago
- ☆11Updated last year
- Democratizing Function Calling Capabilities for Open-Source Language Models☆40Updated last year
- The Next Generation Multi-Modality Superintelligence☆71Updated 9 months ago
- ☆17Updated 2 weeks ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- ProfitPilot closes deals for you effortlessly 24/7, just provide a list of customer and ProfitPilot will reach out on your behalf and clo…☆22Updated last year