SakanaAI / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆34Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- The next evolution of Agents☆48Updated this week
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆49Updated 3 months ago
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆20Updated 3 months ago
- ☆17Updated 11 months ago
- A forest of autonomous agents.☆19Updated 11 months ago
- A framework making it effortless to convert any llm model into a reasoning agent like o1 or DeepSeek's r1☆23Updated 3 months ago
- Streamlit Web UI for AGiXT☆28Updated last week
- a suite of finetuned LLMs for atomically precise function calling 🧪☆17Updated this week
- Simple Implementation of a Transformer in the new framework MLX by Apple☆19Updated last year
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- BH hackathon☆14Updated last year
- ☆18Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 11 months ago
- Q-Star Agent Code: A reinforcement learning-based framework for intelligent agents using Microsoft AutoGen. It leverages Q-Star, a Q-lear…☆88Updated last year
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆37Updated 2 years ago
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆18Updated 3 weeks ago
- ☆14Updated last year
- ☆119Updated last year
- Chaiverse: the Chai AI developer platform.☆190Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- ☆21Updated last year
- Enhancement in Multimodal Representation Learning.☆41Updated last year
- Official code repository for: DiagrammerGPT: Generating Open-Domain, Open-Platform Diagrams via LLM Planning (COLM 2024)☆153Updated last year
- LLM reads a paper and produce a working prototype☆60Updated 9 months ago
- ☆28Updated last year
- A framework to enable multimodal models to play games on a computer.☆97Updated last year
- ☆54Updated 2 years ago
- Hub for Open Source AGiXT Extensions, Chains, Prompts, and Agents.☆17Updated 2 years ago
- Small Multimodal Vision Model "Imp-v1-3b" trained using Phi-2 and Siglip.☆17Updated last year
- Code for ExploreTom☆89Updated 6 months ago