SakanaAI / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆29Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- This repository contains a fork from "language-models-trajectory-generators", the goal is to test the same functionality with Mistrals LL…☆21Updated 8 months ago
- ☆17Updated 4 months ago
- A forest of autonomous agents.☆19Updated 5 months ago
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆19Updated this week
- ☆21Updated 7 months ago
- A framework making it effortless to convert any llm model into a reasoning agent like o1 or DeepSeek's r1☆21Updated this week
- Finetune any model on HF in less than 30 seconds☆57Updated 2 months ago
- The next evolution of Agents☆48Updated this week
- BH hackathon☆14Updated last year
- ☆21Updated 3 weeks ago
- Small Multimodal Vision Model "Imp-v1-3b" trained using Phi-2 and Siglip.☆17Updated last year
- ☆54Updated last year
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆40Updated this week
- Q-Star Agent Code: A reinforcement learning-based framework for intelligent agents using Microsoft AutoGen. It leverages Q-Star, a Q-lear…☆86Updated last year
- Interactive Textbook Demo☆44Updated last year
- The original Shared Recurrent Memory Transformer implementation☆27Updated 2 weeks ago
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆12Updated 2 weeks ago
- RAG Agent for the ARC AGI Challenge☆21Updated 11 months ago
- Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…☆22Updated last month
- ☆18Updated 6 months ago
- ☆21Updated 4 months ago
- LLM reads a paper and produce a working prototype☆57Updated 2 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆80Updated 3 months ago
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆34Updated last year
- ☆29Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆71Updated this week
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 5 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- ☆41Updated last year