A high-throughput and memory-efficient inference and serving engine for LLMs
☆53Dec 11, 2023Updated 2 years ago
Alternatives and similar repositories for vllm-release
Users that are interested in vllm-release are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆24Jul 24, 2023Updated 2 years ago
- CLI to check Google Maven repository for versions of AndroidX libraries☆12Updated this week
- BH hackathon☆14Apr 4, 2024Updated last year
- Code and data for the paper "Steering Conversational Large Language Models for Long Emotional Support Conversations" along with a UI to v…☆15Apr 14, 2025Updated 11 months ago
- meta_llama_2finetuned_text_generation_summarization☆21Jul 21, 2023Updated 2 years ago
- Repo for the testing-genai workshop☆13May 8, 2025Updated 10 months ago
- ☆19Aug 23, 2025Updated 7 months ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Nov 28, 2024Updated last year
- AI Powered Dockerfile Generator Using Llama3.1 with GROQ☆11Oct 24, 2024Updated last year
- Simulate System76 EC with area8051 emulator☆12Mar 2, 2024Updated 2 years ago
- Sentence Embedding as a Service☆15Jun 30, 2025Updated 8 months ago
- A search index specialised for LaTeX equations. Developed for latexsearch.com.☆17Jul 15, 2011Updated 14 years ago
- A minimal yet unstoppable blueprint for multi-agent AI—anchored by the rare, far-reaching “Multi-Agent AI DAO” (2017 Prior Art)—empowerin…☆32Jan 11, 2025Updated last year
- Combining ontology and knowledge graph for an ultimate GraphRAG system.☆41Feb 21, 2026Updated last month
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated 10 months ago
- HTML/XML aware reverse proxy☆18Feb 16, 2026Updated last month
- ☆19Dec 31, 2025Updated 2 months ago
- ☆868Dec 8, 2023Updated 2 years ago
- ☆11Apr 3, 2023Updated 2 years ago
- Official inference library for Mistral models☆10,730Feb 26, 2026Updated 3 weeks ago
- A small configuration library written in Haskell☆18Oct 12, 2019Updated 6 years ago
- LLM model runway server☆13Sep 13, 2023Updated 2 years ago
- Autonomous Traversal and Object Detection for Rovers☆15Mar 16, 2026Updated last week
- Code-Langchain☆44Feb 20, 2024Updated 2 years ago
- Tensor library for machine learning☆17Jul 13, 2023Updated 2 years ago
- Evals for agents☆14Dec 4, 2024Updated last year
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆49Mar 16, 2026Updated last week
- Task management for AI agents☆15Jun 25, 2025Updated 9 months ago
- ☆13Feb 13, 2021Updated 5 years ago
- Fast model deployment on AWS EC2☆14Feb 25, 2024Updated 2 years ago
- ☆32Jul 12, 2024Updated last year
- AI coder powered by open source LLMs☆11Nov 28, 2024Updated last year
- ES module distribution for stdlib, a standard library for JavaScript and Node.js.☆13Jan 13, 2021Updated 5 years ago
- Frontier Open-Source Text-to-Speech☆40Dec 16, 2025Updated 3 months ago
- ☆14Mar 26, 2025Updated 11 months ago
- ☆12Feb 17, 2023Updated 3 years ago
- ☆15Feb 23, 2026Updated last month
- Convert an audio file to a waveform video☆11Nov 10, 2023Updated 2 years ago
- ☆13Nov 28, 2023Updated 2 years ago