A high-throughput and memory-efficient inference and serving engine for LLMs
☆34Mar 21, 2024Updated 2 years ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository of Evolutionary Optimization of Model Merging Recipes☆1,441Nov 29, 2024Updated last year
- Code for Discovering Preference Optimization Algorithms with and for Large Language Models☆196Jun 13, 2024Updated 2 years ago
- CycleQD is a framework for parameter space model merging.☆48Feb 1, 2025Updated last year
- Population Based Training of Petri Dish Neural Cellular Automata☆18Apr 14, 2026Updated 5 months ago
- A quick Crew AI tutorial☆23May 9, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Generative Agents: Interactive Simulacra of Human Behavior - with Local LLMs☆26Aug 15, 2023Updated 3 years ago
- Math library for JavaScript 2D/3D graphics rendering.☆11Aug 30, 2025Updated last year
- This very simple python script takes inputs from your business and outputs articles written bhy claude.☆13Apr 3, 2024Updated 2 years ago
- Artifacts for the "SurgeProtector: Mitigating Temporal Algorithmic Complexity Attacks using Adversarial Scheduling" paper that appears in…☆13Jun 24, 2022Updated 4 years ago
- llmon-py is a multimodal webui for Llama 3-8B.☆16Jul 1, 2024Updated 2 years ago
- 🍏专门为 2024 书生·浦语大模型挑战赛 (春季赛) 准备的 Repo🍎收录了赫萝相关的微调源码☆12Sep 20, 2024Updated 2 years ago
- 🌟 SwarmAgent: A framework for simulating social group dynamics using multi-agent collaboration, aiding insights into collective behavior…☆13Dec 5, 2023Updated 2 years ago
- Template CrewAI allowing for selection of multiple agents including GPT-3, GPT-4, Mixtral, Llama 3, and Gemma☆11May 11, 2024Updated 2 years ago
- Automated Design of Agentic Systems☆10Sep 7, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Legacy frontend repository associated with early SDK.finance implementations. Not under active development.☆13Feb 25, 2026Updated 6 months ago
- 声网云市场插件-大饼变声SDK☆16Jul 10, 2023Updated 3 years ago
- ☆15Aug 7, 2025Updated last year
- Cassandra (CQL) driver for Rust, using the DataStax C/C++ driver under the covers.☆13Jun 17, 2022Updated 4 years ago
- Llama 3 ORPO Fine Tuning on A100 in Colab Pro.☆12Apr 21, 2024Updated 2 years ago
- A new repo to demonstrate tutorials for using HuggingFace on Graphcore IPUs.☆12May 3, 2023Updated 3 years ago
- 道墨云印--树莓派硬件控制部分☆14Dec 8, 2022Updated 3 years ago
- ☆14Aug 9, 2024Updated 2 years ago
- Auto Keyword Suggestion Tool: Extract trending search queries from Google and YouTube. Ideal for content creators and SEO experts, this t…☆16Jan 2, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python toolkit for Active Inference Symposium research analysis: presenter profiling, LLM-assisted proposal generation, and visualization…☆12Aug 3, 2026Updated last month
- Code release for "MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning"☆11Oct 11, 2024Updated last year
- Knowledge Based Authentication Performance Metrics Projec☆13Nov 20, 2014Updated 11 years ago
- my personal mcp server☆13Apr 23, 2025Updated last year
- map elites python reference implementation☆99Sep 20, 2023Updated 3 years ago
- The Shopify Automation Toolkit☆15Apr 21, 2024Updated 2 years ago
- ☆11Jun 14, 2026Updated 3 months ago
- Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral☆17Jan 12, 2025Updated last year
- ☆14May 9, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- URL router for ReactPy☆15Updated this week
- Runs your rivet graphs in a beautiful chat UI☆46Mar 4, 2024Updated 2 years ago
- PyTorch implementation for the Neural Logic Machines (NLM).☆12May 7, 2019Updated 7 years ago
- Code for the paper "Optimal Off-Policy Evaluation from Multiple Logging Policies"☆15Jul 17, 2021Updated 5 years ago
- ⭐️⭐️⭐️⭐️⭐️Spring plugin development framework, Light, Fast, Easy, and StableSpring 插件化开发框架，轻、快、易、稳 ⭐️⭐️⭐️⭐️⭐️☆16Mar 6, 2026Updated 6 months ago
- ☆13Jul 24, 2018Updated 8 years ago
- ☆15May 8, 2025Updated last year