A high-throughput and memory-efficient inference and serving engine for LLMs
☆34Mar 21, 2024Updated 2 years ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository of Evolutionary Optimization of Model Merging Recipes☆1,436Nov 29, 2024Updated last year
- Code for Discovering Preference Optimization Algorithms with and for Large Language Models☆196Jun 13, 2024Updated 2 years ago
- CycleQD is a framework for parameter space model merging.☆48Feb 1, 2025Updated last year
- Population Based Training of Petri Dish Neural Cellular Automata☆16Apr 14, 2026Updated 3 months ago
- Memory experiments with LLMs☆11Mar 31, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The official Kamen Rider Craft The 4th Git!!☆23Sep 23, 2024Updated last year
- An implementation of the paper "Solving the Rubik's Cube without Human Knowledge"☆14Dec 9, 2018Updated 7 years ago
- ☆12May 23, 2024Updated 2 years ago
- to analyze martial arts motion with CMU OpenPose. License depends on OpenPose.☆11Mar 28, 2019Updated 7 years ago
- Math library for JavaScript 2D/3D graphics rendering.☆11Aug 30, 2025Updated 11 months ago
- This very simple python script takes inputs from your business and outputs articles written bhy claude.☆13Apr 3, 2024Updated 2 years ago
- RUN LLAMA-3 70B llm with NVIDIA endpoints☆13Apr 20, 2024Updated 2 years ago
- Artifacts for the "SurgeProtector: Mitigating Temporal Algorithmic Complexity Attacks using Adversarial Scheduling" paper that appears in…☆13Jun 24, 2022Updated 4 years ago
- A Mac OS X application for recording the screen and converting to .webm (for now) -- written in Swift☆10Dec 19, 2014Updated 11 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- llmon-py is a multimodal webui for Llama 3-8B.☆16Jul 1, 2024Updated 2 years ago
- 🍏专门为 2024 书生·浦语大模型挑战赛 (春季赛) 准备的 Repo🍎收录了赫萝相关的微调源码☆12Sep 20, 2024Updated last year
- CounterSocial-Core (AGPLv3)☆10Oct 25, 2021Updated 4 years ago
- Automated Design of Agentic Systems☆10Sep 7, 2024Updated last year
- I'm bored☆12Nov 30, 2022Updated 3 years ago
- Legacy frontend repository associated with early SDK.finance implementations. Not under active development.☆12Feb 25, 2026Updated 5 months ago
- ☆17Sep 13, 2024Updated last year
- 声网云市场插件-大饼变声SDK☆15Jul 10, 2023Updated 3 years ago
- Azure Command-Line Interface☆15Mar 26, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆15Aug 7, 2025Updated 11 months ago
- Cassandra (CQL) driver for Rust, using the DataStax C/C++ driver under the covers.☆13Jun 17, 2022Updated 4 years ago
- Llama 3 ORPO Fine Tuning on A100 in Colab Pro.☆12Apr 21, 2024Updated 2 years ago
- A new repo to demonstrate tutorials for using HuggingFace on Graphcore IPUs.☆12May 3, 2023Updated 3 years ago
- This repository demonstrates how to fine-tune the Google Gemma 2 2B model to improve its performance on Japanese instruction-following ta…☆12Aug 11, 2024Updated last year
- Depot - MacOS app for managing 3D model content and resources.☆13May 18, 2023Updated 3 years ago
- ☆14Aug 9, 2024Updated last year
- Auto Keyword Suggestion Tool: Extract trending search queries from Google and YouTube. Ideal for content creators and SEO experts, this t…☆16Jan 2, 2024Updated 2 years ago
- RabbitMQ on Render☆16Feb 18, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The Shopify Automation Toolkit☆15Apr 21, 2024Updated 2 years ago
- Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral☆17Jan 12, 2025Updated last year
- Built on the robust XTuner backend framework, XTuner Chat GUI offers a user-friendly platform for quick and efficient local model inferen…☆13Feb 5, 2024Updated 2 years ago
- URL router for ReactPy☆15Jul 23, 2026Updated last week
- ☆14May 9, 2024Updated 2 years ago
- PyTorch implementation for the Neural Logic Machines (NLM).☆12May 7, 2019Updated 7 years ago
- ⭐️⭐️⭐️⭐️⭐️Spring plugin development framework, Light, Fast, Easy, and StableSpring 插件化开发框架，轻、快、易、稳 ⭐️⭐️⭐️⭐️⭐️☆16Mar 6, 2026Updated 4 months ago