A high-throughput and memory-efficient inference and serving engine for LLMs
☆34Mar 21, 2024Updated 2 years ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository of Evolutionary Optimization of Model Merging Recipes☆1,436Nov 29, 2024Updated last year
- Code for Discovering Preference Optimization Algorithms with and for Large Language Models☆196Jun 13, 2024Updated 2 years ago
- CycleQD is a framework for parameter space model merging.☆49Feb 1, 2025Updated last year
- A quick Crew AI tutorial☆23May 9, 2024Updated 2 years ago
- ☆58Nov 6, 2025Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Generative Agents: Interactive Simulacra of Human Behavior - with Local LLMs☆26Aug 15, 2023Updated 3 years ago
- Helm charts repository☆17Jul 7, 2026Updated last month
- The official Kamen Rider Craft The 4th Git!!☆23Sep 23, 2024Updated last year
- Math library for JavaScript 2D/3D graphics rendering.☆11Aug 30, 2025Updated last year
- RUN LLAMA-3 70B llm with NVIDIA endpoints☆12Apr 20, 2024Updated 2 years ago
- Artifacts for the "SurgeProtector: Mitigating Temporal Algorithmic Complexity Attacks using Adversarial Scheduling" paper that appears in…☆13Jun 24, 2022Updated 4 years ago
- A Mac OS X application for recording the screen and converting to .webm (for now) -- written in Swift☆10Dec 19, 2014Updated 11 years ago
- ☆138May 15, 2024Updated 2 years ago
- Automated Design of Agentic Systems☆10Sep 7, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆17Sep 13, 2024Updated last year
- ☆11Jan 10, 2024Updated 2 years ago
- 声网云市场插件-大饼变声SDK☆16Jul 10, 2023Updated 3 years ago
- Azure Command-Line Interface☆15Mar 26, 2026Updated 5 months ago
- Llama 3 ORPO Fine Tuning on A100 in Colab Pro.☆12Apr 21, 2024Updated 2 years ago
- 道墨云印--树莓派硬件控制部分☆14Dec 8, 2022Updated 3 years ago
- Get started using Deepgram's Text-to-Speech with this Flask demo app☆16Aug 14, 2026Updated 2 weeks ago
- ☆14Aug 9, 2024Updated 2 years ago
- Python toolkit for Active Inference Symposium research analysis: presenter profiling, LLM-assisted proposal generation, and visualization…☆12Aug 3, 2026Updated 3 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Code release for "MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning"☆11Oct 11, 2024Updated last year
- ☆14Dec 16, 2022Updated 3 years ago
- This module uses the Metasploit framework built into Kali Linux to create a backdoor☆15Dec 3, 2020Updated 5 years ago
- The source code of ICLR 2025 "Beyond Graphs: Can Large Language Models Comprehend Hypergraphs?"☆43Jan 26, 2025Updated last year
- Naraeon SSD Tools, SSD Management Tool.☆24Feb 14, 2018Updated 8 years ago
- Naive Bayes Tweet Sentiment Classifier in Kotlin☆14Sep 21, 2020Updated 5 years ago
- MLJAR Agent taking part in AutoGPT hackathon. Testing micro-agents and scenario prompts.☆15Oct 25, 2023Updated 2 years ago
- RabbitMQ on Render☆16Feb 18, 2026Updated 6 months ago
- The Shopify Automation Toolkit☆15Apr 21, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral☆17Jan 12, 2025Updated last year
- Built on the robust XTuner backend framework, XTuner Chat GUI offers a user-friendly platform for quick and efficient local model inferen…☆13Feb 5, 2024Updated 2 years ago
- URL router for ReactPy☆15Jul 23, 2026Updated last month
- Implementation of uniformity tests on the circle and (hyper)sphere, with a C++ core. The package allows the replication of the data appli…☆11Aug 7, 2026Updated 3 weeks ago
- ⭐️⭐️⭐️⭐️⭐️Spring plugin development framework, Light, Fast, Easy, and StableSpring 插件化开发框架，轻、快、易、稳 ⭐️⭐️⭐️⭐️⭐️☆16Mar 6, 2026Updated 5 months ago
- ☆12Jun 5, 2024Updated 2 years ago
- ☆19Oct 29, 2017Updated 8 years ago