A high-throughput and memory-efficient inference and serving engine for LLMs
☆34Mar 21, 2024Updated 2 years ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository of Evolutionary Optimization of Model Merging Recipes☆1,432Nov 29, 2024Updated last year
- Code for Discovering Preference Optimization Algorithms with and for Large Language Models☆196Jun 13, 2024Updated 2 years ago
- CycleQD is a framework for parameter space model merging.☆48Feb 1, 2025Updated last year
- A quick Crew AI tutorial☆23May 9, 2024Updated 2 years ago
- Memory experiments with LLMs☆10Mar 31, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Chef cookbooks for managing a Ceph cluster☆11Apr 2, 2023Updated 3 years ago
- ☆13May 23, 2024Updated 2 years ago
- Automated Design of Agentic Systems☆10Sep 7, 2024Updated last year
- ☆14Jul 5, 2024Updated 2 years ago
- RUN LLAMA-3 70B llm with NVIDIA endpoints☆13Apr 20, 2024Updated 2 years ago
- llmon-py is a multimodal webui for Llama 3-8B.☆16Jul 1, 2024Updated 2 years ago
- ☆138May 15, 2024Updated 2 years ago
- 🌟 SwarmAgent: A framework for simulating social group dynamics using multi-agent collaboration, aiding insights into collective behavior…☆13Dec 5, 2023Updated 2 years ago
- Code release for "MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning"☆11Oct 11, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆17Updated this week
- Knowledge Based Authentication Performance Metrics Projec☆12Nov 20, 2014Updated 11 years ago
- ☆24Nov 19, 2024Updated last year
- this is a trained yolov8n network that only detects people, at "eye-height", trained in a super basic way on COCO☆13Dec 18, 2023Updated 2 years ago
- The Shopify Automation Toolkit☆15Apr 21, 2024Updated 2 years ago
- [ICLR 2024] Thin-shell Object Manipulations with Differentiable Physics Simulations☆55Jun 5, 2024Updated 2 years ago
- ☆12Feb 2, 2024Updated 2 years ago
- map elites python reference implementation☆99Sep 20, 2023Updated 2 years ago
- ICLR Reproducibility Challenge: Generative Adversarial Models For Learning Private And Fair Representations☆12Jan 12, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This template repository provides the boilerplate and file structure required to easily create your own PennyLane plugin.☆11Sep 16, 2020Updated 5 years ago
- Notebooks for CS4305TU Regression Lectures☆11Oct 14, 2022Updated 3 years ago
- ☆14Aug 9, 2024Updated last year
- Get started using Deepgram's Text-to-Speech with this Flask demo app☆16Apr 11, 2026Updated 2 months ago
- Life Coach assistant powered by GPT-4☆13May 25, 2023Updated 3 years ago
- Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separat…☆16Jun 19, 2026Updated 2 weeks ago
- ☆14May 9, 2024Updated 2 years ago
- A nim library for making graphs with GraphViz and DOT (based on PyGraphviz)☆19Sep 6, 2021Updated 4 years ago
- claude-browser☆20Feb 4, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Auto Keyword Suggestion Tool: Extract trending search queries from Google and YouTube. Ideal for content creators and SEO experts, this t…☆16Jan 2, 2024Updated 2 years ago
- Implementation of uniformity tests on the circle and (hyper)sphere, with a C++ core. The package allows the replication of the data appli…☆11Jun 24, 2026Updated last week
- Collect and archive the metaheuristic algorithms and their applications in geophysics.☆15Oct 25, 2019Updated 6 years ago
- ☆108Jun 23, 2026Updated last week
- ☆28Jan 31, 2025Updated last year
- CDL Quantum Hackathon 2020☆19Sep 20, 2020Updated 5 years ago
- A high-performance tokenizer (BPE + SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimizat…☆60Jun 6, 2026Updated 3 weeks ago