A high-throughput and memory-efficient inference and serving engine for LLMs
☆37Jul 9, 2026Updated 2 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆33Jul 5, 2026Updated 2 months ago
- Elyan Labs — Hartford AI Day Pitch Deck☆34Aug 6, 2026Updated last month
- Open source library for N64 development.☆35May 18, 2026Updated 3 months ago
- The wolfSSL library is a small, fast, portable implementation of TLS/SSL for embedded devices to the cloud. wolfSSL supports up to TLS 1…☆36May 18, 2026Updated 3 months ago
- LLM inference in C/C++☆35Aug 11, 2026Updated last month
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A list of open source games.☆33Jul 31, 2026Updated last month
- TLS/SSL and crypto library☆35Mar 16, 2026Updated 5 months ago
- A list of Game Development resources to make magic happen.☆32May 18, 2026Updated 3 months ago
- Tensors and Dynamic neural networks in Python with strong GPU acceleration☆28Jul 10, 2026Updated 2 months ago
- Mine RTC while playing retro games on Raspberry Pi. RetroAchievements integration, Proof of Play, Cartridge Relics, Saturday Morning Ques…☆39Jul 25, 2026Updated last month
- The definitive list of lists (of lists) curated on GitHub and elsewhere☆31Mar 21, 2026Updated 5 months ago
- Non-bijunctive attention collapse for LLM inference — POWER8 hardware AES (vcipher) + AltiVec vec_perm. Hebbian path selection, cross-hea…☆41Aug 6, 2026Updated last month
- openpilot is an operating system for robotics. Currently, it upgrades the driver assistance system on 300+ supported cars.☆38Mar 11, 2026Updated 6 months ago
- A fast, compressed, persistent binary data store library for C.☆37May 18, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Météo-France's AI Python package☆43May 18, 2026Updated 3 months ago
- The official firmware for Meshtastic, an open-source, off-grid mesh communication system.☆39Jul 29, 2026Updated last month
- The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.☆40Jul 31, 2026Updated last month
- ☆41May 18, 2026Updated 3 months ago
- An Ergo-Appkit based library providing an abstraction layer to easily interact with AVL Trees as an L2 Solution☆36Jul 31, 2026Updated last month
- Heavily optimized library for DEFLATE/zlib/gzip compression and decompression☆36Mar 16, 2026Updated 5 months ago
- RPI (Resonant Permutation Inference) — Zero-multiply text generation. 18K tok/s. 868 KB models. Standalone or as speculative draft engine…☆41Aug 6, 2026Updated last month
- A VS Code extension that collapses long Tailwind CSS class strings to keep your templates clean and readable. Includes a Tailwind CSS pre…☆35May 20, 2026Updated 3 months ago
- ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator☆30Apr 12, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A curated list of AI video generation tools - text-to-video, avatars, UGC ads, lip sync, and open source models.☆43Apr 28, 2026Updated 4 months ago
- A marketplace for AI-assisted engineers and skilled workers.☆27May 18, 2026Updated 3 months ago
- Capstone disassembly/disassembler framework for ARM, ARM64 (ARMv8), Alpha, BPF, Ethereum VM, HPPA, LoongArch, M68K, M680X, Mips, MOS65XX,…☆35Apr 3, 2026Updated 5 months ago
- Elyan Labs Ecosystem Contributor Registry — every human, bot, and agent tracked with RTC wallets☆58Aug 13, 2026Updated last month
- Profile README — Elyan Labs. Every CPU has a voice.☆44Sep 6, 2026Updated last week
- an awesome list of decentralized services and technologies☆36Mar 16, 2026Updated 5 months ago
- The Linux perf GUI for performance analysis.☆34Mar 18, 2026Updated 5 months ago
- The Next-gen Open Source learning platform for everyone ✨☆42Mar 18, 2026Updated 5 months ago
- Mirror of https://git.ffmpeg.org/ffmpeg.git☆32Mar 18, 2026Updated 5 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A lightweight sandboxing tool for enforcing filesystem and network restrictions on arbitrary processes at the OS level, without requiring…☆26Jul 31, 2026Updated last month
- A curated list of modern Generative Artificial Intelligence projects and services☆36Updated this week
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆32May 15, 2026Updated 4 months ago
- ☆35May 18, 2026Updated 3 months ago
- 🚀🪐🌕🌑☄️🛸 Opensource equivalent of Google's Antigravity☆42Mar 8, 2026Updated 6 months ago
- The Python programming language☆32Mar 18, 2026Updated 5 months ago
- A collection of free software and free culture resources for making amazing games. (mirror)☆34Jul 31, 2026Updated last month