A high-throughput and memory-efficient inference and serving engine for LLMs
☆36Jul 9, 2026Updated 3 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32Jul 5, 2026Updated 4 months ago
- Elyan Labs — Hartford AI Day Pitch Deck☆33Aug 6, 2026Updated 3 months ago
- A list of open source games.☆32Jul 31, 2026Updated 3 months ago
- LLM inference in C/C++☆34Aug 11, 2026Updated 2 months ago
- Open source library for N64 development.☆34May 18, 2026Updated 5 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The wolfSSL library is a small, fast, portable implementation of TLS/SSL for embedded devices to the cloud. wolfSSL supports up to TLS 1…☆35May 18, 2026Updated 5 months ago
- TLS/SSL and crypto library☆34Mar 16, 2026Updated 7 months ago
- A list of Game Development resources to make magic happen.☆31May 18, 2026Updated 5 months ago
- Mine RTC while playing retro games on Raspberry Pi. RetroAchievements integration, Proof of Play, Cartridge Relics, Saturday Morning Ques…☆38Jul 25, 2026Updated 3 months ago
- The official firmware for Meshtastic, an open-source, off-grid mesh communication system.☆38Sep 19, 2026Updated last month
- Tensors and Dynamic neural networks in Python with strong GPU acceleration☆27Jul 10, 2026Updated 3 months ago
- A fast, compressed, persistent binary data store library for C.☆36May 18, 2026Updated 5 months ago
- The definitive list of lists (of lists) curated on GitHub and elsewhere☆30Mar 21, 2026Updated 7 months ago
- Heavily optimized library for DEFLATE/zlib/gzip compression and decompression☆35Mar 16, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Non-bijunctive attention collapse for LLM inference — POWER8 hardware AES (vcipher) + AltiVec vec_perm. Hebbian path selection, cross-hea…☆40Aug 6, 2026Updated 3 months ago
- The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.☆39Sep 19, 2026Updated last month
- Météo-France's AI Python package☆42May 18, 2026Updated 5 months ago
- openpilot is an operating system for robotics. Currently, it upgrades the driver assistance system on 300+ supported cars.☆37Mar 11, 2026Updated 7 months ago
- RPI (Resonant Permutation Inference) — Zero-multiply text generation. 18K tok/s. 868 KB models. Standalone or as speculative draft engine…☆40Aug 6, 2026Updated 3 months ago
- ☆40May 18, 2026Updated 5 months ago
- ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator☆29Apr 12, 2026Updated 6 months ago
- An Ergo-Appkit based library providing an abstraction layer to easily interact with AVL Trees as an L2 Solution☆35Jul 31, 2026Updated 3 months ago
- A marketplace for AI-assisted engineers and skilled workers.☆26May 18, 2026Updated 5 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A VS Code extension that collapses long Tailwind CSS class strings to keep your templates clean and readable. Includes a Tailwind CSS pre…☆34May 20, 2026Updated 5 months ago
- The Next-gen Open Source learning platform for everyone ✨☆41Mar 18, 2026Updated 7 months ago
- A curated list of AI video generation tools - text-to-video, avatars, UGC ads, lip sync, and open source models.☆42Apr 28, 2026Updated 6 months ago
- Profile README — Elyan Labs. Every CPU has a voice.☆43Sep 6, 2026Updated 2 months ago
- The Linux perf GUI for performance analysis.☆33Mar 18, 2026Updated 7 months ago
- Mirror of https://git.ffmpeg.org/ffmpeg.git☆31Mar 18, 2026Updated 7 months ago
- Elyan Labs Ecosystem Contributor Registry — every human, bot, and agent tracked with RTC wallets☆58Sep 27, 2026Updated last month
- Capstone disassembly/disassembler framework for ARM, ARM64 (ARMv8), Alpha, BPF, Ethereum VM, HPPA, LoongArch, M68K, M680X, Mips, MOS65XX,…☆34Apr 3, 2026Updated 7 months ago
- A curated list of modern Generative Artificial Intelligence projects and services☆35Sep 9, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Awesome list of open-source startup alternatives to well-known SaaS products 🚀☆35May 18, 2026Updated 5 months ago
- The Python programming language☆31Mar 18, 2026Updated 7 months ago
- an awesome list of decentralized services and technologies☆35Mar 16, 2026Updated 7 months ago
- A lightweight sandboxing tool for enforcing filesystem and network restrictions on arbitrary processes at the OS level, without requiring…☆25Jul 31, 2026Updated 3 months ago
- Collection of Games that have the source code available on GitHub☆37May 18, 2026Updated 5 months ago
- 🚀🪐🌕🌑☄️🛸 Opensource equivalent of Google's Antigravity☆41Mar 8, 2026Updated 7 months ago
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆31May 15, 2026Updated 5 months ago