A high-throughput and memory-efficient inference and serving engine for LLMs
☆36Jul 9, 2026Updated last month
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32Jul 5, 2026Updated last month
- Elyan Labs — Hartford AI Day Pitch Deck☆33Aug 6, 2026Updated 2 weeks ago
- The wolfSSL library is a small, fast, portable implementation of TLS/SSL for embedded devices to the cloud. wolfSSL supports up to TLS 1…☆35May 18, 2026Updated 3 months ago
- Open source library for N64 development.☆34May 18, 2026Updated 3 months ago
- A list of open source games.☆32Jul 31, 2026Updated 3 weeks ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A list of Game Development resources to make magic happen.☆31May 18, 2026Updated 3 months ago
- LLM inference in C/C++☆34Aug 11, 2026Updated 2 weeks ago
- TLS/SSL and crypto library☆34Mar 16, 2026Updated 5 months ago
- Mine RTC while playing retro games on Raspberry Pi. RetroAchievements integration, Proof of Play, Cartridge Relics, Saturday Morning Ques…☆38Jul 25, 2026Updated last month
- The definitive list of lists (of lists) curated on GitHub and elsewhere☆30Mar 21, 2026Updated 5 months ago
- Tensors and Dynamic neural networks in Python with strong GPU acceleration☆27Jul 10, 2026Updated last month
- A fast, compressed, persistent binary data store library for C.☆36May 18, 2026Updated 3 months ago
- Météo-France's AI Python package☆42May 18, 2026Updated 3 months ago
- Heavily optimized library for DEFLATE/zlib/gzip compression and decompression☆35Mar 16, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Non-bijunctive attention collapse for LLM inference — POWER8 hardware AES (vcipher) + AltiVec vec_perm. Hebbian path selection, cross-hea…☆40Aug 6, 2026Updated 2 weeks ago
- openpilot is an operating system for robotics. Currently, it upgrades the driver assistance system on 300+ supported cars.☆37Mar 11, 2026Updated 5 months ago
- The official firmware for Meshtastic, an open-source, off-grid mesh communication system.☆37Jul 29, 2026Updated 3 weeks ago
- The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.☆39Jul 31, 2026Updated 3 weeks ago
- An Ergo-Appkit based library providing an abstraction layer to easily interact with AVL Trees as an L2 Solution☆35Jul 31, 2026Updated 3 weeks ago
- ☆40May 18, 2026Updated 3 months ago
- RPI (Resonant Permutation Inference) — Zero-multiply text generation. 18K tok/s. 868 KB models. Standalone or as speculative draft engine…☆40Aug 6, 2026Updated 2 weeks ago
- A marketplace for AI-assisted engineers and skilled workers.☆26May 18, 2026Updated 3 months ago
- A curated list of AI video generation tools - text-to-video, avatars, UGC ads, lip sync, and open source models.☆42Apr 28, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A VS Code extension that collapses long Tailwind CSS class strings to keep your templates clean and readable. Includes a Tailwind CSS pre…☆34May 20, 2026Updated 3 months ago
- ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator☆29Apr 12, 2026Updated 4 months ago
- The Linux perf GUI for performance analysis.☆33Mar 18, 2026Updated 5 months ago
- A lightweight sandboxing tool for enforcing filesystem and network restrictions on arbitrary processes at the OS level, without requiring…☆24Jul 31, 2026Updated 3 weeks ago
- Capstone disassembly/disassembler framework for ARM, ARM64 (ARMv8), Alpha, BPF, Ethereum VM, HPPA, LoongArch, M68K, M680X, Mips, MOS65XX,…☆34Apr 3, 2026Updated 4 months ago
- Elyan Labs Ecosystem Contributor Registry — every human, bot, and agent tracked with RTC wallets☆57Aug 13, 2026Updated last week
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆31May 15, 2026Updated 3 months ago
- Profile README — Elyan Labs. Every CPU has a voice.☆43Updated this week
- an awesome list of decentralized services and technologies☆35Mar 16, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The Python programming language☆30Mar 18, 2026Updated 5 months ago
- The Next-gen Open Source learning platform for everyone ✨☆41Mar 18, 2026Updated 5 months ago
- Mirror of https://git.ffmpeg.org/ffmpeg.git☆30Mar 18, 2026Updated 5 months ago
- A curated list of modern Generative Artificial Intelligence projects and services☆35Jul 31, 2026Updated 3 weeks ago
- A collection of free software and free culture resources for making amazing games. (mirror)☆33Jul 31, 2026Updated 3 weeks ago
- HACL*, a formally verified cryptographic library written in F*☆32May 18, 2026Updated 3 months ago
- Collection of Games that have the source code available on GitHub☆37May 18, 2026Updated 3 months ago