Optimized VLLM for Ampere
☆24Oct 18, 2026Updated last week
Alternatives and similar repositories for vllm-ampere-optimized
Users that are interested in vllm-ampere-optimized are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Jan 3, 2026Updated 9 months ago
- FlashAttention-style custom attention backend for vLLM on AMD MI50/MI60/Radeon VII (gfx906). Downstream fork of mixa3607/ML-gfx906 with r…☆16Apr 22, 2026Updated 6 months ago
- Unlocking NVIDIA CMP 90HX (GA102): kernel 6.12☆39Aug 22, 2026Updated 2 months ago
- CLI port of BenchLocal quality bench packs — runs LLM behavioral evals against any OpenAI-compatible endpoint. Companion to club-3090.☆20Oct 16, 2026Updated last week
- [ICML 2026] NanoQuant: Efficient Sub-1-Bit Quantization of Large Language Models☆24Jul 3, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- LLM inference in C/C++☆56Aug 8, 2026Updated 2 months ago
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆133Sep 30, 2026Updated 3 weeks ago
- An easy to use off-policy synthetic data distillation engine for LLMs.☆20Oct 4, 2026Updated 2 weeks ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆45Updated this week
- This is a repository for documenting the setup and performance of MI100s in popular inference engines.☆19Oct 8, 2026Updated 2 weeks ago
- ☆19Sep 9, 2026Updated last month
- Redis APN Daemon☆14Dec 9, 2012Updated 13 years ago
- OLLVM-Next (Ensia): The next generation LLVM based Obfuscator☆37Updated this week
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Macintosh IIvi☆15Aug 28, 2026Updated last month
- A tool to create, build, and manage MCP servers for use with Claude and other MCP clients☆12Mar 14, 2025Updated last year
- HikVision IP Camera Alarm Server to MQTT☆14Sep 20, 2023Updated 3 years ago
- web2py: jqgrid interface☆10Aug 14, 2012Updated 14 years ago
- Physics Master is a model fine-tuned from llama3-8B-Instruct. It can answer your physics question!☆16Aug 24, 2024Updated 2 years ago
- The 4th Coming: Next Generation Revival Project☆10Mar 29, 2017Updated 9 years ago
- Discontinued Source Code for ZygiskPG/zyCheatsPG☆13Jul 12, 2023Updated 3 years ago
- CLI tool designed to manage MCI (Model Context Interface) schemas and dynamically run MCP servers using defined MCI toolsets☆15Nov 12, 2025Updated 11 months ago
- Proxima lets existing GPUs serve 4x more concurrent requests☆26Aug 19, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Benchmark AI model speeds with TTFT, tokens/sec, and performance metrics .☆22Jul 23, 2026Updated 3 months ago
- 🌏 Java filesystem SPIs with Fuse (googledrive, onedrive, dropbox, box, etc...)☆11Oct 9, 2026Updated 2 weeks ago
- ☆12Apr 28, 2017Updated 9 years ago
- Unlock P2P comms between consumer NVIDIA GPUs☆623Sep 16, 2026Updated last month
- Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,86…☆125Oct 15, 2026Updated last week
- Single-file installer for a club-3090 webserver providing an admin control panel, a reverse proxy that automatically routes requests to t…☆28Jul 8, 2026Updated 3 months ago
- ☆21May 17, 2026Updated 5 months ago
- [ICLR'25] Official repository of paper: Ranking-aware adapter for text-driven image ordering with CLIP☆16Apr 17, 2025Updated last year
- React Native App Onboard is a customizable, easy-to-use, and efficient library for creating compelling onboarding experiences for your Re…☆12Jun 18, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Builds vLLM for ROCm gfx906 using Nix☆17Aug 29, 2026Updated last month
- Flask webapp w/ admin template project☆11Oct 18, 2012Updated 14 years ago
- ☆14May 14, 2026Updated 5 months ago
- High performance Java reflection(revised version)☆12Feb 16, 2023Updated 3 years ago
- Venster is a highly native Windows GUI toolkit for Python based on the ctypes ffi library.☆12Mar 9, 2010Updated 16 years ago
- A rewritten edition of il2cpp dumper to support recent Unity vers (e.g. Unity 6000.0) and modified vers of the Unity Engine.☆14Feb 13, 2025Updated last year
- A template for the oneplus-enchilada (OnePlus 6) using Mobile NixOS☆12May 2, 2023Updated 3 years ago