INT8-native vLLM fork
☆22Oct 17, 2026Updated this week
Alternatives and similar repositories for int8-vllm
Users that are interested in int8-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆25Sep 30, 2026Updated 3 weeks ago
- Various social media interface tools.☆18Feb 21, 2021Updated 5 years ago
- Per-commit evidence records for agent-written code. Captures what the agent tried, what verified it, and what nobody reviewed☆23Sep 15, 2026Updated last month
- Streaming parser to extract tarballs with ReactPHP.☆12Updated this week
- FlashAttention-style custom attention backend for vLLM on AMD MI50/MI60/Radeon VII (gfx906). Downstream fork of mixa3607/ML-gfx906 with r…☆16Apr 22, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆12Feb 8, 2025Updated last year
- pyCSH: automated generation of realistic bulk calcium silicate hydrate (C-S-H) structures.☆13Jun 26, 2024Updated 2 years ago
- A Darwin/XNU Based Operating System☆24Sep 12, 2026Updated last month
- ☆10Jul 19, 2021Updated 5 years ago
- 100% offline voice dictation for macOS, Windows & Linux — Whisper & Parakeet on-device, no cloud, open source.☆28Sep 18, 2026Updated last month
- ☆43Sep 10, 2026Updated last month
- ninfer-ext: Forked for speed.☆26Updated this week
- 🚿 Llaminar: an LLM inferencing engine in C++.☆45Oct 9, 2026Updated last week
- Wireless realtime skeleton-tracking and skeleton-reconstruction in Augmented Reality between devices, powered by Unity ARFoundation.☆17Sep 29, 2020Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A Rust library for draping polygons over terrain with gfx☆11Mar 5, 2018Updated 8 years ago
- The J-Core Jx Platform board hardware.☆17Jun 21, 2020Updated 6 years ago
- ☆33Aug 17, 2026Updated 2 months ago
- A learning-focussed, simplified implementation of ContainerSSH☆11Dec 16, 2020Updated 5 years ago
- Alternative to try-catch wrapping async/await☆19Jun 17, 2020Updated 6 years ago
- A python framework to develop games with real world object tracking (using cameras) combined with projection mapping☆13Apr 28, 2021Updated 5 years ago
- Earth and Beyond server-side code, dev tools, content DB.☆11May 11, 2014Updated 12 years ago
- A geometric deep learning model for predicting molecular tensorial properties and selected spectra with high accurately and efficiency☆17Nov 10, 2024Updated last year
- Bash script presents crontab in human readable form.☆11Apr 21, 2018Updated 8 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A compilation of docker-compose recipes, for self-hosted applications and services.☆13Jun 19, 2025Updated last year
- Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,86…☆124Oct 15, 2026Updated last week
- Deploy Nginx Ingress on an EKS cluster using Terraform & Helm.☆14Feb 11, 2022Updated 4 years ago
- CPU-GPU hybrid inference for DeepSeek-V4 on NVIDIA SM80+ (A100/RTX 4090 etc.), forked from yhfgyyf/vllm-deepseek-v4-sm89.☆60Sep 16, 2026Updated last month
- MacOS on BC-250 via OpenCore.☆25Oct 1, 2026Updated 3 weeks ago
- A tool to unlobotomize your NVIDIA card!☆32Sep 6, 2026Updated last month
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆26Jun 23, 2026Updated 3 months ago
- LLM inference in C/C++☆64Oct 15, 2026Updated last week
- A fork of https://github.com/Niko1221/Strata optimized for my 3090+5070 Ti setup, see docs/COMPARISON.md. Renamed to StrataFast.☆48Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆28Aug 19, 2026Updated 2 months ago
- A translator based on text generation webui allow you use local language model to translate epub book☆16Jun 11, 2023Updated 3 years ago
- ☆20Sep 14, 2026Updated last month
- Metal acceleration project for the ASRock BC-250 on macOS. Based on ChefKiss' NootedRed project. LLMs are used in this project for debugg…☆38Oct 1, 2026Updated 3 weeks ago
- Yet Another SteamOS Toolkit☆53Updated this week
- ☆24May 28, 2025Updated last year
- A browser extension to automatically extract and batch-copy transcripts from Udemy videos. Perfect for students and learners who use note…☆24Oct 7, 2026Updated 2 weeks ago