vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support
☆22Jun 20, 2026Updated 2 months ago
Alternatives and similar repositories for vllm-v100
Users that are interested in vllm-v100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM fork for Tesla V100 (SM70) with AWQ 4-bit support, CUDA 12.8 build flow, and validated Qwen3.5 27B/35B deployment on multi-GPU V…☆683Updated this week
- Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V☆194Jun 30, 2026Updated last month
- forked from vllm-project/flash-attention☆62May 9, 2026Updated 3 months ago
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆31Jul 8, 2026Updated last month
- RadioHead Packet Radio library for embedded microprocessors from http://www.airspayce.com/mikem/arduino/RadioHead/☆15Mar 5, 2018Updated 8 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- llama-cpp support turboquant and gemma 4☆21May 19, 2026Updated 3 months ago
- gEDA for Windows plus gSpiceUI☆17Jul 31, 2018Updated 8 years ago
- Training a bot using reinforcement learning to aim and fire at a target.☆13Jan 6, 2020Updated 6 years ago
- PXQ: PXA-native low-bit MoE quants (2/3/4-bit, E16-row scales) + fused CUDA kernels for Pascal/Volta — run a real 35B on a salvaged 12-16…☆16Updated this week
- SDR firmware and bootloader with configuration files for use with Eclipse, EmBitz and Makefile☆12Jan 25, 2024Updated 2 years ago
- A professional ESP32-based DMR hotspot with MMDVM modem support, real-time web interface and BrandMeister network integration.☆23Apr 2, 2026Updated 4 months ago
- ☆15Sep 27, 2024Updated last year
- The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.☆70Aug 11, 2026Updated 2 weeks ago
- A Rust-based, SenseVoiceSmall☆40Apr 27, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic…☆23Mar 6, 2026Updated 5 months ago
- LLM inference in C/C++☆37Updated this week
- Windows Programming software for the SA818 SR110 SR-FRS radio module.☆20Mar 28, 2023Updated 3 years ago
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆23Apr 3, 2026Updated 4 months ago
- Altera USB Blaster porting to Artery AT32F425 and WCH CH32V203.☆28Jun 7, 2025Updated last year
- ModelCypher - Decipher the high dimensional geometry of LLMs. An open source x-ray into LLM representation structure.☆25Jul 14, 2026Updated last month
- Alternative IP Camera firmware from an open community☆18Jan 22, 2026Updated 7 months ago
- My playground. Currently used as an auto builder for some custom board configs. EXPERIMENTAL CHANGES WARNING☆24Jan 2, 2025Updated last year
- Dual channel Arduino Nano milliwatt power meter for HF/VHF/UHF/SHF bands☆30Nov 1, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A simple, observable code-writing agent builder in TypeScript.☆33Apr 9, 2025Updated last year
- Performance‑enhanced IMBE/AMBE vocoder primitives with modern CMake packaging.☆30Updated this week
- Low cost, low part count CH32V003-based oscilloscope☆28Dec 27, 2025Updated 7 months ago
- 🟢 NVIDIA ONLY – All-in-One TTS App with Kokoro, KittenTTS, Higgs audio, Chatterbox, Fish-Speech, F5 & index-tts & indextts2, Supports Co…☆29Feb 18, 2026Updated 6 months ago
- M17 Analog Gateway by ESP32☆36Sep 19, 2023Updated 2 years ago
- 🤵 AIfred-Intelligence — self-hosted Multi-Agent Assistant with Debate Modes (Symposion/Tribunal), Voice (STT + Streaming-TTS), RAG with …☆35Updated this week
- Open Source Open Hardware USB Pic Programmer☆39Mar 11, 2025Updated last year
- Adaptive Reasoning Engine for Efficient and Context-Aware Intelligence☆49Nov 15, 2025Updated 9 months ago
- ☆156Jun 13, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆35Jan 30, 2025Updated last year
- Xilinx virtual cable server for generic FTDI 4232H.☆65Feb 9, 2024Updated 2 years ago
- Bayesian CW Decoder for Pi Pico☆37May 22, 2026Updated 3 months ago
- SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB G…☆212Updated this week
- Agent orchestration framework with Git-backed storage. Every turn is a Git commit - inspectable, rewindable, forkable.☆56Aug 5, 2026Updated 2 weeks ago
- NVIDIA Linux open GPU with P2P support☆445Updated this week
- HTTP proxy that fixes malformed tool calls from Qwen3-Coder LLM models for seamless integration with OpenCode☆40Aug 15, 2025Updated last year