Block-FP8 (W8A16) on NVIDIA V100 / Volta (sm_70) for vLLM — the FP8 path upstream drops on Volta, tuned for sparse MoE.
☆15Jul 10, 2026Updated 4 months ago
Alternatives and similar repositories for vllm-fp8-w8a16-sm70
Users that are interested in vllm-fp8-w8a16-sm70 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆25Jul 10, 2026Updated 4 months ago
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区,聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆27Jul 2, 2026Updated 4 months ago
- vLLM fork for Tesla V100☆15May 31, 2026Updated 5 months ago
- CS 189/289A (Introduction to Machine Learning), Prof. Shewchuk☆10Jan 12, 2024Updated 2 years ago
- 1Cat Studio: unified vLLM workbench, Codex Agent and creative canvas☆15Nov 6, 2026Updated 2 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A Simple Tool to gather information from any website, domain, sub-domain, DNS, links by enumeration with simple commands.☆18Jun 7, 2024Updated 2 years ago
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆13Jul 22, 2026Updated 3 months ago
- llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefil…☆84Nov 12, 2026Updated last week
- Worm is an Android post exploitation Framework to gain remote access of any Android device by exploiting Android Debug Bridge.☆19Jun 7, 2024Updated 2 years ago
- a simple keylogger that records hardware inputs like keyboard, mouse, microphone and webcam and sends it to your e-mail.☆22Oct 18, 2024Updated 2 years ago
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆66Updated this week
- CUDA implementation of Filecoin's PC2 operation☆12Jun 20, 2023Updated 3 years ago
- FlashAttention brought back to Tesla V100 — a deep llama.cpp fork: SM 7.0 D256 kernels, SplitKV3, q4_0 KV cache, DFlash2 speculative deco…☆19Nov 8, 2026Updated last week
- HorizonPush is a file-sharing and synchronization tool leveraging iroh for peer-to-peer transfers and multi-provider blob streaming. It p…☆16Apr 3, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 一个为 Qwen-Code 提供响应式 Web 界面的项目,让您可以从任何设备进行 AI 辅助编程。☆17Sep 8, 2026Updated 2 months ago
- HideMePlease is a new generation tool to hide phising web links into legitimate web links with original domains (eg: facebook.com, instag…☆36Jun 3, 2024Updated 2 years ago
- Voice typing for Windows. local & cloud ASR (Seed-ASR 2.0 )豆包语音输入法,FireRedASR2,Qwen audio/ASR,microsoft/mai-transcribe-2,MIMO ASR☆21Updated this week
- llama-cpp support turboquant and gemma 4☆20May 19, 2026Updated 6 months ago
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆29Jul 8, 2026Updated 4 months ago
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆188Aug 19, 2026Updated 3 months ago
- Last updated~ 26/03/2026 Old layouts can be viewed here - https://github.com/COUNTRY-HUMANS/old-readme & https://github.com/COUNTRY-HUMA…☆38Oct 10, 2026Updated last month
- Leveraging Optical Character Recognition (OCR) technology to automatically read container numbers directly from images, offering innovati…☆17Jan 6, 2024Updated 2 years ago
- Rust SurrealDB Tutoria☆20Oct 15, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support☆27Jun 20, 2026Updated 5 months ago
- SemiFA: Agentic Multi-Modal Framework for Autonomous Semiconductor Failure Analysis Report Generation | LangGraph · LLaVA-1.6 · DINOv2 · …☆16Apr 16, 2026Updated 7 months ago
- ☆17Mar 17, 2025Updated last year
- V100 / SM70-focused vLLM engineering fork for modern LLM inference.☆1,550Updated this week
- A Vue directive that prevents vertical scrolling outside the current element when top or bottom are reached.☆20Feb 8, 2018Updated 8 years ago
- This crate provides core types for interoperating with IPLD.☆35Feb 17, 2026Updated 9 months ago
- ☆15Updated this week
- 毕业设计:基于SpringBoot及thymeleaf搭建的疫情信息管理系统☆12Sep 27, 2020Updated 6 years ago
- Refined types for Typescript☆26Aug 18, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- SpringBoot示例项目☆20Mar 31, 2022Updated 4 years ago
- ☆49Updated this week
- ☆35Oct 20, 2025Updated last year
- csdn下载,csdn免积分下载,csdn免会员下载,csdn付费内容下载☆20Apr 8, 2026Updated 7 months ago
- A translator that translates the text inside an image and reconstructs the image by replacing actual text with the translated text.☆22Apr 7, 2019Updated 7 years ago
- Transaction scoring demo with RedisAI☆18May 15, 2024Updated 2 years ago
- This is the official **live** mirror of Huawei Ascend-native hardware plugin for ray☆16Oct 28, 2026Updated 3 weeks ago
Are these results useful?