forked from vllm-project/flash-attention
☆69May 9, 2026Updated 5 months ago
Alternatives and similar repositories for flash-attention-v100
Users that are interested in flash-attention-v100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 3 months ago
- Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V☆214Oct 14, 2026Updated last week
- This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 …☆22Mar 18, 2026Updated 7 months ago
- 1CatV2 with TileLANG written FA-v100 and many goodies☆20Jul 15, 2026Updated 3 months ago
- vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support☆26Jun 20, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated 11 months ago
- Sol-Attn (arXiv 2607.24027) sparse acceleration for MiniMax H3 on V100 — single-node ComfyUI plugin (embedded FP16Safe + keep-or-drop ker…☆34Aug 29, 2026Updated last month
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated 3 weeks ago
- ComfyUI MiniMax H3 inference optimizations for NVIDIA Tesla V100 (SM70)☆30Sep 29, 2026Updated 3 weeks ago
- 1Cat-vLLM on Intel Gaudi☆43Oct 12, 2026Updated last week
- SGLang for cool dudes using V100☆80Oct 5, 2026Updated 2 weeks ago
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆85Oct 16, 2026Updated last week
- gfx906 setup document☆14Sep 1, 2025Updated last year
- xllama.cpp — Optimized LLM Inference for NVidia Tesla V100-SXM2-32GB☆17Apr 29, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- NVIDIA Tesla V100 显卡驱动自动化管理套件☆32Oct 9, 2025Updated last year
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆50Sep 15, 2026Updated last month
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆23Jul 10, 2026Updated 3 months ago
- ☆54Updated this week
- Local LLM Inference Speed Test Tool☆244Updated this week
- Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, Mini…☆33Oct 7, 2026Updated 2 weeks ago
- FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs☆70May 4, 2025Updated last year
- triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆48Dec 8, 2025Updated 10 months ago
- H3-aware latent upscaling for ComfyUI with automatic 32-pixel alignment.☆25Aug 17, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A fork of jasl/vllm (codex/ds4-sm120-min-enable) with CPU-GPU hybrid inference support for DeepSeek-V4 on SM120+.☆31Sep 10, 2026Updated last month
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated last month
- 专为 ComfyUI 打造的开源无限画布 AI 创作工作台：纯前端直连自建与云端算力（首选推荐 LightCC 镜像开箱即用），工作流槽位驱动 UI，涵盖生图/全能参考视频/首尾帧，集成 Canvas Agent 与插件生态。Pure frontend infinite c…☆29Updated this week
- Standalone multi-reference image conditioning for LTX-2.5 in ComfyUI, with MSR LoRA slot embeddings and negative temporal offsets.☆41Sep 24, 2026Updated last month
- 本地豆包多账号文生/图生视频管理器☆71Jul 15, 2026Updated 3 months ago
- 谷歌INCEPTION-RESNET-V2迁移学习实现图像二分类判断图像是否生病☆17Apr 23, 2018Updated 8 years ago
- ☆80Feb 19, 2024Updated 2 years ago
- llama.cpp optimized for NVIDIA Tesla V100 (SM70): Qwen3.8-Flash-Next with MTP (prefill 3402 tok/s at 200K context on 6x V100-16GB; also r…☆49Updated this week
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆10Nov 19, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 使用nvidia oam转接卡将intel gaudi2转接到pcie并在ubuntu下正常驱动和使用 的指南☆22Oct 10, 2026Updated 2 weeks ago
- Code and paper reproductions for MLPs Are Hebbians☆34Jul 22, 2026Updated 3 months ago
- A Rust-based, SenseVoiceSmall☆43Sep 28, 2026Updated 3 weeks ago
- Local-first AI manga drama production studio powered by Agnes-compatible APIs.☆52Sep 24, 2026Updated last month
- Configurable Livekit Voice AI System☆18Sep 10, 2025Updated last year
- FastAPI WebSocket server for the OpenVoice text-to-speech model.☆12Jun 6, 2024Updated 2 years ago
- Lumivra 是一个干净、现代、富有设计感的 WordPress 主题。专为追求极简美学和优雅排版的内容创作者、博客作者和企业网站打造。Lumivra is a clean, modern, and beautifully designed WordPress theme…☆14Mar 22, 2026Updated 7 months ago