forked from vllm-project/flash-attention
☆59May 9, 2026Updated 2 months ago
Alternatives and similar repositories for flash-attention-v100
Users that are interested in flash-attention-v100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 …☆21Mar 18, 2026Updated 4 months ago
- vLLM fork for Tesla V100 (SM70) with AWQ 4-bit support, CUDA 12.8 build flow, and validated Qwen3.5 27B/35B deployment on multi-GPU V…☆569Updated this week
- vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support☆20Jun 20, 2026Updated last month
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated 8 months ago
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆395Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Give OpenClaw the power to control your desktop — UI-TARS VLM-driven GUI automation☆18Feb 17, 2026Updated 5 months ago
- Local LLM Inference Speed Test Tool☆134Updated this week
- 大语言模型工具集☆28Aug 1, 2025Updated last year
- FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs☆71May 4, 2025Updated last year
- TurboQuant+ KV cache compression for vLLM. 3.8x smaller KV cache, same conversation quality. Fused CUDA kernels with automatic PyTorch fa…☆77Jul 14, 2026Updated 3 weeks ago
- triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆48Dec 8, 2025Updated 7 months ago
- Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parall…☆103Updated this week
- This repository is created to provide a straight forward reference for running Custom Yolov5 models on the NPU for Orangepi 5 boards - RK…☆12Feb 19, 2025Updated last year
- [CVPR 2026] GaussianDWM: 3D Gaussian Driving World Model for Unified Scene Understanding and Multi-Modal Generation☆78Jun 13, 2026Updated last month
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A Rust-based, SenseVoiceSmall☆39Apr 27, 2026Updated 3 months ago
- CI scripts designed to build a Pascal-compatible version of vLLM.☆13Aug 10, 2024Updated last year
- FastAPI WebSocket server for the OpenVoice text-to-speech model.☆12Jun 6, 2024Updated 2 years ago
- ☆78Feb 19, 2024Updated 2 years ago
- Minimal, zero-dependency LLM inference in pure C11. CPU-first with NEON/AVX2 SIMD. Flash MoE (pread + LRU expert cache). TurboQuant 3-bit…☆24Jul 25, 2026Updated last week
- Simple Mask Detection☆33Aug 30, 2024Updated last year
- Official code of Veason-R1☆15Jul 14, 2026Updated 3 weeks ago
- ☆17Oct 15, 2023Updated 2 years ago
- 一个机器人插件 用于管理群聊☆17Nov 24, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- 引流外链【开心版引流宝】致力于为个人、团队提供基于微信私域流量的推广、引流的效率工具。可减轻人力，有效降低资源损失、流量流失的几率。引流宝完全开源，免费，可商用、可任意二次开发。引流宝可以辅助你更好地开展营销活动推广！降低运营成本，提高工作效率，获取更多资源。☆13Feb 12, 2024Updated 2 years ago
- [NeurIPS 2025] SAMA: Towards Multi-Turn Referential Grounded Video Chat with Large Language Models.☆17May 26, 2026Updated 2 months ago
- NoneBot 黑白名单☆15May 7, 2023Updated 3 years ago
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- 机器人阿洛娜的额外功能插件☆13Oct 25, 2024Updated last year
- 原 XiunoBBS 自带的插件☆21Apr 10, 2022Updated 4 years ago
- 公共API服务，Power by ThinkJS☆20May 11, 2025Updated last year
- Enable true multi gpu capability in Comfy UI using XDiT XFuser and FSDP managed by Ray☆378Updated this week
- ☆19Nov 28, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- tanslate stable diffusion tags☆11May 4, 2023Updated 3 years ago
- Arduino, ESP8266, Servo library with speed control☆26Sep 9, 2018Updated 7 years ago
- 使用Live2D与GPT-sovits的AI全自动直播一站式解决方案。☆18Jun 10, 2026Updated last month
- llama.cpp fork with additional SOTA quants and improved performance☆2,990Updated this week
- ChatAdmin是ChatFlow和ChatStudio的后端API服务☆18Oct 18, 2024Updated last year
- 使用vgg16，vgg19对cifar数据集中的图像进行分类☆23Mar 28, 2019Updated 7 years ago
- Lazy's Live 直播间源码☆19Aug 14, 2025Updated 11 months ago