This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 2026. It does not account for compatibility with other architectures and has only been tested on an 8-card V100 32GB setup.
☆21Mar 18, 2026Updated 4 months ago
Alternatives and similar repositories for lmdeploy-v100
Users that are interested in lmdeploy-v100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆21Jul 2, 2026Updated last month
- forked from vllm-project/flash-attention☆59May 9, 2026Updated 2 months ago
- A ComfyUI custom node enabling **Flash Attention 1** on legacy NVIDIA GPUs (Tesla V100, T4) that lack Compute Capability 8.0+ required by…☆16Feb 9, 2026Updated 5 months ago
- NVIDIA Tesla V100 显卡驱动自动化管理套件☆26Oct 9, 2025Updated 9 months ago
- 谷歌INCEPTION-RESNET-V2迁移学习实现图像二分类判断图像是否生病☆17Apr 23, 2018Updated 8 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Go version of ruyiPage based on Firefox + WebDriver BiDi☆16Apr 24, 2026Updated 3 months ago
- vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support☆20Jun 20, 2026Updated last month
- Minimal, zero-dependency LLM inference in pure C11. CPU-first with NEON/AVX2 SIMD. Flash MoE (pread + LRU expert cache). TurboQuant 3-bit…☆24Jul 25, 2026Updated last week
- Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free…☆24Jul 26, 2026Updated last week
- ☆14Jun 29, 2025Updated last year
- Configurable Livekit Voice AI System☆19Sep 10, 2025Updated 10 months ago
- 引流外链【开心版引流宝】致力于为个人、团队提供基于微信私域流量的推广、引流的效率工具。可减轻人力，有效降低资源损失、流量流失的几率。引流宝完全开源，免费，可商用、可任意二次开发。引流宝可以辅助你更好地开展营销活动推广！降低运营成本，提高工作效率，获取更多资源。☆13Feb 12, 2024Updated 2 years ago
- A simple, cross-platform CLI tool for quickly switching between Claude Code configuration profiles by managing different settings.json ve…☆16Jan 17, 2026Updated 6 months ago
- 原 XiunoBBS 自带的插件☆21Apr 10, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- This repository contains modules to extend reordering rules (available on warehouses locations) functionalities.☆17Jul 28, 2026Updated last week
- Bus Pirate☆13Jul 24, 2020Updated 6 years ago
- ☆11Jan 14, 2019Updated 7 years ago
- Policy-Driven Multi-Tier File System☆10Jul 18, 2019Updated 7 years ago
- ChatAdmin是ChatFlow和ChatStudio的后端API服务☆18Oct 18, 2024Updated last year
- 使用vgg16，vgg19对cifar数据集中的图像进行分类☆23Mar 28, 2019Updated 7 years ago
- A high-performance, lightweight Go proxy that bridges the **Trae API** with the **OpenAI Standard API**. Seamlessly integrate Trae's AI c…☆16Jan 22, 2026Updated 6 months ago
- 500彩票网球赛数据爬取:通过实时爬取足球赛事信息，赛事胜平负及欧赔率及凯利指数，计算变异系数，图表展示。☆48Feb 15, 2023Updated 3 years ago
- A build script for python-libtorrent bindings using current dependencies with minimal system footprint☆15Aug 17, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Automate Uploads to Cloud Storage using Rclone☆14Jul 7, 2020Updated 6 years ago
- Slidev implementation☆19Jul 16, 2026Updated 2 weeks ago
- Single-file, dependency-free live dashboard for local llama.cpp/vLLM serving — GPU, throughput, KV/ctx, model library. Stdlib Python + on…☆66Updated this week
- TUI display manager for Artix Linux☆11Jan 7, 2025Updated last year
- PSGroove with PL3 payloads☆15Oct 6, 2010Updated 15 years ago
- Experimental general-purpose data compressor☆11Nov 9, 2020Updated 5 years ago
- REST Web server that client applications can use to send a receive data from/to your Telegram bot, easy to configure and install. PHP w/R…☆11Feb 26, 2018Updated 8 years ago
- Odoo Test Helper☆13May 26, 2026Updated 2 months ago
- ☆21Dec 10, 2025Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- FPGA-Based Logic Analyzer☆15Apr 18, 2016Updated 10 years ago
- 🌀 Docker image packaging for libtorrent.☆16Updated this week
- zJTAG is an EJTAG Debrick Utility based on BrJTAG☆12Feb 28, 2016Updated 10 years ago
- View the demo☆10Nov 10, 2023Updated 2 years ago
- Australian localisation of Odoo (formerly OpenERP)☆12Feb 20, 2019Updated 7 years ago
- Just discord file storage☆13Feb 28, 2025Updated last year
- FrontEnd Theme using material design☆15May 21, 2016Updated 10 years ago