The complete NUMA-optimized branch of the ktransformers project
☆27Nov 3, 2025Updated last year
Alternatives and similar repositories for lktransformers
Users that are interested in lktransformers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 大语言模型工具集☆28Aug 1, 2025Updated last year
- A fork of jasl/vllm (codex/ds4-sm120-min-enable) with CPU-GPU hybrid inference support for DeepSeek-V4 on SM120+.☆32Sep 10, 2026Updated 2 months ago
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆476Nov 6, 2026Updated 2 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆38Nov 4, 2026Updated 2 weeks ago
- CPU-GPU hybrid inference for DeepSeek-V4 on NVIDIA SM80+ (A100/RTX 4090 etc.), forked from yhfgyyf/vllm-deepseek-v4-sm89.☆61Sep 16, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- KTransformers 一键部署脚本☆61Apr 18, 2025Updated last year
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated 2 months ago
- Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parall…☆169Updated this week
- Personal fork of Kacper’s vLLM-Moet for DeepSeek V4 Flash on a single RTX PRO 6000. Shared for others to use; support is best-effort as t…☆18Aug 19, 2026Updated 3 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆22Oct 21, 2026Updated last month
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆27Aug 8, 2026Updated 3 months ago
- 限制问题区域显存 62906MiB / 65024MiB 支持驱动 610.57.04 ,修改显卡显示名称为NVIDIA Tesla A100☆12Aug 30, 2026Updated 2 months ago
- ktransformers v0.3 docker build and run☆10Feb 24, 2025Updated last year
- ☆12Jun 6, 2019Updated 7 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- dsv41-flash-pp5-170hx &pp6 Supports the original (full/unquantized) model. Prefill 7,000 t/s, decode 45-75-125 t/s. dspark. Requires 200 …☆13Updated this week
- some experiments about 170hx 10g version.☆14Oct 19, 2026Updated last month
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated last month
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 11 months ago
- Single-card Intel Gaudi2 vLLM source snapshot: FP8 Qwen, non-greedy DFlash2/MTP, GDN kernels and host-side optimizations.☆20Updated this week
- Distillation pipeline from pretrained Transformers to customized FLA models☆13Aug 4, 2025Updated last year
- Generates kid-friendly weather forecasts suitable for display on a large monitor. Uses OpenWeatherMap and a local or hosted LLM.☆18Feb 28, 2026Updated 8 months ago
- 基于Ipad协议开发的云微信,包含 【自动同意】 【自动进群】 【群发话术】 【话术设置】 【好友同步】 【无痕僵尸粉检测】 【图片/文字/视频/卡片消息群发】 支持一号一代理,稳定不封,可定制需求。 免费测试QQ:1119588926☆11May 16, 2024Updated 2 years ago
- ☆13May 11, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
- Scripts to setup a two-node llama.cpp cluster on NVIDIA DGX Spark (GB10) hardware.☆12May 10, 2026Updated 6 months ago
- 数据库表字段和类型比较,支持SqlServer,MySql,Oracle☆15Aug 4, 2015Updated 11 years ago
- make HttpCanary better to use!☆15Aug 31, 2022Updated 4 years ago
- Android Douyin/Tiktok sharp tool,floating window,copy sharp url to get raw video [libcms gorgon xlog video device register]☆13Jun 26, 2020Updated 6 years ago
- llama.cpp fork: custom radix-select top-k kernel + CUDA graphs for prefill for fast prompt processing - This repo is all AI generated☆11Aug 16, 2026Updated 3 months ago
- vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several☆32Nov 2, 2026Updated 2 weeks ago
- Qwen3.8-Flash-Next-FP8 (official checkpoint) on 3x/4x CMP170HX / PP=4 / MTP-4☆12Updated this week
- AMD PACE is a PyTorch extension for high-performance LLM inference on AMD CPUs. It provides a framework to develop and test novel optimiz…☆18Oct 21, 2026Updated 3 weeks ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Server酱WordPress博客评论微信通知插件☆16Aug 24, 2021Updated 5 years ago
- ☆36Oct 20, 2026Updated last month
- Use OpenCode in WeChat☆23Mar 22, 2026Updated 7 months ago
- ☆23Dec 15, 2016Updated 9 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆13Apr 14, 2026Updated 7 months ago
- XTU = X Transformers Unity — hybrid (CPU-expert + GPU) inference acceleration for vLLM: mainline plugin + CPU MoE engine (AVX512-VNNI/BF1…☆16Nov 2, 2026Updated 2 weeks ago
- Python for .NET is a package that gives Python programmers nearly seamless integration with the .NET Common Language Runtime (CLR) and pr…☆20Jul 4, 2019Updated 7 years ago
Are these results useful?