The complete NUMA-optimized branch of the ktransformers project
☆27Nov 3, 2025Updated 11 months ago
Alternatives and similar repositories for lktransformers
Users that are interested in lktransformers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆474Sep 22, 2026Updated last month
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated 11 months ago
- A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations☆45Sep 10, 2026Updated last month
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated last month
- KTransformers 一键部署脚本☆60Apr 18, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parall…☆164Updated this week
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆26Aug 8, 2026Updated 2 months ago
- AI 驱动的量化分析平台（开源版）：因子分析 / 选股 / 多因子轮动回测 / 模型实验室 / 自动因子挖掘 · Qlib + Alpha158 + FastAPI + Vue3☆20Oct 13, 2026Updated 2 weeks ago
- 限制问题区域显存 62906MiB / 65024MiB 支持驱动 610.57.04 ，修改显卡显示名称为NVIDIA Tesla A100☆13Aug 30, 2026Updated 2 months ago
- high-performance linear attention kernel library built on TileLang☆14Jun 8, 2026Updated 4 months ago
- ☆12Jun 6, 2019Updated 7 years ago
- DeepSeek-V4-Flash W4A16-FP8 quantization on 8x H200 — patches, recipe, mission report☆14Sep 26, 2026Updated last month
- HX 家族多功能工具箱：NVIDIA CMP 全系矿卡（30HX/40HX/50HX/70HX/90HX/170HX）工作台——固件解锁、型号伪装、双卡调度、动态省电、快照回滚。单文件免安装，前端与工具包全部内嵌。☆38Oct 25, 2026Updated last week
- vLLM GGUF plugin fork — Qwen3.5/3.6 hybrid (GDN) serving: iq4_xs mmvq perf, MTP speculative decode, MoE draft support☆12Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several☆23Updated this week
- Generates kid-friendly weather forecasts suitable for display on a large monitor. Uses OpenWeatherMap and a local or hosted LLM.☆17Feb 28, 2026Updated 8 months ago
- Multi-GPU prefill acceleration for llama.cpp☆15Oct 23, 2026Updated last week
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 10 months ago
- 基于XPosed框架，简化应用间通信，支持多app hook☆11Jul 12, 2023Updated 3 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆13Apr 14, 2026Updated 6 months ago
- 通过修改 GPT 分区表禁用联发科 GenieZone 虚拟化管理程序，不破坏 preloader 代码签名，释放EL2，达到内核启动在EL2级别的目的从而运行KVM☆17Aug 12, 2026Updated 2 months ago
- ☆14Dec 6, 2023Updated 2 years ago
- 基于Ipad协议开发的云微信，包含 【自动同意】 【自动进群】 【群发话术】 【话术设置】 【好友同步】 【无痕僵尸粉检测】 【图片/文字/视频/卡片消息群发】 支持一号一代理，稳定不封，可定制需求。 免费测试QQ：1119588926☆11May 16, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The Vala Compiler, ported to C#☆17Jun 23, 2018Updated 8 years ago
- Android Douyin/Tiktok sharp tool,floating window,copy sharp url to get raw video [libcms gorgon xlog video device register]☆13Jun 26, 2020Updated 6 years ago
- Douyin/抖音/tiktok signature algorithm for as/cp/mas parameters☆17Feb 3, 2019Updated 7 years ago
- Wechat App(微信小程序,.wxapkg)解包及相关文件(.wxss,.json,.wxs,.wxml)还原工具☆12Jun 12, 2018Updated 8 years ago
- Use OpenCode in WeChat☆23Mar 22, 2026Updated 7 months ago
- AMD PACE is a PyTorch extension for high-performance LLM inference on AMD CPUs. It provides a framework to develop and test novel optimiz…☆16Oct 21, 2026Updated last week
- Server酱WordPress博客评论微信通知插件☆16Aug 24, 2021Updated 5 years ago
- A fork of jasl/vllm (codex/ds4-sm120-min-enable) with CPU-GPU hybrid inference support for DeepSeek-V4 on SM120+.☆32Sep 10, 2026Updated last month
- 一个Turing专用vLLM分支，通过整合FlashInfer 0.6.18（PR #3526）与SM75后端门槛补丁（PR #47949），持续同步vLLM主线最新版本☆37Oct 11, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Python for .NET is a package that gives Python programmers nearly seamless integration with the .NET Common Language Runtime (CLR) and pr…☆20Jul 4, 2019Updated 7 years ago
- Android real-time display control software☆16Apr 5, 2023Updated 3 years ago
- ☆43Sep 30, 2026Updated last month
- BeefLang website☆23Oct 9, 2026Updated 3 weeks ago
- 最新微信公众号文章抓取工具，修复7月29号微信公众号接口下架后不能抓取的问题，支持windows、MacOS系统☆66Sep 5, 2026Updated last month
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- 1Cat-vLLM on Intel Gaudi☆44Oct 12, 2026Updated 2 weeks ago