KTransformers 一键部署脚本
☆61Apr 18, 2025Updated last year
Alternatives and similar repositories for ktrun
Users that are interested in ktrun are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The complete NUMA-optimized branch of the ktransformers project☆27Nov 3, 2025Updated last year
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated 11 months ago
- Production Docker deployment for Qwen3.8-27B AutoRound W4A16 (Vishva007) on 2x RTX 3090 (NVLink or PCIe). OpenAI-compatible vLLM with MTP…☆18Aug 20, 2026Updated 2 months ago
- run DeepSeek-R1 GGUFs on KTransformers☆258Mar 3, 2025Updated last year
- Local LLM Inference Speed Test Tool☆248Oct 21, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ComfyUI MiniMax H3 长视频循环导演台增强版 - 3 节点循环系统 + 官方 expand 机制 + HIGH 二次采样引导 + 运行隔离，轻松实现多段连贯长视频生成☆61Oct 26, 2026Updated last week
- A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations☆19,646Updated this week
- ☆27Updated this week
- vLLM on AMD RDNA4 (gfx1201 / RX 9070 XT-9070): clone-and-docker-compose-up, with a W4A8-FP8-WMMA MoE kernel☆14Jul 18, 2026Updated 3 months ago
- ☆12Aug 7, 2026Updated 2 months ago
- fastllm是后端无依赖的高性能大模型推理库，帮助您在大部分设备上高效推理大模型！☆5,130Updated this week
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 10 months ago
- ESP32 网页示波器☆12Jun 30, 2022Updated 4 years ago
- DeepSeek-V4.1-Flash EXL3 on 2x DGX Spark (GB10) with the TensorFold engine, TP=2☆13Oct 10, 2026Updated 3 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An automated and extendable command system as Unity package☆12Jan 29, 2026Updated 9 months ago
- Tensor-Core selector unlock for RTX 4070 Ti Super☆29Oct 20, 2026Updated last week
- ☆16Jan 2, 2024Updated 2 years ago
- This system provides a high-performance, flexible timer management solution for Unreal Engine. It extends the standard timer functionalit…☆12Aug 17, 2025Updated last year
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
- Simple Hierarchical RAG Framework☆95May 8, 2026Updated 5 months ago
- ComfyUI workflow for MiniMax-H3-Turbo☆13Oct 23, 2026Updated last week
- Model Based Testing of the App Based On The Description from Constructing the User Interface with Statecharts Book of Ian Horrocks using …☆13Feb 20, 2024Updated 2 years ago
- Graph Assembly processing networks for robotic assembly sequence planning and feasibility learning☆13Aug 7, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- SSTV encoder for ARDUINO DUE☆12Jul 27, 2018Updated 8 years ago
- 一个完全免费的多智能体自动化工作流系统☆12Jul 31, 2025Updated last year
- Discord 平台的 OneBot 实现☆10Oct 26, 2026Updated last week
- Decensoring Language Models Through Activation Tuning☆16Feb 21, 2025Updated last year
- Exact SGLang runtime for GLM-5.3-Flash-NVFP4 on 4x RTX PRO 6000 Blackwell (SM120): flashinfer_cutlass MoE, DSA+KDA attention, NEXTN MTP5,…☆17Aug 27, 2026Updated 2 months ago
- DeepSeek-V4.1-Flash on 4x DGX Spark TP4 switchless RoCE ring - SGLang production recipe, 600K context, DSpark MTP, benchmark archive☆31Oct 1, 2026Updated last month
- Eye-tracking experiment with video stimuli, programmed using PyGaze and OpenCV☆11Jan 23, 2018Updated 8 years ago
- Give the DeepSeek Harness (dsh) eyes with any text model + any vision model: a vision proxy for chat image attachments and an analyze_ima…☆12Sep 28, 2026Updated last month
- ☆14Sep 4, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- AMD PACE is a PyTorch extension for high-performance LLM inference on AMD CPUs. It provides a framework to develop and test novel optimiz…☆17Oct 21, 2026Updated last week
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆474Sep 22, 2026Updated last month
- Light musician is a tool to convert song to its light version. With Light Player, vocals in a song can be convert to other instruments us…☆11Aug 29, 2022Updated 4 years ago
- ZSC - College of Computing New Member Q&A☆14Jul 22, 2023Updated 3 years ago
- a private project used for cloud computing competition☆10Apr 12, 2017Updated 9 years ago
- AI-powered Unreal Engine asset inspection toolkit. Analyze Blueprints, Materials, Widgets, DataTables, and more without launching the Edi…☆16Mar 1, 2026Updated 8 months ago
- 基于 DeepSeek Harness 的桌面写作应用，提供稿纸编辑、AI 写作辅助与可选插件。☆16Sep 27, 2026Updated last month