Alternatives and similar repositories for ktrun

Users that are interested in ktrun are comparing it to the libraries listed below

• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆261Updated 11 months ago
• fattank / deepseek-on-vllm-VRAMandDRAM
  一套基于Vllm的显存内存混合模式大模型部署工具（图形界面），VRAMandDRAM模式虽然慢一点，但是解决了超大模型在普通家用计算机上的部署问题。
  ☆91Updated 9 months ago
• guqiong96 / Lvllm
  LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …
  ☆146Updated last week
• zj591227045 / DeepStressModel
  ☆173Updated 10 months ago
• liuwenzhoa / KT_Qwen3
  ☆44Updated 9 months ago
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,467Updated this week
• lework / llm-benchmark
  LLM 并发性能测试工具，支持自动化压力测试和性能报告生成。
  ☆213Updated 2 months ago
• luckylykkk / LocalAItable
  By invoking local large language models, this tool processes spreadsheets similar to multi-dimensional tables. It can batch-generate cont…
  ☆41Updated 10 months ago
• gengchaogit / triton-3.2.0-mi50
  triton3.2.0添加mi25/mi50/mi60支持
  ☆14Updated 9 months ago
• jianggujin / ollama-desktop
  Ollama Desktop是基于Ollama引擎的一个桌面应用解决方案，用于在macOS、Windows和Linux操作系统上运行和管理Ollama模型的GUI工具。
  ☆182Updated 7 months ago
• luyilong2015 / open-webui-pipeline-for-ragflow
  使用open-webui中的pipelines技术在open-webui中调用ragflow的agent实现基于知识库的智能对话，并拥有美观的界面。
  ☆158Updated 3 months ago
• junjiem / dify-plugin-repackaging
  Scripting tool for downloading Dify plugin package from Dify Marketplace and Github and repackaging [true] offline package.
  ☆608Updated last month
• YOOTeam / ChatPPT-MCP
  The AI-powered PPT generation service based on ChatPPT can create presentations based on themes, requirements, or uploaded documents, sup…
  ☆128Updated 4 months ago
• KylinMountain / graphrag-server
  添加🚀流式 Web 服务到 GraphRAG，兼容 OpenAI SDK，支持可访问的实体链接🔗，支持建议问题，兼容本地嵌入模型，修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…
  ☆264Updated 10 months ago
• RapidAI / LLM-EXAM
  大模型中文测试题库-民间版本
  ☆95Updated 2 years ago
• vllm-project / vllm-ascend
  Community maintained hardware plugin for vLLM on Ascend
  ☆1,651Updated this week
• chmod777john / swarm-ide
  为 Agent Swarm 打造的 IDE ，支持 Kimi-2.5, GLM-4.7 等（即使不像 K2.5 那样经过强化学习的模型也能用）An IDE built for Agent Swarms, supporting Kimi-2.5, GLM-4.7, and m…
  ☆684Updated this week
• bowenliang123 / md_exporter
  An Agent Skill and Dify plugin to transform Markdown to files of DOCX, PPTX, XLSX, PNG, PDF, Mermaid, HTML, MD, CSV, JSON, XML.
  ☆180Updated last week
• brightwang / dify-tool-service
  为AI带路党Pro视频准备
  ☆278Updated 11 months ago
• Samge0 / ragflow-upload
  自动批量上传并解析文档至 RagFlow 知识库，省去手动操作，提升效率。
  ☆487Updated 6 months ago
• TylunasLi / fastllm
  纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM
  ☆12Updated last week
• Ikaros-521 / GraphRAG-Ollama-UI
  GraphRAG-Ollama-UI + GraphRAG4OpenWebUI 融合版（有gradio webui配置生成RAG索引，有fastapi提供RAG API服务）
  ☆105Updated last year
• knowflow-ai / KnowFlow
  KnowFlowRAG
  ☆420Updated last month
• zstar1003 / ragflow-plus
  Ragflow-Plus 是 Ragflow 的二次开发版本，使其更为简洁实用
  ☆1,219Updated last month
• UnicomAI / Unichat-llama3-Chinese
  ☆348Updated last year
• XJF2332 / GOT-OCR-2-GUI
  GOT-OCR的GUI版本，提供OCR、导出PDF、批处理等功能，但不提供训练功能
  ☆181Updated 3 months ago
• MooreThreads / vllm_musa
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆76Updated last year
• txg1550759 / ktransformers-v0.3-docker
  ktransformers v0.3 docker build and run
  ☆13Updated 11 months ago
• hjlarry / dify-plugin-database
  ☆102Updated 5 months ago
• adoresever / Pretuning
  A tool for creating pre-training datasets for language models, supporting one-click batch processing for both text and image datasets. 一个…
  ☆43Updated last year