Alternatives and similar repositories for ktrun:

Users that are interested in ktrun are comparing it to the libraries listed below

• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆224Updated last month
• zj591227045 / DeepStressModel
  ☆137Updated last month
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,097Updated this week
• Ikaros-521 / GraphRAG-Ollama-UI
  GraphRAG-Ollama-UI + GraphRAG4OpenWebUI 融合版（有gradio webui配置生成RAG索引，有fastapi提供RAG API服务）
  ☆106Updated 8 months ago
• KylinMountain / graphrag-server
  添加🚀流式 Web 服务到 GraphRAG，兼容 OpenAI SDK，支持可访问的实体链接🔗，支持建议问题，兼容本地嵌入模型，修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…
  ☆250Updated last month
• win4r / VideoFinder-Llama3.2-vision-Ollama
  VideoFinder is an advanced video analysis tool powered by multimodal AI, designed to help users easily locate and identify specific objec…
  ☆140Updated 5 months ago
• AIIRWKV / RWKV-RAG
  RAG SYSTEM FOR RWKV
  ☆45Updated 4 months ago
• zstar1003 / ragflow-plus
  Ragflow-Plus 是 Ragflow 的二次开发版本，使其更为简洁实用
  ☆201Updated this week
• brightwang / dify-tool-service
  为AI带路党Pro视频准备
  ☆221Updated 2 months ago
• liuhuapiaoyuan / MinerU-webui
  MinerU是一款开源的高质量PDF解析工具，基于深度学习技术，可自动提取PDF文档中的文字、表格、图片、公式等内容，并提供丰富的分析、统计、搜索等功能。 本项目为其提供一个简化版本的WebUI，方便用户上传PDF文件，并实时展示提取结果。
  ☆182Updated 4 months ago
• brightwang / graphrag-dify
  ☆243Updated 4 months ago
• XJF2332 / GOT-OCR-2-GUI
  GOT-OCR的GUI版本，提供OCR、导出PDF、批处理等功能，但不提供训练功能
  ☆168Updated last month
• dof-studio / NathUI
  Nath UI is a front-end and back-end hybrid large language model interaction framework that can support the above functions driven by user…
  ☆83Updated last month
• BiboyQG / bob-cosyvoice
  A Bob plugin that calls self-deployed Cosyvoice service to achieve TTS.
  ☆36Updated 8 months ago
• ultrasev / stream-whisper
  基于 faster-whisper 的伪实时语音转写服务
  ☆209Updated 7 months ago
• ylsdamxssjxxdd / eva
  一款轻量的大模型工具 (embedding vector agent)
  ☆163Updated this week
• vproxy-tools / ktransformers
  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
  ☆39Updated 2 weeks ago
• NanGePlus / KagTest
  KAG开源框架介绍及使用KAG实现知识增强生成应用(产品模式测试、开发者模式测试)，KAG是OpenSPG发布v0.5版本中推出的知识增强生成（KAG）的专业领域知识服务框架，旨在充分利用知识图谱和向量检索的优势，增强大型语言模型和知识图谱，以解决 RAG 挑战
  ☆89Updated 2 weeks ago
• LuckLittleBoy / SenseVoice-OneApi
  基于SenseVoice的funasr版本进行的api发布，可以无缝对接oneapi
  ☆54Updated 7 months ago
• lioensky / Mixlite
  多AI混合思考工作流，实现任何大模型的多步纠错思维链。
  ☆58Updated last week
• SynthiaDL / TrainChatGalRWKV
  ☆43Updated last year
• v3ucn / llama3-txt2json-dataset-maker
  文本语料转训练集工具，txt转dataset
  ☆91Updated 11 months ago
• AdamPlatin123 / Open-Deep-Research-workflow-on-Dify
  ☆191Updated 2 months ago
• Datayoo / HuggingFists
  A low-code data flow tool that allows for convenient use of LLM and HuggingFace models, with some features considered as a low-code versi…
  ☆300Updated last week
• CrazyBoyM / phi3-Chinese
  Phi3 中文后训练模型仓库
  ☆321Updated 5 months ago
• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。
  ☆170Updated this week
• 0x5446 / api4sensevoice
  API and websocket server for sensevoice. It has inherited some enhanced features, such as VAD detection, real-time streaming recognition,…
  ☆410Updated 6 months ago
• win4r / GraphRAG4OpenWebUI
  GraphRAG4OpenWebUI integrates Microsoft's GraphRAG technology into Open WebUI, providing a versatile information retrieval API. It combin…
  ☆496Updated 3 months ago
• Hasen-dc / GPT-SoVITS-API-V3
  GPT-SoVITS api for v3 version
  ☆13Updated last month
• leeevertime / AnythingLLM
  ☆49Updated last year