Alternatives and similar repositories for ktransformers-v0.3-docker

Users that are interested in ktransformers-v0.3-docker are comparing it to the libraries listed below

• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆251Updated 6 months ago
• vproxy-tools / ktransformers
  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
  ☆43Updated 4 months ago
• neka-nat / mineru-api
  MinerU API server
  ☆71Updated 8 months ago
• labring / aiproxy
  AI Proxy is a high-performance AI gateway using OpenAI's and Claude protocol as the entry point. It features intelligent error handling, …
  ☆191Updated this week
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆273Updated last month
• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。
  ☆208Updated last week
• UnicomAI / Unichat-llama3-Chinese
  ☆351Updated last year
• maaaxinfinity / ktrun
  KTransformers 一键部署脚本
  ☆51Updated 5 months ago
• zj591227045 / DeepStressModel
  ☆166Updated 5 months ago
• hustyichi / dify-rag
  dify's rag patch module
  ☆273Updated last week
• RapidAI / RapidOCRPDF
  Based on RapidOCR, extract the PDF content
  ☆182Updated 4 months ago
• Shenzhi-Wang / Llama3-Chinese-Chat
  This is the first Chinese chat model specifically fine-tuned for Chinese through ORPO based on the Meta-Llama-3-8B-Instruct model.
  ☆322Updated last year
• KylinMountain / markify
  Convert files into markdown to help RAG or LLM understand, based on markitdown and MinerU, which could provide high quality pdf parser.
  ☆126Updated 5 months ago
• junjiem / dify-plugin-repackaging
  Scripting tool for downloading Dify plugin package from Dify Marketplace and Github and repackaging [true] offline package.
  ☆438Updated 2 weeks ago
• luyilong2015 / open-webui-pipeline-for-ragflow
  使用open-webui中的pipelines技术在open-webui中调用ragflow的agent实现基于知识库的智能对话，并拥有美观的界面。
  ☆128Updated 2 months ago
• volcengine / volcengine-python-sdk
  ☆128Updated last week
• MAyang38 / dify-on-dingding-go
  一分钟部署 Go语言实现钉钉机器人接入dify工作流，完成ai 流式问答
  ☆55Updated last year
• seanzhang-zhichen / llama3-chinese
  Llama3-Chinese是以Meta-Llama-3-8B为底座，使用 DORA + LORA+ 的训练方法，在50w高质量中文多轮SFT数据 + 10w英文多轮SFT数据 + 2000单轮自我认知数据训练而来的大模型。
  ☆295Updated last year
• Kedreamix / ChatTTS
  TTS
  ☆49Updated last year
• zhongTao99 / ollama
  Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.
  ☆23Updated 3 months ago
• liuwenzhoa / KT_Qwen3
  ☆35Updated 4 months ago
• kingdream123 / rag_mac
  ☆21Updated last year
• Zire-Young / DeepDoc
  尝试从ragflow中拆分出独立的deepdoc
  ☆11Updated 7 months ago
• RapidAI / RapidTable
  基于序列表格识别算法推理库，集成PP-Structure和modelscope等表格识别算法。
  ☆372Updated 2 weeks ago
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,278Updated this week
• LuckLittleBoy / SenseVoice-OneApi
  基于SenseVoice的funasr版本进行的api发布，可以无缝对接oneapi
  ☆73Updated last year
• CrazyBoyM / phi3-Chinese
  Phi3 中文后训练模型仓库
  ☆322Updated 9 months ago
• RapidAI / LLM-EXAM
  大模型中文测试题库-民间版本
  ☆88Updated 2 years ago
• tenadolanter / chatTTS-timbre
  根据声音生成音色文件
  ☆37Updated last year
• shikanon / cline-doubao-server
  CLINE编程助手接入doubao模型(方舟豆包接口)的本地服务
  ☆46Updated 7 months ago