Alternatives and similar repositories for ktransformers

Users that are interested in ktransformers are comparing it to the libraries listed below

• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆242Updated 4 months ago
• ling0322 / libllm
  Efficient inference of large language models.
  ☆149Updated last month
• XuanwuLab / llama.cpp_deepseek
  ☆17Updated 4 months ago
• bd4sur / Nano
  电子鹦鹉 / Toy Language Model
  ☆189Updated last week
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆308Updated last month
• maaaxinfinity / ktrun
  KTransformers 一键部署脚本
  ☆48Updated 2 months ago
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆147Updated last year
• karminski / Janus
  Janus-Series: Unified Multimodal Understanding and Generation Models forked from deepseek-ai/Janus
  ☆17Updated 5 months ago
• evangelosmeklis / deepdrone
  An AI agent to control drones
  ☆115Updated this week
• win4r / MoA
  ☆149Updated last year
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆236Updated this week
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,159Updated this week
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆160Updated last week
• RapidAI / LLM-EXAM
  大模型中文测试题库-民间版本
  ☆84Updated 2 years ago
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆39Updated last year
• CrazyBoyM / phi3-Chinese
  Phi3 中文后训练模型仓库
  ☆321Updated 7 months ago
• shakespearewu / deepwiki
  A pure Markdown documents showcase
  ☆29Updated 10 years ago
• onllama / Onllama.ModelScope2Registry
  Ollama 模型 Registry 镜像站 / 加速器，让 Ollama 从 ModelScope 魔搭 更快的 拉取 / 下载 模型。
  ☆96Updated 3 months ago
• padeoe / hf-mirror-site
  a huggingface mirror site.
  ☆289Updated last year
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆596Updated 7 months ago
• Qihoo360 / 360zhinao
  360zhinao
  ☆290Updated 2 months ago
• gojue / moling
  MoLing is a computer-use and browser-use based MCP server. It is a locally deployed, dependency-free office AI assistant.
  ☆305Updated last month
• CyberCommy / baidu-qa-100w
  百度QA100万数据集
  ☆47Updated last year
• 01-ai / Descartes
  ☆110Updated last year
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆45Updated last week
• thad0ctor / llama-server-launcher
  ☆101Updated this week
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆133Updated 5 months ago
• and270 / thinking_effort_processor
  ☆90Updated last week
• OrionStarAI / OrionStar-Yi-34B-Chat
  OrionStar-Yi-34B-Chat 是一款开源中英文Chat模型，由猎户星空基于Yi-34B开源模型、使用15W+高质量语料微调而成。
  ☆259Updated last year
• bingqiang2021 / ailaw
  ai法律团队
  ☆42Updated 6 months ago