Alternatives and similar repositories for ktransformers

Users that are interested in ktransformers are comparing it to the libraries listed below

• ling0322 / libllm
  Efficient inference of large language models.
  ☆149Updated 4 months ago
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆260Updated 11 months ago
• bd4sur / Nano
  电子鹦鹉 / Toy Language Model
  ☆258Updated last week
• karminski / Janus
  Janus-Series: Unified Multimodal Understanding and Generation Models forked from deepseek-ai/Janus
  ☆17Updated last year
• yassa9 / qwen600
  Static suckless single batch CUDA-only qwen3-0.6B mini inference engine
  ☆543Updated 4 months ago
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆317Updated 4 months ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆225Updated 3 weeks ago
• MoonshotAI / moonpalace
  MoonPalace（月宫）是由 Moonshot AI 月之暗面提供的 API 调试工具。
  ☆221Updated last year
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆39Updated last year
• junaire / run.cu
  Compile & run a single CUDA file on the cloud GPUs
  ☆14Updated last year
• and270 / thinking_effort_processor
  ☆94Updated 6 months ago
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆135Updated 11 months ago
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆150Updated last year
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆616Updated last year
• padeoe / hf-mirror-site
  a huggingface mirror site.
  ☆326Updated last year
• nihui / ncnn-android-rvm
  ncnn android robust video matting
  ☆20Updated 3 weeks ago
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,413Updated last week
• karminski / teach-fish-to-swim
  Wanna breeze through some papers?
  ☆82Updated last week
• fastcws / fastcws
  轻量级高性能中文分词项目
  ☆199Updated 2 years ago
• nihui / ruapu
  Detect CPU features with single-file
  ☆442Updated last month
• RapidAI / LLM-EXAM
  大模型中文测试题库-民间版本
  ☆95Updated 2 years ago
• TsingmaoAI / xw-cli
  实现国产算力大模型零门槛部署，一键跑通 Qwen、GLM-4.7、Minimax-2.1、DeepSeek-OCR 等模型
  ☆236Updated this week
• maaaxinfinity / ktrun
  KTransformers 一键部署脚本
  ☆57Updated 9 months ago
• 01-ai / Descartes
  ☆114Updated last year
• viitrix / vt-transformer
  Transformer framework for edge computing based on C++.
  ☆130Updated last year
• keith2018 / TinyGPT
  Tiny C++ LLM inference implementation from scratch
  ☆102Updated last week
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆72Updated last week
• MegEngine / InferLLM
  a lightweight LLM model inference framework
  ☆749Updated last year
• evangelosmeklis / deepdrone
  Control drones with natural language
  ☆167Updated 2 weeks ago
• gen-cli / gen-cli
  Agents of C.L.I.
  ☆142Updated 4 months ago