Alternatives and similar repositories for ktransformers

Users that are interested in ktransformers are comparing it to the libraries listed below

• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆249Updated 5 months ago
• ling0322 / libllm
  Efficient inference of large language models.
  ☆150Updated last month
• bd4sur / Nano
  电子鹦鹉 / Toy Language Model
  ☆193Updated last week
• karminski / Janus
  Janus-Series: Unified Multimodal Understanding and Generation Models forked from deepseek-ai/Janus
  ☆17Updated 6 months ago
• XuanwuLab / llama.cpp_deepseek
  ☆17Updated 4 months ago
• openvino-dev-samples / Qwen2.openvino
  This sample shows how to deploy Qwen2 using OpenVINO
  ☆39Updated 10 months ago
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆308Updated 2 months ago
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆149Updated last year
• bigeagle / aizotero
  ☆47Updated this week
• fastcws / fastcws
  轻量级高性能中文分词项目
  ☆200Updated 2 years ago
• evangelosmeklis / deepdrone
  An AI agent to control drones from your CLI
  ☆123Updated this week
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆171Updated last week
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,232Updated this week
• MoonshotAI / moonpalace
  MoonPalace（月宫）是由 Moonshot AI 月之暗面提供的 API 调试工具。
  ☆203Updated 7 months ago
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆40Updated last year
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆135Updated 5 months ago
• RapidAI / LLM-EXAM
  大模型中文测试题库-民间版本
  ☆87Updated 2 years ago
• shareAI-lab / share-best-prompt
  世界上最好的提示词 （总计估值超过300亿的提示词）外国网友x1xh成功获取了 v0、Manus、Cursor、Same.dev 和 Lovable 的完整官方系统提示词和内部工具。
  ☆156Updated 3 months ago
• bingqiang2021 / ailaw
  ai法律团队
  ☆41Updated 7 months ago
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆607Updated 8 months ago
• maaaxinfinity / ktrun
  KTransformers 一键部署脚本
  ☆49Updated 3 months ago
• win4r / MoA
  ☆149Updated last year
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆250Updated this week
• onllama / Onllama.ModelScope2Registry
  Ollama 模型 Registry 镜像站 / 加速器，让 Ollama 从 ModelScope 魔搭 更快的 拉取 / 下载 模型。
  ☆98Updated 3 months ago
• and270 / thinking_effort_processor
  ☆91Updated last month
• chinobing / FastAPI-PaddleSpeech-Audio-To-Text
  FastAPI PaddleSpeech 音频录音转文字
  ☆51Updated last year
• Kedreamix / ChatTTS
  TTS
  ☆49Updated last year
• soulteary / ml-engineering
  《机器学习工程》开源电子书，欢迎一起贡献完善《Machine Learning Engineering》中文版
  ☆72Updated last year
• thad0ctor / llama-server-launcher
  ☆104Updated last week
• junaire / run.cu
  Compile & run a single CUDA file on the cloud GPUs
  ☆14Updated 11 months ago