Alternatives and similar repositories for ktransformers

Users that are interested in ktransformers are comparing it to the libraries listed below

• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆227Updated 2 months ago
• ling0322 / libonmi
  Efficient inference of large language models.
  ☆146Updated 5 months ago
• karminski / Janus
  Janus-Series: Unified Multimodal Understanding and Generation Models forked from deepseek-ai/Janus
  ☆17Updated 3 months ago
• XuanwuLab / llama.cpp_deepseek
  ☆16Updated 2 months ago
• and270 / thinking_effort_processor
  ☆88Updated 2 months ago
• bingqiang2021 / ailaw
  ai法律团队
  ☆41Updated 4 months ago
• BeautyyuYanli / GPT-SoVITS-Infer
  The inference code of RVC-Boss/GPT-SoVITS that can be developer-friendly.
  ☆15Updated 7 months ago
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆147Updated last year
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,113Updated this week
• jianchang512 / fireredasr-ui
  一个中文语音转文字项目，封装自FireRedASR
  ☆47Updated 2 months ago
• vincenthcui / rfc6143
  ☆13Updated 3 years ago
• bd4sur / Nano
  电子鹦鹉 / Toy Language Model
  ☆169Updated this week
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆131Updated 3 months ago
• gojue / muou
  网络包测试工具
  ☆45Updated last year
• lewangdev / CosyVoice
  Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
  ☆12Updated 10 months ago
• jianchang512 / kokoro-uiapi
  用于kokoro TTS的webui界面和兼容openai api
  ☆32Updated 3 months ago
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆191Updated this week
• junaire / run.cu
  Compile & run a single CUDA file on the cloud GPUs
  ☆14Updated 8 months ago
• RapidAI / LLM-EXAM
  大模型中文测试题库-民间版本
  ☆82Updated last year
• iikira / golang-msvc
  golang生成支持MSVC调用的dll
  ☆13Updated 2 years ago
• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆60Updated last week
• meta-soul / dmeta-embedding-examples
  ☆16Updated 9 months ago
• Qihoo360 / 360zhinao
  360zhinao
  ☆289Updated this week
• shakespearewu / deepwiki
  A pure Markdown documents showcase
  ☆23Updated 10 years ago
• aigc-open / auto_openai
  自动将大模型部署成openai，并且自动切换模型，自动伸缩扩容
  ☆29Updated 2 weeks ago
• lazyparser / what-i-learned-from-anime
  我从动漫中学习到的知识和人生感悟
  ☆17Updated 2 months ago
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆38Updated last year
• llm-sec / transformer-hacker
  transformer安全相关
  ☆30Updated 6 months ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆64Updated last week
• silverriver / ChatGLM-6B-Slim
  ChatGLM-6B-Slim：裁减掉20K图片Token的ChatGLM-6B，完全一样的性能，占用更小的显存。
  ☆126Updated 2 years ago