Alternatives and similar repositories for ktransformers

Users that are interested in ktransformers are comparing it to the libraries listed below

• XuanwuLab / llama.cpp_deepseek
  ☆17Updated 2 months ago
• karminski / Janus
  Janus-Series: Unified Multimodal Understanding and Generation Models forked from deepseek-ai/Janus
  ☆17Updated 4 months ago
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆234Updated 3 months ago
• ling0322 / omni.rs
  Efficient inference of large language models.
  ☆148Updated this week
• evangelosmeklis / deepdrone
  An AI agent to control drones
  ☆109Updated this week
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,134Updated this week
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆132Updated 3 months ago
• BeautyyuYanli / GPT-SoVITS-Infer
  The inference code of RVC-Boss/GPT-SoVITS that can be developer-friendly.
  ☆15Updated 8 months ago
• viitrix / vt-transformer
  Transformer framework for edge computing based on C++.
  ☆124Updated 6 months ago
• junaire / run.cu
  Compile & run a single CUDA file on the cloud GPUs
  ☆14Updated 8 months ago
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆147Updated last year
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆254Updated last week
• 01-ai / Descartes
  ☆108Updated last year
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆203Updated last week
• hellangleZ / BY_RAG_V2
  support BM25+vecetor
  ☆29Updated last week
• padeoe / hf-mirror-site
  a huggingface mirror site.
  ☆289Updated last year
• bingqiang2021 / ailaw
  ai法律团队
  ☆42Updated 5 months ago
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆39Updated last year
• LLM-Red-Team / ban-free-api
  🤗 这里提出一种可能的提高逆向成本的方案，希望厂商们让free-api早日终结👋
  ☆74Updated last year
• shootime2021 / APUS-xDAN-4.0-moe
  Its an open source LLM based on MOE Structure.
  ☆58Updated 11 months ago
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆300Updated this week
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆142Updated 3 months ago
• dingdangdog / cloudflare_ddns
  Simple script to quickly implement DDNS based on CloudFlare.
  ☆16Updated 2 months ago
• soulteary / dify-with-qwen-vl
  视频理解：千问视频多模态模型 & Dify
  ☆58Updated 9 months ago
• lwyBZss8924d / DeepSearchAgents
  Awesome Code Action - DeepWebSearch AgentKit App. Build with 🤗 Hugging Face smolagents framework
  ☆62Updated last week
• zjrwtx / SFT-data-builder
  利用免费的大模型api来结合你的私域数据来生成sft训练数据（妥妥白嫖）支持llamafactory等工具的训练数据格式synthetic data
  ☆164Updated 6 months ago
• soulteary / ssh-config
  1MB size, 100% Coverage, Use more expressive YAML / JSON to manage your Config files. --- 1MB大小，100% 测试覆盖，使用更具表现力的YAML / JSON来管理您的配置文件。
  ☆63Updated 3 months ago
• Said-Akbar / vllm-rocm
  FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆49Updated last month
• DmTomHL / Google-AI-Red-Team-Tutorial-ZH_CN
  ☆71Updated 2 months ago
• wangyuxinwhy / generate
  A Python Package to Access World-Class Generative Models
  ☆128Updated 11 months ago