Alternatives and similar repositories for r1-ktransformers-guide

Users that are interested in r1-ktransformers-guide are comparing it to the libraries listed below

• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,134Updated this week
• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。
  ☆184Updated last week
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆203Updated last week
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆254Updated last week
• vllm-project / vllm-ascend
  Community maintained hardware plugin for vLLM on Ascend
  ☆721Updated this week
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆419Updated 10 months ago
• infinigence / Infini-Megrez
  ☆310Updated 5 months ago
• MooreThreads / vllm_musa
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆51Updated 7 months ago
• modelscope / evalscope
  A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
  ☆1,076Updated this week
• infinigence / Infini-Megrez-Omni
  ☆231Updated 3 months ago
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆189Updated 8 months ago
• ScienceOne-AI / DeepSeek-671B-SFT-Guide
  An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to infer…
  ☆692Updated 2 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆173Updated this week
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆588Updated 6 months ago
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆75Updated 3 weeks ago
• nlzy / vllm-gfx906
  vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆63Updated last week
• open-chinese / alpaca-chinese-dataset
  Alpaca Chinese Dataset -- 中文指令微调数据集
  ☆205Updated 8 months ago
• ModelCloud / GPTQModel
  Production ready LLM model compression/quantization toolkit with hw accelerated inference support for both cpu/gpu via HF, vLLM, and SGLa…
  ☆590Updated last week
• CrazyBoyM / phi3-Chinese
  Phi3 中文后训练模型仓库
  ☆321Updated 6 months ago
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆300Updated this week
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆142Updated 3 months ago
• padeoe / hf-mirror-site
  a huggingface mirror site.
  ☆289Updated last year
• intel / xFasterTransformer
  ☆427Updated this week
• ymcui / Chinese-Mixtral
  中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
  ☆606Updated last year
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆132Updated 3 months ago
• Chinese-Tiny-LLM / Chinese-Tiny-LLM
  ☆228Updated last year
• AIIRWKV / RWKV-RAG
  RAG SYSTEM FOR RWKV
  ☆49Updated 6 months ago
• charent / Phi2-mini-Chinese
  Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.
  ☆552Updated 10 months ago
• multimodal-art-projection / MAP-NEO
  ☆939Updated 4 months ago
• vproxy-tools / ktransformers
  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
  ☆40Updated last month