Alternatives and similar repositories for r1-ktransformers-guide:

Users that are interested in r1-ktransformers-guide are comparing it to the libraries listed below

• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,053Updated this week
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆154Updated this week
• vllm-project / vllm-ascend
  Community maintained hardware plugin for vLLM on Ascend
  ☆393Updated this week
• infinigence / Infini-Megrez
  ☆310Updated 3 months ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆240Updated 3 weeks ago
• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。
  ☆161Updated this week
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆185Updated 6 months ago
• modelscope / evalscope
  A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
  ☆676Updated this week
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆131Updated last month
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in pure C++
  ☆282Updated last month
• brightwang / graphrag-dify
  ☆227Updated 3 months ago
• OpenBMB / UltraRAG
  Build & Optimize your RAG.
  ☆588Updated last week
• vproxy-tools / ktransformers
  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
  ☆31Updated 2 weeks ago
• wangshuai09 / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆36Updated 2 months ago
• infinigence / Infini-Megrez-Omni
  ☆218Updated last month
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆124Updated last month
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆135Updated 2 weeks ago
• KylinMountain / markify
  Convert files into markdown to help RAG or LLM understand, based on markitdown and MinerU, which could provide high quality pdf parser.
  ☆74Updated this week
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆405Updated 8 months ago
• Alannikos / edg4llm
  A unified tool to generate fine-tuning datasets for LLMs, including questions, answers, and dialogues. ✨🤖📚💬
  ☆57Updated 2 weeks ago
• KylinMountain / graphrag-server
  添加🚀流式 Web 服务到 GraphRAG，兼容 OpenAI SDK，支持可访问的实体链接🔗，支持建议问题，兼容本地嵌入模型，修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…
  ☆242Updated 2 months ago
• FlagOpen / FlagData
  ☆314Updated 9 months ago
• CapitalCode2020 / InfiniRetri2
  This is InfiniRetri, a tool enhance Transformer-based LLMs(Large Language Model) ablity to hangle Long-Context.
  ☆79Updated this week
• charent / Phi2-mini-Chinese
  Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.
  ☆540Updated 8 months ago
• QwenLM / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆132Updated 3 months ago
• Alibaba-NLP / ViDoRAG
  ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents
  ☆412Updated last week
• gpustack / gpustack
  Manage GPU clusters for running AI models
  ☆2,279Updated this week
• datawhalechina / unlock-deepseek
  DeepSeek 系列工作解读、扩展和复现。
  ☆614Updated this week
• Qihoo360 / Light-R1
  ☆556Updated last week
• 1694439208 / GOT-OCR-Inference
  研究GOT-OCR-项目落地加速，不限语言
  ☆59Updated 5 months ago