Alternatives and similar repositories for deepseek.cpp

Users that are interested in deepseek.cpp are comparing it to the libraries listed below

• andrewkchan / yalm
  Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
  ☆550Updated 4 months ago
• yassa9 / qwen600
  Static suckless single batch CUDA-only qwen3-0.6B mini inference engine
  ☆543Updated 4 months ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆225Updated 3 weeks ago
• modal-labs / gpu-glossary
  GPU documentation for humans
  ☆514Updated last week
• Anemll / mlx-rdma
  experiments with MLX
  ☆66Updated last month
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆145Updated 6 months ago
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆160Updated 5 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆203Updated 4 months ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆390Updated 2 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆60Updated last year
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆295Updated 2 months ago
• Tencent / hpc-ops
  High Performance LLM Inference Operator Library
  ☆695Updated this week
• microsoft / T-MAC
  Low-bit LLM inference on CPU/NPU with lookup table
  ☆916Updated 8 months ago
• ling0322 / libllm
  Efficient inference of large language models.
  ☆149Updated 4 months ago
• OpenMachine-ai / transformer-tricks
  A collection of tricks and tools to speed up transformer models
  ☆194Updated last month
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆260Updated 11 months ago
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆348Updated this week
• danbev / learning-ai
  Notes and exploration code for learning about AI/ML
  ☆207Updated last week
• Emericen / tiny-qwen
  A minimal PyTorch re-implementation of Qwen3 VL with a fancy CLI
  ☆316Updated 2 months ago
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆785Updated this week
• intel / auto-round
  🎯An accuracy-first, highly efficient quantization toolkit for LLMs, designed to minimize quality degradation across Weight-Only Quantiza…
  ☆839Updated last week
• micytao / vllm-playground
  A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes…
  ☆351Updated last week
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆394Updated 7 months ago
• likejazz / llama3.cuda
  llama3.cuda is a pure C/CUDA implementation for Llama 3 model.
  ☆350Updated 9 months ago
• and270 / thinking_effort_processor
  ☆94Updated 7 months ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆251Updated last year
• thad0ctor / llama-server-launcher
  ☆107Updated 2 weeks ago
• InternLM / turbomind
  ☆96Updated 10 months ago
• intel / xFasterTransformer
  ☆437Updated 4 months ago
• rednote-hilab / dots.llm1
  The official repository of the dots.llm1 base and instruct models proposed by rednote-hilab.
  ☆487Updated 5 months ago