Alternatives and similar repositories for SmallThinker

Users that are interested in SmallThinker are comparing it to the libraries listed below

• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆223Updated 2 weeks ago
• moonquest-ai / SRDA
  ☆29Updated 7 months ago
• wdlctc / headinfer
  ☆64Updated 8 months ago
• sgl-project / sgl-cookbook
  Cookbook of SGLang - Recipe
  ☆63Updated this week
• microsoft / AttentionEngine
  ☆117Updated 8 months ago
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆97Updated last month
• inclusionAI / dInfer
  dInfer: An Efficient Inference Framework for Diffusion Language Models
  ☆403Updated 3 weeks ago
• Tencent / llm.hunyuan.T1
  ☆83Updated 9 months ago
• PKULab1806 / Fairy-plus-minus-i
  Fairy±i (iFairy): Complex-valued Quantization Framework for Large Language Models
  ☆116Updated 2 months ago
• pangu-tech / pangu-ultra
  ☆74Updated 8 months ago
• DeepLink-org / DLSlime
  DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
  ☆92Updated this week
• sihyeong / Awesome-LLM-Inference-Engine
  ☆166Updated last month
• TransferQueue / TransferQueue
  [Archived] For the latest updates and community contribution, please visit: https://github.com/Ascend/TransferQueue or https://gitcode.co…
  ☆13Updated 2 weeks ago
• omni-ai-npu / omni-infer
  Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature se…
  ☆102Updated this week
• Wenyueh / MinivLLM
  Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation
  ☆243Updated last week
• tile-ai / AttentionEngine
  ☆52Updated 8 months ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆47Updated 9 months ago
• RLsys-Foundation / TritonForge
  🔥 LLM-powered GPU kernel synthesis: Train models to convert PyTorch ops into optimized Triton kernels via SFT+RL. Multi-turn compilation…
  ☆115Updated 2 months ago
• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆98Updated 5 months ago
• NVlabs / QeRL
  QeRL enables RL for 32B LLMs on a single H100 GPU.
  ☆477Updated 2 months ago
• stepfun-ai / Step3
  ☆449Updated 5 months ago
• ByteDance-Seed / cudaLLM
  ☆128Updated 5 months ago
• InternLM / turbomind
  ☆96Updated 10 months ago
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆110Updated last week
• hao-ai-lab / DistCA
  Efficient Long-context Language Model Training by Core Attention Disaggregation
  ☆85Updated this week
• Ascend / triton-ascend
  Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend
  ☆105Updated this week
• AndreSlavescu / mHC.cu
  mHC kernels implemented in CUDA
  ☆243Updated 2 weeks ago
• z-lab / dflash
  Block Diffusion for Ultra-Fast Speculative Decoding
  ☆432Updated last week
• deepseek-ai / LPLB
  An early research stage expert-parallel load balancer for MoE models based on linear programming.
  ☆491Updated 2 months ago
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆154Updated 2 weeks ago