Alternatives and similar repositories for llm.rs

Users that are interested in llm.rs are comparing it to the libraries listed below

• InfiniTensor / InfiniLM-Rust
  ☆126Updated last week
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆150Updated last year
• YdrMaster / notebook
  笔记
  ☆44Updated 2 months ago
• PKUFlyingPig / MIT6.5940_TinyML
  Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing
  ☆60Updated 9 months ago
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆427Updated last year
• wangshuai09 / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆39Updated last month
• PKULab1806 / Fairy-plus-minus-i
  Fairy±i (iFairy): Complex-valued Quantization Framework for Large Language Models
  ☆104Updated last week
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆86Updated 6 months ago
• mdy666 / mdy_triton
  ☆147Updated 3 months ago
• mobvoi / seq-monkey-data
  ☆164Updated last year
• xgqdut2016 / cuda_code
  easy cuda code
  ☆84Updated 9 months ago
• hpcgame / hpc-wiki
  Wiki fo HPC
  ☆121Updated 2 months ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆198Updated last week
• REXWindW / my_llm
  尝试自己从头写一个LLM，参考llama和nanogpt
  ☆66Updated last year
• scPointer / maturin
  ☆13Updated last year
• ustc-compiler-principles / 2023
  USTC Principles and Techniques of Compiler 2023 homepage
  ☆28Updated 11 months ago
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆285Updated 9 months ago
• mofa-org / mofa
  MoFA - Modular Framework for Agents. Modular, Compositional and Programmable.
  ☆117Updated 2 weeks ago
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆114Updated this week
• Sunt-ing / stick
  A PyTorch-like deep learning framework. Just for fun.
  ☆156Updated 2 years ago
• LearningInfiniTensor / learning-lm-rs
  ☆63Updated 11 months ago
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆133Updated last year
• InfiniTensor / InfiniTensor
  ☆259Updated last week
• zhaibowen / Retriever
  Retriever-0.1B
  ☆95Updated last year
• bojone / bytepiece
  更纯粹、更高压缩率的Tokenizer
  ☆485Updated 10 months ago
• thomaschlt / mla.c
  Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.
  ☆19Updated 9 months ago
• xforcevesa / new-vrwkv
  ☆23Updated 6 months ago
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆545Updated 3 weeks ago
• GenTang / regression2chatgpt
  《解构大语言模型：从线性回归到通用人工智能》配套代码
  ☆246Updated 3 months ago
• ling0322 / libllm
  Efficient inference of large language models.
  ☆149Updated 3 weeks ago