Alternatives and similar repositories for toyllm

Users that are interested in toyllm are comparing it to the libraries listed below

• ironartisan / awesome-compression1
  模型压缩的小白入门教程
  ☆22Updated last year
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆75Updated 3 months ago
• PFCCLab / Starter
  【HACKATHON 预备营】飞桨启航计划集训营
  ☆16Updated last month
• bd4sur / Nano
  电子鹦鹉 / Toy Language Model
  ☆189Updated this week
• noooop / wde
  Workflow Defined Engine
  ☆24Updated 3 months ago
• ling0322 / libllm
  Efficient inference of large language models.
  ☆149Updated last month
• JerryYin777 / PaperHelper
  PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant with Reliable References
  ☆17Updated last year
• wangyifan2018 / ChatDoc-TPU
  适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆12Updated last year
• keith2018 / TinyGPT
  Tiny C++11 GPT-2 inference implementation from scratch
  ☆62Updated last week
• PKUFlyingPig / MIT6.5940_TinyML
  Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing
  ☆51Updated 6 months ago
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆74Updated 5 months ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆54Updated 8 months ago
• array2d / deepx
  Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & …
  ☆52Updated this week
• NiuTrans / compiler-notes
  ☆80Updated 2 years ago
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆58Updated 8 months ago
• DeepLink-org / ditorch
  ☆23Updated 6 months ago
• freelw / cpp-transformer
  A C++ implementation of Transformer without special library dependencies, supporting CPU, CUDA, and Apple Metal, including training and i…
  ☆93Updated last week
• wangsiping97 / GPU-Tutorials
  Tutorials to GPU programming. Reading notes.
  ☆17Updated 2 years ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated last week
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆135Updated this week
• CyberCommy / baidu-qa-100w
  百度QA100万数据集
  ☆47Updated last year
• bbruceyuan / bit-brain
  最少使用 3090 即可训练自己的比特大脑（miniLLM）🧠（进行中）. Train your own BitBrain(A mini LLM) with just an RTX 3090 minimum.
  ☆31Updated 3 weeks ago
• keith2018 / TinyTorch
  A tiny deep learning training framework implemented from scratch in C++ that follows PyTorch's API.
  ☆53Updated last week
• lucasjinreal / AI-Infer-Engine-From-Zero
  关于自建AI推理引擎的手册，从0开始你需要知道的所有事情
  ☆267Updated 2 years ago
• zjhellofss / KuiperCourse
  b站上的课程
  ☆75Updated last year
• GetUpEarlier / minit
  ☆27Updated last year
• Chtholly-Boss / swizzle
  A practical way of learning Swizzle
  ☆22Updated 5 months ago
• zjhellofss / kuiperbook
  ☆10Updated last month
• JKay0327 / whisper-TPU_py
  A whisper repo for TPU
  ☆10Updated last year