Tiny C++ LLM inference implementation from scratch
☆106Jan 29, 2026Updated last month
Alternatives and similar repositories for TinyGPT
Users that are interested in TinyGPT are comparing it to the libraries listed below
Sorting:
- ☆11Dec 26, 2025Updated 2 months ago
- Tengine 管子是用来快速生产 demo 的辅助工具☆12Jul 15, 2021Updated 4 years ago
- ☆17Mar 17, 2023Updated 2 years ago
- RISC-V vector and tensor compute extensions for Vortex GPGPU acceleration for ML workloads. Optimized for transformer models, CNNs, and g…☆21Apr 25, 2025Updated 10 months ago
- A toolkit for developers to simplify the transformation of nn.Module instances. It's now corresponding to Pytorch.fx.☆13Apr 7, 2023Updated 2 years ago
- ☆10Jun 13, 2023Updated 2 years ago
- Run Rocket Chip on VCU128☆30Oct 21, 2025Updated 4 months ago
- tutorial for writing custom pytorch cpp+cuda kernel, applied on volume rendering (NeRF)☆29Dec 12, 2023Updated 2 years ago
- ☆16Feb 7, 2023Updated 3 years ago
- EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！☆39Aug 26, 2024Updated last year
- My tests and experiments with some popular dl frameworks.☆17Sep 11, 2025Updated 5 months ago
- ☆33Jul 23, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Jun 3, 2024Updated last year
- A simulator integrates ChampSim and Ramulator.☆19Aug 18, 2025Updated 6 months ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆64Nov 8, 2024Updated last year
- ☆17Jan 1, 2024Updated 2 years ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆18Dec 19, 2024Updated last year
- Whisper in TensorRT-LLM☆17Sep 21, 2023Updated 2 years ago
- A PyTorch implementation of SEED, originally created by Google Research for TensorFlow 2.☆15Dec 8, 2020Updated 5 years ago
- ☆69Mar 19, 2023Updated 2 years ago
- ☆38Aug 7, 2025Updated 6 months ago
- Transformer related optimization, including BERT, GPT☆17Jul 29, 2023Updated 2 years ago
- cartpole的多种控制方法（强化学习、自适应pid、粒子群）☆20Dec 19, 2018Updated 7 years ago
- CUDA 12.2 HMM demos☆20Jul 26, 2024Updated last year
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Jul 21, 2023Updated 2 years ago
- High Performan Ai Model Web Server. Mainly support computer vision model. Quickly establish your own ai-model server. https://github.com/…☆45May 13, 2025Updated 9 months ago
- qwen2 and llama3 cpp implementation☆49Jun 7, 2024Updated last year
- A practical way of learning Swizzle☆37Feb 3, 2025Updated last year
- 使用OpenCV部署L2CS-Net人脸朝向估计，包含C++和Python两个版本的程序，只依赖opencv库就可以运行☆21Aug 12, 2023Updated 2 years ago
- ☆16Jul 15, 2022Updated 3 years ago
- Low overhead tracing library and trace visualizer for pipelined CUDA kernels☆131Nov 26, 2025Updated 3 months ago
- a CSK serial based train tools， rely on pytorch☆29Feb 6, 2026Updated last month
- GPGPU-Sim 中文注释版代码，包含 GPGPU-Sim 模拟器的最新版代码，经过中文注释，以帮助中文用户更好地理解和使用该模拟器。☆28Dec 18, 2024Updated last year
- ☆23Apr 25, 2023Updated 2 years ago
- 《深入理解文件系统原理和实践》pdf, ISBN: 978-7-89381-214-9☆28May 6, 2024Updated last year
- ☆31Feb 25, 2026Updated last week
- Autocomp: AI-Driven Code Optimizer for Tensor Accelerators☆74Feb 24, 2026Updated last week
- This is our Compiler Design project for 6th semester.☆12May 15, 2022Updated 3 years ago
- ☆42Nov 1, 2025Updated 4 months ago