naklecha / llm-inference-optimizations-explainedLinks
in this repository, i'm going to implement increasingly complex llm inference optimizations
☆64Updated 2 months ago
Alternatives and similar repositories for llm-inference-optimizations-explained
Users that are interested in llm-inference-optimizations-explained are comparing it to the libraries listed below
Sorting:
- rl from zero pretrain, can it be done? we'll see.☆66Updated 2 weeks ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆68Updated 3 months ago
- ☆46Updated 4 months ago
- Simple Transformer in Jax☆138Updated last year
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆188Updated 2 months ago
- A really tiny autograd engine☆95Updated 2 months ago
- SIMD quantization kernels☆76Updated this week
- Learning about CUDA by writing PTX code.☆133Updated last year
- working implimention of deepseek MLA☆42Updated 6 months ago
- small auto-grad engine inspired from Karpathy's micrograd and PyTorch☆274Updated 8 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 4 months ago
- look how they massacred my boy☆63Updated 9 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆62Updated 9 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆103Updated 4 months ago
- Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆172Updated last year
- ☆96Updated last year
- Compiling useful links, papers, benchmarks, ideas, etc.☆45Updated 4 months ago
- ☆64Updated 2 months ago
- Learnings and programs related to CUDA☆414Updated last month
- Collection of autoregressive model implementation☆86Updated 3 months ago
- Exploring Applications of GRPO☆245Updated 3 weeks ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆83Updated 3 months ago
- Simple & Scalable Pretraining for Neural Architecture Research☆277Updated last week
- ☆43Updated 3 months ago
- Lego for GRPO☆28Updated 2 months ago
- Cerule - A Tiny Mighty Vision Model☆66Updated 10 months ago
- Decentralized RL Training at Scale☆400Updated this week
- smolLM with Entropix sampler on pytorch☆150Updated 9 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago
- Dion optimizer algorithm☆193Updated this week