naklecha / llm-inference-optimizations-explainedLinks
in this repository, i'm going to implement increasingly complex llm inference optimizations
☆64Updated 3 months ago
Alternatives and similar repositories for llm-inference-optimizations-explained
Users that are interested in llm-inference-optimizations-explained are comparing it to the libraries listed below
Sorting:
- ☆46Updated 4 months ago
- rl from zero pretrain, can it be done? yes.☆257Updated this week
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆105Updated 5 months ago
- SIMD quantization kernels☆79Updated 2 weeks ago
- Simple Transformer in Jax☆139Updated last year
- small auto-grad engine inspired from Karpathy's micrograd and PyTorch☆278Updated 9 months ago
- A really tiny autograd engine☆95Updated 3 months ago
- working implimention of deepseek MLA☆43Updated 7 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆69Updated 4 months ago
- Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆172Updated last year
- Learning about CUDA by writing PTX code.☆134Updated last year
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆84Updated this week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆190Updated 2 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 5 months ago
- Collection of autoregressive model implementation☆86Updated 4 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆63Updated 9 months ago
- look how they massacred my boy☆64Updated 10 months ago
- ☆96Updated last year
- Lego for GRPO☆28Updated 2 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆250Updated 2 weeks ago
- ☆66Updated 3 months ago
- Exploring Applications of GRPO☆246Updated last month
- Cerule - A Tiny Mighty Vision Model☆66Updated 11 months ago
- Learnings and programs related to CUDA☆415Updated last month
- Compiling useful links, papers, benchmarks, ideas, etc.☆45Updated 5 months ago
- Simple & Scalable Pretraining for Neural Architecture Research☆289Updated this week
- ☆44Updated 3 months ago
- a tiny vectorstore implementation built with numpy.☆63Updated last year
- coding CUDA everyday!☆56Updated 4 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago