kabir2505 / tiny-mixtralLinks
☆44Updated 3 months ago
Alternatives and similar repositories for tiny-mixtral
Users that are interested in tiny-mixtral are comparing it to the libraries listed below
Sorting:
- ☆46Updated 4 months ago
- minimal GRPO implementation from scratch☆96Updated 5 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆69Updated 4 months ago
- ☆405Updated this week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆190Updated 2 months ago
- Collection of autoregressive model implementation☆86Updated 4 months ago
- An extension of the nanoGPT repository for training small MOE models.☆178Updated 5 months ago
- ☆192Updated 7 months ago
- making the official triton tutorials actually comprehensible☆53Updated last month
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆66Updated 3 months ago
- working implimention of deepseek MLA☆43Updated 7 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 5 months ago
- RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct☆30Updated 6 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆56Updated last year
- GPU Kernels☆193Updated 4 months ago
- Low memory full parameter finetuning of LLMs☆52Updated last month
- ☆214Updated 6 months ago
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆116Updated 3 months ago
- Memory optimized Mixture of Experts☆54Updated last month
- ☆43Updated 3 months ago
- First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…☆178Updated last month
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆105Updated 5 months ago
- A collection of tricks and tools to speed up transformer models☆170Updated 2 months ago
- ☆48Updated 11 months ago
- Simple repository for training small reasoning models☆37Updated 6 months ago
- coding CUDA everyday!☆56Updated 4 months ago
- ☆64Updated this week
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆97Updated 3 weeks ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆391Updated 5 months ago