nivibilla / build-nanogpt
Video+code lecture on building nanoGPT from scratch
☆66Updated 10 months ago
Alternatives and similar repositories for build-nanogpt:
Users that are interested in build-nanogpt are comparing it to the libraries listed below
- Testing LLM reasoning abilities with family relationship quizzes.☆62Updated 2 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆138Updated last month
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆95Updated last month
- Scripts to create your own moe models using mlx☆89Updated last year
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆42Updated 10 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 7 months ago
- ☆112Updated 3 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆58Updated this week
- Collection of autoregressive model implementation☆85Updated 2 months ago
- All the world is a play, we are but actors in it.☆49Updated this week
- Arxflix turns your boring Arxiv research paper into a captivating video.☆47Updated 4 months ago
- A pipeline parallel training script for LLMs.☆137Updated 2 weeks ago
- entropix style sampling + GUI☆25Updated 5 months ago
- Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…☆40Updated last month
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆88Updated 3 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆63Updated 5 months ago
- Train your own SOTA deductive reasoning model☆83Updated last month
- ☆129Updated 7 months ago
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆107Updated last month
- ☆66Updated 10 months ago
- look how they massacred my boy☆63Updated 5 months ago
- Lego for GRPO☆26Updated last week
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated last year
- Use the Moondream 2 model to detect faces and their gaze directions in videos.☆39Updated 3 months ago
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Simple GRPO scripts and configurations.☆58Updated 2 months ago
- Distributed Inference for mlx LLm☆87Updated 8 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆90Updated 9 months ago
- ☆28Updated last year