smol models are fun too
☆93Nov 9, 2024Updated last year
Alternatives and similar repositories for entropix-local
Users that are interested in entropix-local are comparing it to the libraries listed below
Sorting:
- train entropix like a champ!☆20Oct 10, 2024Updated last year
- Entropy Based Sampling and Parallel CoT Decoding☆3,432Nov 13, 2024Updated last year
- smolLM with Entropix sampler on pytorch☆149Oct 31, 2024Updated last year
- look how they massacred my boy☆63Oct 16, 2024Updated last year
- Entropy Based Sampling and Parallel CoT Decoding☆17Oct 9, 2024Updated last year
- Modify Entropy Based Sampling to work with Mac Silicon via MLX☆49Nov 6, 2024Updated last year
- coloring terminal text with intensities (used for plotting probability, entropy with tokens)☆12Oct 11, 2024Updated last year
- An Open Source SLM Trained for MCP☆23May 18, 2025Updated 9 months ago
- Approximating the joint distribution of language models via MCTS☆22Nov 3, 2024Updated last year
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆62Nov 4, 2024Updated last year
- Simple Transformer in Jax☆143Jun 22, 2024Updated last year
- Auto generate decoders for OCaml☆10Dec 19, 2024Updated last year
- Plotting (entropy, varentropy) for small LMs☆99May 20, 2025Updated 9 months ago
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- Smart reproducible analytical pipeline inspection☆21Feb 13, 2026Updated 3 weeks ago
- An AI character interaction system with emotional modeling and advanced memory management☆17Oct 26, 2024Updated last year
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58May 14, 2024Updated last year
- NanoGPT-speedrunning for the poor T4 enjoyers☆73Apr 22, 2025Updated 10 months ago
- Grokking on modular arithmetic in less than 150 epochs in MLX☆14Oct 24, 2024Updated last year
- ☆44Jan 24, 2024Updated 2 years ago
- ☆40Jul 26, 2024Updated last year
- The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"☆19Jul 24, 2024Updated last year
- ☆67May 23, 2025Updated 9 months ago
- A light tensor library in zig.☆77Feb 9, 2025Updated last year
- ☆21Jul 25, 2025Updated 7 months ago
- A new way to generate large quantities of high quality synthetic data (on par with GPT-4), with better controllability, at a fraction of …☆23Oct 1, 2024Updated last year
- A graph visualization of attention☆57May 20, 2025Updated 9 months ago
- ☆58Nov 19, 2024Updated last year
- A process manager for linux, mac & windows to simplify your developer environment.☆41Feb 3, 2026Updated last month
- Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…☆33Feb 7, 2025Updated last year
- Collection of resources for RL and Reasoning☆27Feb 3, 2025Updated last year
- Exploring Applications of GRPO☆252Aug 25, 2025Updated 6 months ago
- LLM plugin for models hosted by Anyscale Endpoints☆35Apr 22, 2024Updated last year
- entropix style sampling + GUI☆27Oct 30, 2024Updated last year
- ☆27Jul 9, 2024Updated last year
- Universal Neurons in GPT2 Language Models☆30May 28, 2024Updated last year
- Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"☆578Jun 28, 2024Updated last year
- ☆32May 26, 2025Updated 9 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Sep 17, 2025Updated 5 months ago