Entropy Based Sampling and Parallel CoT Decoding
☆3,435Nov 13, 2024Updated last year
Alternatives and similar repositories for entropix
Users that are interested in entropix are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- smol models are fun too☆94Nov 9, 2024Updated last year
- smolLM with Entropix sampler on pytorch☆148Oct 31, 2024Updated 2 years ago
- Plotting (entropy, varentropy) for small LMs☆99May 20, 2025Updated last year
- MoE training for Me and You and maybe other people☆400Mar 15, 2026Updated 7 months ago
- Our library for RL environments + evals☆4,768Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,771Jul 18, 2025Updated last year
- Simple Transformer in Jax☆143Jun 22, 2024Updated 2 years ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆61Nov 4, 2024Updated 2 years ago
- NanoGPT (124M) in 90 seconds☆6,006Sep 28, 2026Updated last month
- Optimizing inference proxy for LLMs☆4,335Updated this week
- ☆1,031Dec 17, 2024Updated last year
- Tools for merging pretrained large language models.☆7,436Updated this week
- A library for making RepE control vectors☆770Sep 24, 2025Updated last year
- look how they massacred my boy☆63Oct 16, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆358Mar 5, 2026Updated 8 months ago
- Modify Entropy Based Sampling to work with Mac Silicon via MLX☆49Nov 6, 2024Updated last year
- Go ahead and axolotl questions☆12,669Updated this week
- DSPy: The framework for programming—not prompting—language models☆38,904Updated this week
- Structured Outputs☆16,003Sep 21, 2026Updated last month
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Jan 7, 2026Updated 9 months ago
- System 2 Reasoning Link Collection☆875Mar 16, 2025Updated last year
- A language model programming library.☆5,848Jun 5, 2025Updated last year
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆509Sep 27, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Efficient Triton Kernels for LLM Training☆6,686Updated this week
- Puffing up reinforcement learning☆6,581Oct 14, 2026Updated 3 weeks ago
- Minimal reproduction of DeepSeek R1-Zero☆13,262Feb 27, 2026Updated 8 months ago
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆22,108Apr 15, 2026Updated 6 months ago
- A bibliography and survey of the papers surrounding o1☆1,214Jul 7, 2026Updated 3 months ago
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,975May 17, 2025Updated last year
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,450Updated this week
- Recipes to scale inference-time compute of open models☆1,133Sep 23, 2026Updated last month
- You like pytorch? You like micrograd? You love tinygrad! ❤️☆33,830Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Multiversal tree writing interface for human-AI collaboration☆1,396Jun 28, 2024Updated 2 years ago
- A Loom implementation in Obsidian☆334Mar 20, 2025Updated last year
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,268Aug 22, 2025Updated last year
- A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.☆6,902Dec 17, 2025Updated 10 months ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,772Updated this week
- Code for BLT research paper☆2,070Nov 3, 2025Updated last year
- ☆40Jul 26, 2024Updated 2 years ago