xjdr-alt / entropix-local
smol models are fun too
☆89Updated 4 months ago
Alternatives and similar repositories for entropix-local:
Users that are interested in entropix-local are comparing it to the libraries listed below
- smolLM with Entropix sampler on pytorch☆150Updated 4 months ago
- ☆97Updated 5 months ago
- look how they massacred my boy☆63Updated 4 months ago
- Simple Transformer in Jax☆136Updated 8 months ago
- train entropix like a champ!☆20Updated 5 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆63Updated 4 months ago
- ☆101Updated 2 months ago
- Aidan Bench attempts to measure <big_model_smell> in LLMs.☆286Updated last week
- Modify Entropy Based Sampling to work with Mac Silicon via MLX☆50Updated 4 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆135Updated 3 weeks ago
- ☆126Updated 6 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated 5 months ago
- Fast parallel LLM inference for MLX☆173Updated 8 months ago
- ☆270Updated last month
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆167Updated last month
- DeMo: Decoupled Momentum Optimization☆182Updated 3 months ago
- Testing baseline LLMs performance across various models☆229Updated last week
- ☆38Updated 7 months ago
- Long context evaluation for large language models☆201Updated last week
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆165Updated last week
- ☆111Updated 2 months ago
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆422Updated 5 months ago
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆222Updated last month
- Draw more samples☆186Updated 8 months ago
- ☆20Updated 4 months ago