An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
☆150Jan 7, 2026Updated last month
Alternatives and similar repositories for backtrack_sampler
Users that are interested in backtrack_sampler are comparing it to the libraries listed below
Sorting:
- ☆338Jul 28, 2025Updated 7 months ago
- smolLM with Entropix sampler on pytorch☆149Oct 31, 2024Updated last year
- entropix style sampling + GUI☆27Oct 30, 2024Updated last year
- AI management tool☆121Nov 9, 2024Updated last year
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆62Nov 4, 2024Updated last year
- Karpathy's llama2.c transpiled to MLX for Apple Silicon☆14Dec 28, 2023Updated 2 years ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Oct 1, 2025Updated 5 months ago
- A cli app for experimenting with kokoro voice creating and mixing using the available voices to interpolate new ones☆37Feb 5, 2025Updated last year
- An introduction to LLM Sampling☆80Dec 15, 2024Updated last year
- ☆11Jul 21, 2024Updated last year
- A creative coding environment where Claude can express itself through generative art using p5.js. See tweet thread for examples: https://…☆13Feb 3, 2026Updated last month
- ☆15Apr 26, 2025Updated 10 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆3,434Nov 13, 2024Updated last year
- Forces DeepSeek R1 models to engage in extended reasoning by intercepting early termination tokens.☆19Feb 12, 2025Updated last year
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 2 years ago
- Experimental LLM Inference UX to aid in creative writing☆128Dec 14, 2024Updated last year
- ☆24Jan 22, 2025Updated last year
- Fine-tune ModernBERT with custom tokenizers, curriculum learning, and next-gen optimizers.☆74Jan 16, 2026Updated last month
- Optimizing inference proxy for LLMs☆3,352Jan 28, 2026Updated last month
- ☆210Jan 5, 2026Updated last month
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆13May 5, 2024Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆180May 2, 2024Updated last year
- Genertaes control vectors for use with llama.cpp in GGUF format.☆38Mar 19, 2025Updated 11 months ago
- A library for making RepE control vectors☆691Sep 24, 2025Updated 5 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Sep 22, 2025Updated 5 months ago
- various experiments for scaling inference time compute with small reasoning models☆17Jan 16, 2025Updated last year
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Oct 8, 2025Updated 4 months ago
- Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…☆51May 7, 2025Updated 9 months ago
- Embed anything.☆27May 24, 2024Updated last year
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆56Feb 10, 2025Updated last year
- Project code for training LLMs to write better unit tests + code☆21May 19, 2025Updated 9 months ago
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆21Feb 23, 2024Updated 2 years ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆240May 26, 2024Updated last year
- Multipack distributed sampler for fast padding-free training of LLMs☆204Aug 10, 2024Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆615Feb 17, 2025Updated last year
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆675Apr 25, 2025Updated 10 months ago
- LLMs as Collaboratively Edited Knowledge Bases☆46Feb 8, 2026Updated 3 weeks ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Apr 29, 2024Updated last year
- Approximating the joint distribution of language models via MCTS☆22Nov 3, 2024Updated last year