JD-P / RetroInstructLinks
Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
☆32Updated 3 months ago
Alternatives and similar repositories for RetroInstruct
Users that are interested in RetroInstruct are comparing it to the libraries listed below
Sorting:
- look how they massacred my boy☆63Updated 8 months ago
- Approximating the joint distribution of language models via MCTS☆21Updated 7 months ago
- ☆38Updated 10 months ago
- Modify Entropy Based Sampling to work with Mac Silicon via MLX☆50Updated 7 months ago
- ☆47Updated last year
- Using modal.com to process FineWeb-edu data☆20Updated 2 months ago
- Lego for GRPO☆28Updated 3 weeks ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆59Updated last year
- utilities for loading and running text embeddings with onnx☆44Updated 10 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 4 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆64Updated 7 months ago
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆30Updated 2 years ago
- ☆63Updated 3 weeks ago
- ☆10Updated last month
- Verbosity control for AI agents☆63Updated last year
- train entropix like a champ!☆20Updated 8 months ago
- KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…☆24Updated last year
- Chat Markup Language conversation library☆55Updated last year
- Sparse autoencoders for Contra text embedding models☆25Updated last year
- Latent Large Language Models☆18Updated 9 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.☆69Updated 4 months ago
- ☆22Updated last year
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated 8 months ago
- Simple GRPO scripts and configurations.☆58Updated 4 months ago
- coloring terminal text with intensities (used for plotting probability, entropy with tokens)☆12Updated 8 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- Vanilla-Python ergonomics on top of DSPy☆31Updated 2 weeks ago
- Training code for Sparse Autoencoders on Embedding models☆38Updated 3 months ago
- A graph visualization of attention☆55Updated last month