Elluran / concentration_notebooksLinks
☆11Updated last year
Alternatives and similar repositories for concentration_notebooks
Users that are interested in concentration_notebooks are comparing it to the libraries listed below
Sorting:
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆23Updated last year
- look how they massacred my boy☆63Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 3 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- An introduction to LLM Sampling☆79Updated last year
- ☆62Updated 2 years ago
- Simple GRPO scripts and configurations.☆59Updated last year
- [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluation☆61Updated last month
- ☆35Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated 2 years ago
- Cerule - A Tiny Mighty Vision Model☆68Updated 3 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- ☆137Updated last year
- Approximating the joint distribution of language models via MCTS☆22Updated last year
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- ☆40Updated last year
- Latent Large Language Models☆19Updated last year
- ☆68Updated last year
- OpenPipe Reinforcement Learning Experiments☆32Updated 10 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated last year
- Lego for GRPO☆30Updated 8 months ago
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Updated 4 months ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated 2 years ago
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆37Updated last year
- ☆41Updated last year
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆175Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Updated last month
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆110Updated 11 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago