axolotl-ai-cloud / axolotl-cookbook
☆25Updated 3 weeks ago
Alternatives and similar repositories for axolotl-cookbook:
Users that are interested in axolotl-cookbook are comparing it to the libraries listed below
- Simple GRPO scripts and configurations.☆58Updated last month
- ☆48Updated 4 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated last month
- look how they massacred my boy☆63Updated 5 months ago
- Train your own SOTA deductive reasoning model☆81Updated 3 weeks ago
- Lego for GRPO☆25Updated last week
- model activation visualiser☆90Updated this week
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- entropix style sampling + GUI☆25Updated 4 months ago
- An intelligent code optimization system leveraging AI analysis, automated refactoring, and test generation. Built with DSPy and Gradio, i…☆18Updated last month
- Set of scripts to finetune LLMs☆37Updated 11 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated 5 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated last month
- OpenPipe Reinforcement Learning Experiments☆20Updated 2 weeks ago
- ☆48Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 4 months ago
- A Qwen .5B reasoning model trained on OpenR1-Math-220k☆12Updated last month
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆52Updated last week
- ☆38Updated last month
- Combining Base and Instruction-Tuned Language Models for Better Synthetic Data Generation☆26Updated last month
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆91Updated 3 weeks ago
- ☆38Updated 8 months ago
- alternative way to calculating self attention☆18Updated 10 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆42Updated 10 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated last week
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆38Updated 6 months ago
- ☆66Updated 10 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆59Updated last year
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 11 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year