Glavin001 / Data2AITextbook
π Automatically convert unstructured data into a high-quality 'textbook' format, optimized for fine-tuning Large Language Models (LLMs)
β26Updated last year
Alternatives and similar repositories for Data2AITextbook:
Users that are interested in Data2AITextbook are comparing it to the libraries listed below
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.β33Updated last year
- Using multiple LLMs for ensemble Forecastingβ16Updated last year
- Data preparation code for CrystalCoder 7B LLMβ44Updated 11 months ago
- GPT-4 Level Conversational QA Trained In a Few Hoursβ60Updated 8 months ago
- β48Updated 5 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optunaβ39Updated 2 months ago
- SCREWS: A Modular Framework for Reasoning with Revisionsβ27Updated last year
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.β22Updated 3 weeks ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absoluteβ¦β49Updated 9 months ago
- Implementation of "SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models"β27Updated 2 months ago
- β49Updated 10 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimizationβ61Updated last year
- β50Updated 5 months ago
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding forβ¦β25Updated 4 months ago
- β37Updated 2 years ago
- OpenPipe Reinforcement Learning Experimentsβ22Updated last month
- entropix style sampling + GUIβ25Updated 5 months ago
- LLM reads a paper and produce a working prototypeβ52Updated 2 weeks ago
- A collection of notebooks for the Hugging Face blog series (https://huggingface.co/blog).β45Updated 8 months ago
- Simple GRPO scripts and configurations.β58Updated 2 months ago
- Example implementation of Iteration of Tought - Gives a star if you like the projectβ40Updated 4 months ago
- β24Updated 7 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasksβ31Updated 11 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Modelsβ69Updated last year
- β62Updated 3 weeks ago
- β24Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorerβ42Updated last year
- The Next Generation Multi-Modality Superintelligenceβ71Updated 7 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)β90Updated 3 months ago
- Generate High Quality textual or multi-modal datasets with Agentsβ18Updated last year