Glavin001 / Data2AITextbook
🚀 Automatically convert unstructured data into a high-quality 'textbook' format, optimized for fine-tuning Large Language Models (LLMs)
☆26Updated last year
Alternatives and similar repositories for Data2AITextbook:
Users that are interested in Data2AITextbook are comparing it to the libraries listed below
- Data preparation code for CrystalCoder 7B LLM☆44Updated 10 months ago
- ☆48Updated 4 months ago
- ☆20Updated last year
- ☆40Updated last month
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆41Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 2 months ago
- Implementation of "SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models"☆27Updated last month
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆43Updated last year
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated last year
- One Line To Build Zero-Data Classifiers in Minutes☆36Updated 6 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆59Updated 7 months ago
- Universal text classifier for generative models☆22Updated 8 months ago
- ☆48Updated last year
- ☆32Updated 9 months ago
- entropix style sampling + GUI☆25Updated 5 months ago
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆16Updated last year
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆59Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆73Updated 5 months ago
- Simple GRPO scripts and configurations.☆58Updated last month
- LLMs as Collaboratively Edited Knowledge Bases☆45Updated last year
- Writing Blog Posts with Generative Feedback Loops!☆47Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆76Updated 5 months ago
- ☆45Updated 6 months ago
- ☆49Updated 10 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆37Updated last year
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆14Updated last year
- Advanced Reasoning Benchmark Dataset for LLMs☆45Updated last year