Glavin001 / Data2AITextbook
🚀 Automatically convert unstructured data into a high-quality 'textbook' format, optimized for fine-tuning Large Language Models (LLMs)
☆26Updated last year
Alternatives and similar repositories for Data2AITextbook:
Users that are interested in Data2AITextbook are comparing it to the libraries listed below
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆22Updated last month
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 10 months ago
- Universal text classifier for generative models☆22Updated 6 months ago
- ☆48Updated 2 months ago
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated last year
- Data preparation code for CrystalCoder 7B LLM☆44Updated 8 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 6 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆74Updated 3 months ago
- entropix style sampling + GUI☆25Updated 3 months ago
- ☆20Updated last year
- A collection of notebooks for the Hugging Face blog series (https://huggingface.co/blog).☆42Updated 5 months ago
- LLM reads a paper and produce a working prototype☆48Updated last month
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆52Updated 11 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Pre-training code for CrystalCoder 7B LLM☆55Updated 8 months ago
- LLMs as Collaboratively Edited Knowledge Bases☆43Updated 11 months ago
- ☆31Updated 7 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- Official homepage for "Self-Harmonized Chain of Thought"☆89Updated last week
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 8 months ago
- ☆24Updated last year
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆20Updated last month
- Data preparation code for Amber 7B LLM☆84Updated 8 months ago
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆46Updated 9 months ago
- ☆49Updated 8 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆37Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆29Updated 4 months ago
- The Next Generation Multi-Modality Superintelligence☆70Updated 4 months ago