Generate textbook-quality synthetic LLM pretraining data
☆507Oct 19, 2023Updated 3 years ago
Alternatives and similar repositories for textbook_quality
Users that are interested in textbook_quality are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A multi-purpose LLM framework for RAG and data creation.☆622Jan 13, 2024Updated 2 years ago
- Score LLM pretraining data with classifiers☆54Nov 2, 2023Updated 3 years ago
- Convert all of libgen to high quality markdown☆253Dec 13, 2023Updated 2 years ago
- Customizable implementation of the self-instruct paper.☆1,053Mar 7, 2024Updated 2 years ago
- ☆182Oct 13, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- data cleaning and curation for unstructured text☆327Aug 6, 2024Updated 2 years ago
- Curate better data for LLMs☆1,069Mar 19, 2024Updated 2 years ago
- Fine-tune mistral-7B on 3090s, a100s, h100s☆737Oct 11, 2023Updated 3 years ago
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- batched loras☆352Sep 6, 2023Updated 3 years ago
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 3 years ago
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆28Apr 21, 2023Updated 3 years ago
- A bagel, with everything.☆327Apr 11, 2024Updated 2 years ago
- ☆75Sep 5, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Multipack distributed sampler for fast padding-free training of LLMs☆207Aug 10, 2024Updated 2 years ago
- ☆578Nov 20, 2024Updated last year
- Handles everything related to working with instruction datasets☆11Dec 19, 2023Updated 2 years ago
- ☆415Nov 2, 2023Updated 3 years ago
- Full finetuning of large language models without large memory requirements☆92Sep 22, 2025Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Sep 10, 2023Updated 3 years ago
- Robust recipes to align language models with human and AI preferences☆5,707Sep 23, 2026Updated last month
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,445Oct 26, 2026Updated last week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,471Jun 7, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer☆1,671Sep 15, 2023Updated 3 years ago
- Tools for merging pretrained large language models.☆7,427Updated this week
- ☆93Oct 5, 2023Updated 3 years ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆220Apr 29, 2024Updated 2 years ago
- Self-Alignment with Principle-Following Reward Models☆171Oct 9, 2026Updated 3 weeks ago
- QLoRA with Enhanced Multi GPU Support☆38Aug 8, 2023Updated 3 years ago
- evol augment any dataset online☆62Aug 3, 2023Updated 3 years ago
- ☆864Dec 8, 2023Updated 2 years ago
- [WIP] Transformer to embed Danbooru labelsets☆13Mar 31, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- YaRN: Efficient Context Window Extension of Large Language Models☆1,808Apr 17, 2024Updated 2 years ago
- Generate High Quality textual or multi-modal datasets with Agents☆18Jun 7, 2023Updated 3 years ago
- The official implementation of Self-Play Fine-Tuning (SPIN)☆1,255May 8, 2024Updated 2 years ago
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆509Sep 27, 2024Updated 2 years ago
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,413Apr 11, 2024Updated 2 years ago
- 🤖 A PyTorch library of curated Transformer models and their composable components☆890Apr 17, 2024Updated 2 years ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆3,414Updated this week