Glavin001 / Data2AITextbookLinks
🚀 Automatically convert unstructured data into a high-quality 'textbook' format, optimized for fine-tuning Large Language Models (LLMs)
☆25Updated last year
Alternatives and similar repositories for Data2AITextbook
Users that are interested in Data2AITextbook are comparing it to the libraries listed below
Sorting:
- Latent Large Language Models☆18Updated 9 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated last year
- Data preparation code for CrystalCoder 7B LLM☆44Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 4 months ago
- ☆49Updated 7 months ago
- ☆76Updated last year
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆26Updated 5 months ago
- ☆23Updated last year
- Simple GRPO scripts and configurations.☆58Updated 4 months ago
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆19Updated last year
- Verifiers for LLM Reinforcement Learning☆56Updated last month
- Using open source LLMs to build synthetic datasets for direct preference optimization☆63Updated last year
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆76Updated 7 months ago
- ☆9Updated last month
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- ☆43Updated 3 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆56Updated 3 weeks ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆69Updated 2 weeks ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 8 months ago
- Pre-training code for CrystalCoder 7B LLM☆54Updated last year
- entropix style sampling + GUI☆26Updated 7 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Universal text classifier for generative models☆24Updated 10 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated 7 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆43Updated last year