huggingface / llm_training_handbookLinks
An open collection of methodologies to help with successful training of large language models.
☆512Updated last year
Alternatives and similar repositories for llm_training_handbook
Users that are interested in llm_training_handbook are comparing it to the libraries listed below
Sorting:
- An open collection of implementation tips, tricks and resources for training large language models☆481Updated 2 years ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆720Updated last year
- Code for fine-tuning Platypus fam LLMs using LoRA☆627Updated last year
- A repository for research on medium sized language models.☆511Updated 4 months ago
- LLM Workshop by Sourab Mangrulkar☆394Updated last year
- ☆541Updated 10 months ago
- Scaling Data-Constrained Language Models☆342Updated 3 months ago
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆256Updated last year
- batched loras☆346Updated 2 years ago
- distributed trainer for LLMs☆580Updated last year
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆548Updated last year
- Evaluation suite for LLMs☆364Updated 2 months ago
- Build, evaluate, understand, and fix LLM-based apps☆490Updated last year
- Salesforce open-source LLMs with 8k sequence length.☆721Updated 8 months ago
- Official repository for ORPO☆464Updated last year
- Fast Inference Solutions for BLOOM☆565Updated last year
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆311Updated last year
- Inference code for Mistral and Mixtral hacked up into original Llama implementation☆370Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆963Updated 11 months ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆473Updated last year
- A bagel, with everything.