mosaicml / examples
Fast and flexible reference benchmarks
☆435Updated last month
Related projects: ⓘ
- batched loras☆326Updated last year
- Minimalistic large language model 3D-parallelism training☆1,111Updated this week
- ☆520Updated 8 months ago
- An open collection of methodologies to help with successful training of large language models.☆441Updated 7 months ago
- An open collection of implementation tips, tricks and resources for training large language models☆455Updated last year
- distributed trainer for LLMs☆521Updated 3 months ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆657Updated 5 months ago
- A Data Streaming Library for Efficient Neural Network Training☆1,076Updated this week
- Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript☆545Updated 2 months ago
- ☆1,164Updated last week
- ☆409Updated 10 months ago
- Fast & Simple repository for pre-training and fine-tuning T5-style models☆957Updated 3 weeks ago
- Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch☆850Updated 10 months ago
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding☆1,099Updated 7 months ago
- Inference code for Persimmon-8B☆416Updated last year
- Fast Inference Solutions for BLOOM☆556Updated last month
- What would you do with 1000 H100s...☆816Updated 8 months ago
- [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization☆629Updated last month
- Code for fine-tuning Platypus fam LLMs using LoRA☆625Updated 7 months ago
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆248Updated 10 months ago
- Tune any FALCON in 4-bit☆469Updated last year
- Finetuning Large Language Models on One Consumer GPU in Under 4 Bits☆696Updated 3 months ago
- Scalable toolkit for efficient model alignment☆509Updated this week
- Serving multiple LoRA finetuned LLM as one☆946Updated 4 months ago
- ☆453Updated 11 months ago
- Used for adaptive human in the loop evaluation of language and embedding models.☆300Updated last year
- Transformers with Arbitrarily Large Context☆613Updated last month
- Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.☆972Updated last month
- A repository for research on medium sized language models.☆469Updated last month
- Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".☆694Updated 3 weeks ago