foundation-model-stack / fms-accelerationLinks
🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
☆13Updated 3 weeks ago
Alternatives and similar repositories for fms-acceleration
Users that are interested in fms-acceleration are comparing it to the libraries listed below
Sorting:
- Experimental scripts for researching data adaptive learning rate scheduling.☆22Updated 2 years ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆16Updated last year
- Utilities for Training Very Large Models☆58Updated last year
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- some mixture of experts architecture implementations☆25Updated last year
- ☆47Updated last year
- JAX Scalify: end-to-end scaled arithmetics☆17Updated last year
- Train, tune, and infer Bamba model☆137Updated 7 months ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆15Updated 2 years ago
- Fork of Flame repo for training of some new stuff in development☆19Updated this week
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆55Updated 3 weeks ago
- ☆26Updated 2 years ago
- A collection of reproducible inference engine benchmarks☆38Updated 8 months ago
- ☆21Updated 10 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- vLLM adapter for a TGIS-compatible gRPC server.☆47Updated this week
- ☆34Updated last year
- Lottery Ticket Adaptation☆40Updated last year
- PyTorch centric eager mode debugger☆48Updated last year
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated last year
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago
- ☆24Updated last year
- Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise☆40Updated last year
- LM engine is a library for pretraining/finetuning LLMs☆103Updated last week
- An ML research codebase built with friends :)☆26Updated last year
- DPO, but faster 🚀☆46Updated last year
- ☆82Updated last month
- ☆52Updated last year
- Repository for CPU Kernel Generation for LLM Inference☆27Updated 2 years ago
- An experimental implementation of compiler-driven automatic sharding of models across a given device mesh.☆48Updated this week