foundation-model-stack / fms-accelerationLinks
🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
☆13Updated last week
Alternatives and similar repositories for fms-acceleration
Users that are interested in fms-acceleration are comparing it to the libraries listed below
Sorting:
- Experimental scripts for researching data adaptive learning rate scheduling.☆22Updated 2 years ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆15Updated last year
- ☆26Updated 2 years ago
- vLLM adapter for a TGIS-compatible gRPC server.☆45Updated this week
- Utilities for Training Very Large Models☆58Updated last year
- Train, tune, and infer Bamba model☆137Updated 6 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated last year
- NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference☆69Updated last year
- DPO, but faster 🚀☆46Updated last year
- ☆47Updated last year
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- ☆16Updated last year
- Example ML projects that use the Determined library.☆32Updated last year
- ☆38Updated 2 months ago
- A collection of reproducible inference engine benchmarks☆38Updated 7 months ago
- Using FlexAttention to compute attention with different masking patterns☆47Updated last year
- LM engine is a library for pretraining/finetuning LLMs☆77Updated this week
- Fork of Flame repo for training of some new stuff in development☆19Updated 2 weeks ago
- Lottery Ticket Adaptation☆40Updated last year
- JAX Scalify: end-to-end scaled arithmetics☆17Updated last year
- Repository for CPU Kernel Generation for LLM Inference☆27Updated 2 years ago
- ☆68Updated 6 months ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated 2 years ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆62Updated 3 months ago
- ☆13Updated 2 years ago
- Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.☆79Updated 3 weeks ago
- ☆24Updated last year