foundation-model-stack / fms-extrasLinks
☆24Updated last year
Alternatives and similar repositories for fms-extras
Users that are interested in fms-extras are comparing it to the libraries listed below
Sorting:
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆271Updated 3 weeks ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆130Updated last year
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆279Updated 2 years ago
- ☆219Updated 10 months ago
- This repository contains the experimental PyTorch native float8 training UX☆227Updated last year
- Official implementation for Training LLMs with MXFP4☆115Updated 7 months ago
- PB-LLM: Partially Binarized Large Language Models☆157Updated 2 years ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated last year
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆157Updated 8 months ago
- Experiments on speculative sampling with Llama models☆127Updated 2 years ago
- ☆204Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Updated 2 weeks ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- Simple implementation of Speculative Sampling in NumPy for GPT-2.☆98Updated 2 years ago
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆249Updated 10 months ago
- ☆128Updated last year
- ☆47Updated last year
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆216Updated last week
- RWKV in nanoGPT style☆195Updated last year
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- A collection of reproducible inference engine benchmarks☆38Updated 7 months ago
- Load compute kernels from the Hub☆347Updated this week
- ☆91Updated last year
- Token Omission Via Attention☆128Updated last year
- ☆121Updated last year
- DPO, but faster 🚀☆46Updated last year
- Multipack distributed sampler for fast padding-free training of LLMs☆202Updated last year
- Make triton easier☆49Updated last year
- A safetensors extension to efficiently store sparse quantized tensors on disk☆220Updated this week
- ☆53Updated last year