foundation-model-stack / fms-extrasLinks
☆24Updated last year
Alternatives and similar repositories for fms-extras
Users that are interested in fms-extras are comparing it to the libraries listed below
Sorting:
- ☆219Updated last year
- Experiments on speculative sampling with Llama models☆127Updated 2 years ago
- LM engine is a library for pretraining/finetuning LLMs☆113Updated last week
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆131Updated last year
- This repository contains the experimental PyTorch native float8 training UX☆227Updated last year
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated last year
- Official implementation for Training LLMs with MXFP4☆118Updated 9 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆279Updated 2 months ago
- Benchmark suite for LLMs from Fireworks.ai☆89Updated this week
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆280Updated 2 years ago
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆157Updated 10 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆72Updated 3 weeks ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆219Updated this week
- ☆47Updated 2 years ago
- Simple high-throughput inference library☆155Updated 8 months ago
- Simple implementation of Speculative Sampling in NumPy for GPT-2.☆99Updated 2 years ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆238Updated this week
- ☆203Updated last year
- DPO, but faster 🚀☆47Updated last year
- Experiment of using Tangent to autodiff triton☆82Updated 2 years ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated 2 years ago
- PB-LLM: Partially Binarized Large Language Models☆157Updated 2 years ago
- scalable and robust tree-based speculative decoding algorithm☆366Updated last year
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆252Updated last year
- Boosting 4-bit inference kernels with 2:4 Sparsity☆93Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆263Updated 4 months ago
- RWKV in nanoGPT style☆197Updated last year
- Example of applying CUDA graphs to LLaMA-v2☆12Updated 2 years ago
- Easy and Efficient Quantization for Transformers☆204Updated last week
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆73Updated last year