foundation-model-stack / fms-extrasLinks
☆24Updated last year
Alternatives and similar repositories for fms-extras
Users that are interested in fms-extras are comparing it to the libraries listed below
Sorting:
- ☆219Updated last year
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆279Updated 2 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆280Updated 2 years ago
- Simple implementation of Speculative Sampling in NumPy for GPT-2.☆99Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Updated 2 months ago
- Experiments on speculative sampling with Llama models☆127Updated 2 years ago
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆157Updated 10 months ago
- Triton-based implementation of Sparse Mixture of Experts.☆263Updated 4 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated last year
- scalable and robust tree-based speculative decoding algorithm☆366Updated last year
- LM engine is a library for pretraining/finetuning LLMs☆113Updated this week
- A safetensors extension to efficiently store sparse quantized tensors on disk☆238Updated this week
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆131Updated last year
- Benchmark suite for LLMs from Fireworks.ai☆89Updated last week
- This repository contains the experimental PyTorch native float8 training UX☆227Updated last year
- ☆115Updated last year
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆252Updated last year
- ☆125Updated last year
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…☆148Updated last year
- PyTorch implementation of models from the Zamba2 series.☆186Updated last year
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆371Updated last year
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆219Updated this week
- Easy and Efficient Quantization for Transformers☆204Updated last week
- ☆124Updated last year
- ☆128Updated 2 years ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆247Updated 8 months ago
- Simple high-throughput inference library☆155Updated 8 months ago
- ☆71Updated 10 months ago
- ☆47Updated 2 years ago