foundation-model-stack / fms-extras

Related projects ⓘ

Alternatives and complementary repositories for fms-extras

• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆50Updated this week
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆56Updated last month
• fw-ai / llama-cuda-graph-example
  Example of applying CUDA graphs to LLaMA-v2
  ☆10Updated last year
• apple / ml-recurrent-drafter
  ☆99Updated last month
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆104Updated last month
• wdlctc / mini-s
  ☆35Updated 3 weeks ago
• UmerHA / triton_util
  Make triton easier
  ☆41Updated 5 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 10 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆139Updated this week
• RobertCsordas / moeut
  ☆62Updated 3 months ago
• euclaise / supertrainer2000
  ☆49Updated 8 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last month
• Infini-AI-Lab / MagicDec
  Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆79Updated this week
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆118Updated last year
• HanGuo97 / lq-lora
  ☆122Updated 10 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆187Updated this week
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆45Updated 2 months ago
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆64Updated last week
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆78Updated 3 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (Official Code)
  ☆135Updated last month
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆56Updated last month
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆66Updated this week
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆148Updated last year
• mistralai / mistral-evals
  ☆48Updated last month
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆74Updated last month
• lianakoleva / no-libtorch-compile
  ☆17Updated 3 weeks ago
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 10 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆61Updated last month
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆58Updated 2 weeks ago