Alternatives and similar repositories for GIST

Users that are interested in GIST are comparing it to the libraries listed below

• daochenzha / dreamshard
  [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems
  ☆29Updated 2 years ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated 2 years ago
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated 2 years ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆36Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• IST-DASLab / RoSA
  Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)
  ☆44Updated last year
• OswaldHe / HMT-pytorch
  [NAACL 2025] Official Implementation of "HMT: Hierarchical Memory Transformer for Long Context Language Processing"
  ☆75Updated 4 months ago
• phython96 / ARGNP
  Pytorch Implementation of Automatic Relation-aware Graph Network Proliferation (CVPR 2022 Oral)
  ☆26Updated last year
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆36Updated last year
• stanford-crfm / helm-efficiency
  ☆10Updated last year
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆87Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆28Updated last year
• NolanoOrg / SpectraSuite
  ☆51Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated 2 years ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆100Updated last year
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆60Updated last year
• mingkai-zheng / GENIUS
  Can GPT-4 Perform Neural Architecture Search?
  ☆87Updated 2 years ago
• prateeky2806 / ComPEFT
  ☆26Updated last year
• giangdip2410 / HyperRouter
  Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"
  ☆33Updated last year
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆65Updated 2 years ago
• sail-sg / Precision-RL
  Defeating the Training-Inference Mismatch via FP16
  ☆56Updated this week
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆114Updated last year
• MaxBelitsky / cache-steering
  KV Cache Steering for Inducing Reasoning in Small Language Models
  ☆41Updated 3 months ago
• dropbox / low-rank-llama2
  Low-Rank Llama Custom Training
  ☆23Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated last year
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated 3 months ago
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆37Updated last year