Alternatives and similar repositories for GIST:

Users that are interested in GIST are comparing it to the libraries listed below

• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆30Updated 9 months ago
• mobiusml / low-rank-llama2
  Low-Rank Llama Custom Training
  ☆22Updated last year
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆42Updated 6 months ago
• RandallBalestriero / SplineLLM
  ☆15Updated last year
• daochenzha / dreamshard
  [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems
  ☆29Updated 2 years ago
• rlin27 / DeBut
  Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.
  ☆12Updated 3 years ago
• Hannibal046 / RWKV-howto
  possibly useful materials for learning RWKV language model.
  ☆25Updated last year
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆18Updated last year
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago
• YiteWang / NTK-SAP
  [ICLR2023] NTK-SAP: Improving neural network pruning by aligning training dynamics
  ☆18Updated last year
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆20Updated 3 years ago
• facebookresearch / coocmap
  code for paper "Accessing higher dimensions for unsupervised word translation"
  ☆21Updated last year
• alexzhang13 / Triton-Puzzles-Solutions
  Personal solutions to the Triton Puzzles
  ☆18Updated 8 months ago
• daochenzha / neuroshard
  [MLSys 2023] Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models
  ☆16Updated last year
• camlsys / degree-quant
  ICLR 2021
  ☆47Updated 4 years ago
• jxbz / entropix
  📰 Computing the information content of trained neural networks
  ☆21Updated 3 years ago
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆79Updated 9 months ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆44Updated last year
• OswaldHe / HMT-pytorch
  [NAACL 2025] Official Implementation of "HMT: Hierarchical Memory Transformer for Long Context Language Processing"
  ☆67Updated last month
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 6 months ago
• wangskyGit / passage-sieve
  official repo of AAAI2024 paper Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence Regularization
  ☆13Updated last year
• minjiyoon / MMGL
  Multimodal Graph Learning: how to encode multiple multimodal neighbors with their relations into LLMs
  ☆58Updated 8 months ago
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆21Updated 3 weeks ago
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated 2 weeks ago
• szc12153 / sparse_meta_tuning
  Official implementation for Sparse MetA-Tuning (SMAT)
  ☆16Updated 9 months ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• model-similarity / lm-similarity
  ☆14Updated last month
• dkopi / Bitune
  Implementation of Bitune: Bidirectional Instruction-Tuning
  ☆19Updated 9 months ago
• catid / spectral_ssm
  Implementation of Spectral State Space Models
  ☆16Updated last year