Alternatives and similar repositories for GIST:

Users that are interested in GIST are comparing it to the libraries listed below

• daochenzha / dreamshard
  [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems
  ☆29Updated last year
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated last year
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated 3 months ago
• tding1 / Efficient-LLM-Survey
  The Efficiency Spectrum of LLM
  ☆52Updated last year
• stanford-crfm / helm-efficiency
  ☆9Updated last year
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆18Updated last year
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago
• jxbz / entropix
  📰 Computing the information content of trained neural networks
  ☆21Updated 3 years ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆28Updated 7 months ago
• facebookresearch / gismo
  companion code for "Learning to substitute Ingredients in Recipes"
  ☆26Updated last year
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated last week
• Hannibal046 / RWKV-howto
  possibly useful materials for learning RWKV language model.
  ☆24Updated last year
• wangskyGit / passage-sieve
  official repo of AAAI2024 paper Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence Regularization
  ☆13Updated last year
• bailuding / rails
  Retrieval with Learned Similarities (RAILS, http://arxiv.org/abs/2407.15462)
  ☆20Updated last month
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• RandallBalestriero / SplineLLM
  ☆14Updated last year
• IST-DASLab / RoSA
  ☆38Updated 11 months ago
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated last year
• duykhuongnguyen / LASeR-MAB
  Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"
  ☆13Updated 3 months ago
• nverma1 / merging-text-transformers
  Code for "Merging Text Transformers from Different Initializations"
  ☆19Updated 5 months ago
• zzwjames / FailureLLMUnlearning
  ☆23Updated last month
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks"
  ☆17Updated last week
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆23Updated 6 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆58Updated 8 months ago
• fishmingyu / GeoT
  GeoT: Tensor Centric Library for Graph Neural Network via Efficient Segment Reduction on GPU
  ☆18Updated 2 months ago
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆31Updated 11 months ago
• tech-srl / layer_norm_expressivity_role
  Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)
  ☆45Updated 3 months ago
• Itamarzimm / UnifiedImplicitAttnRepr
  ☆36Updated 7 months ago