google-deepmind / alta

Related projects ⓘ

Alternatives and complementary repositories for alta

• sjelassi / transformers_ssm_copy
  ☆24Updated 8 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 7 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆34Updated last week
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated last month
• katiekang1998 / reasoning_generalization
  ☆16Updated last month
• yikangshen / megablocks
  ☆18Updated 5 months ago
• HazyResearch / prefix-linear-attention
  ☆45Updated 4 months ago
• Asap7772 / understanding-rlhf
  ☆24Updated 7 months ago
• RobertCsordas / moeut
  ☆62Updated 3 months ago
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 2 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆16Updated last week
• radarFudan / mamba-minimal-jax
  ☆29Updated 2 months ago
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆18Updated last year
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆13Updated this week
• Lagooon / LeanSTaR
  ☆25Updated 2 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 4 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated 10 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆56Updated 6 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 11 months ago
• scalable-model-editing / unified-model-editing
  We introduce EMMET and unify model editing with popular algorithms ROME and MEMIT.
  ☆12Updated 2 months ago
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆40Updated 3 months ago
• ethz-spylab / superhuman-ai-consistency
  ☆28Updated last year
• amudide / switch_sae
  Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)
  ☆12Updated last month
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆23Updated 4 months ago
• RodkinIvan / associative-recurrent-memory-transformer
  [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluating
  ☆31Updated this week
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆37Updated 5 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆29Updated last month
• epfml / schedules-and-scaling
  ☆53Updated 3 weeks ago
• assafbk / DeciMamba
  Official Implementation Of The Paper: `DeciMamba: Exploring the Length Extrapolation Potential of Mamba'
  ☆20Updated 3 months ago
• dvruette / barrel-rec-pytorch
  ☆53Updated 10 months ago