google-deepmind / alta

Related projects ⓘ

Alternatives and complementary repositories for alta

• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆16Updated 2 weeks ago
• Asap7772 / understanding-rlhf
  ☆24Updated 6 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆18Updated 3 weeks ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 6 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated last month
• epfml / schedules-and-scaling
  ☆50Updated 2 weeks ago
• ethz-spylab / superhuman-ai-consistency
  ☆28Updated last year
• sjelassi / transformers_ssm_copy
  ☆24Updated 8 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆13Updated 3 weeks ago
• RobertCsordas / moeut
  ☆61Updated 2 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆37Updated 5 months ago
• RickySkywalker / TheoremLlama
  This is the official repository for all the code of TheoremLlama
  ☆30Updated last month
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆33Updated this week
• ScalingIntelligence / large_language_monkeys
  ☆50Updated last month
• scalable-model-editing / unified-model-editing
  We introduce EMMET and unify model editing with popular algorithms ROME and MEMIT.
  ☆12Updated 2 months ago
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated last year
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆23Updated 4 months ago
• yikangshen / megablocks
  ☆18Updated 5 months ago
• belindal / LaMPP
  Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action
  ☆35Updated last year
• assafbk / DeciMamba
  Official Implementation Of The Paper: `DeciMamba: Exploring the Length Extrapolation Potential of Mamba'
  ☆20Updated 3 months ago
• radarFudan / mamba-minimal-jax
  ☆29Updated 2 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆29Updated 3 weeks ago
• RodkinIvan / associative-recurrent-memory-transformer
  [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluating
  ☆31Updated this week
• uscnlp-lime / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated 8 months ago
• vvvm23 / mezo-jax
  JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"
  ☆20Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• HazyResearch / prefix-linear-attention
  ☆44Updated 4 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆44Updated 9 months ago
• Lagooon / LeanSTaR
  ☆25Updated last month
• JacobPfau / fillerTokens
  ☆49Updated 6 months ago