RandallBalestriero / SplineLLMLinks
☆16Updated 2 years ago
Alternatives and similar repositories for SplineLLM
Users that are interested in SplineLLM are comparing it to the libraries listed below
Sorting:
- Sparse and discrete interpretability tool for neural networks☆64Updated 2 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- Understanding how features learned by neural networks evolve throughout training☆41Updated last year
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆40Updated 2 years ago
- ☆36Updated 3 years ago
- Official code for the paper "Compositional Generalization from First Principles" (NeurIPS 2023)☆13Updated 2 years ago
- The Energy Transformer block, in JAX☆63Updated 2 years ago
- ☆46Updated 2 years ago
- ☆77Updated last year
- Quantification of Uncertainty with Adversarial Models☆29Updated 2 years ago
- The data and the PyTorch implementation for the models and experiments in the paper "Language Model Decoding as Likelihood–Utility Alignm…☆14Updated 2 years ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆16Updated 4 years ago
- Google Research☆46Updated 3 years ago
- A centralized place for deep thinking code and experiments☆90Updated 2 years ago
- Minimum Description Length probing for neural network representations☆20Updated last year
- 📰 Computing the information content of trained neural networks☆22Updated 4 years ago
- Repo for: When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment☆38Updated 2 years ago
- ☆112Updated last year
- Updated code base for GlanceNets: Interpretable, Leak-proof Concept-based models☆25Updated 2 years ago
- RWKV model implementation☆37Updated 2 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Updated 2 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆39Updated 3 years ago
- Official code for the paper: "Metadata Archaeology"☆19Updated 2 years ago
- Repo for solving arc problems with an Neural Cellular Automata☆23Updated 8 months ago
- ☆57Updated 2 years ago
- ☆28Updated 2 years ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Updated last year
- Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …☆116Updated last year
- Repository for the PopulAtion Parameter Averaging (PAPA) paper☆30Updated last year