Code for our ACL '23 paper titled "Grokking of Hierarchical Structure in Vanilla Transformers"
☆26Oct 8, 2023Updated 3 years ago
Alternatives and similar repositories for structural-grokking
Users that are interested in structural-grokking are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tool to measure tree-structuredness of the internal algorithm learnt by a transformer☆12May 24, 2023Updated 3 years ago
- Code for "Does syntax need to grow on trees? Sources of inductive bias in sequence to sequence networks"☆23Jan 14, 2020Updated 6 years ago
- Code for Pushdown Layers from our EMNLP 2023 paper☆29Dec 3, 2023Updated 2 years ago
- Repository for the code and dataset for the paper: "Have LLMs Advanced enough? Towards Harder Problem Solving Benchmarks For Large Langu…☆38Dec 18, 2023Updated 2 years ago
- ☆23Apr 5, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [NeurIPS 2019] Code for Hierarchical Third-Person Imitation Learning☆60Jan 20, 2020Updated 6 years ago
- TyDiP Multilingual Politeness dataset and code☆12Oct 15, 2023Updated 3 years ago
- [NeurIPS-2023] The PyTorch Implementation of MoSo. The algorithms are based on our paper: "Data Pruning via Moving-one-Sample-out". MoSo …☆11May 21, 2026Updated 4 months ago
- A Hierarchical Type system for fine grained entity typing☆50May 15, 2019Updated 7 years ago
- Word acquisition in neural language models (TACL 2022).☆21Jan 30, 2025Updated last year
- Tasks for describing differences between text distributions.☆17Aug 9, 2024Updated 2 years ago
- [ACM MM 2025] Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception☆14Aug 5, 2026Updated 2 months ago
- The KiloGram Tangrams dataset☆61Apr 25, 2025Updated last year
- MAGIC: Microlensing Analysis Guided by Intelligent Computation. A PyTorch framework for automatic analysis of realistic microlensing ligh…☆13May 30, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆57Nov 30, 2024Updated last year
- The Implementation for the Paper "Time-Stamped Language Model: Teaching Language Models toUnderstand The Flow of Events"☆11May 6, 2021Updated 5 years ago
- Code for our ACL '20 paper "Representation Engineering with Natural Language Explanations"☆30Jun 15, 2020Updated 6 years ago
- ☆18Jan 3, 2025Updated last year
- ☆17Oct 22, 2024Updated last year
- FaiRR: Faithful and Robust Deductive Reasoning over Natural Language (ACL 2022)☆14May 19, 2022Updated 4 years ago
- A dataset of 80 millon constraint preserving transformations of CAD sketches☆18Nov 22, 2024Updated last year
- Generate ics file given a set of courses and slots☆12Sep 16, 2024Updated 2 years ago
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆27Oct 3, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [EMNLP 2020] PyTorch code of PRover: Proof Generation for Interpretable Reasoning over Rules☆20Jul 6, 2023Updated 3 years ago
- Multimodal extreme classification☆21May 1, 2024Updated 2 years ago
- ☆18Jan 17, 2024Updated 2 years ago
- [NeurIPS 2026] EfficientRollout: System-Aware Self-Speculative Decoding for RL Rollouts☆17Sep 30, 2026Updated 2 weeks ago
- Learning Algebraic Representation for Systematic Generalization in Abstract Reasoning☆11Jul 20, 2022Updated 4 years ago
- ☆35Jan 29, 2023Updated 3 years ago
- Official Implementation of UA^{2}-Agent and other baseline algorithms of "Towards Unified Alignment Between Agents, Humans, and Environme…☆20Nov 12, 2024Updated last year
- Official Implementation of ACL2023: Don't Parse, Choose Spans! Continuous and Discontinuous Constituency Parsing via Autoregressive Span …☆14Aug 25, 2023Updated 3 years ago
- Official implementation of MARIO: Model Agnostic Recipe for Improving OOD Generalization of Graph Contrastive Learning☆19Jan 27, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Tensorflow implementation of the `intelligent synapse' model from [Zenke et al., (2017)] and application to the Permuted MNIST benchmark.☆21Aug 2, 2017Updated 9 years ago
- Rust寄稿記事の詳細コードを収録している☆10Oct 12, 2022Updated 4 years ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆242Jul 19, 2025Updated last year
- TensorFlow implementation of Match-LSTM and Answer pointer for the popular SQuAD dataset.☆136Feb 15, 2018Updated 8 years ago
- A runtime-independent crate for transforming Wasm-DWARF☆12Mar 11, 2020Updated 6 years ago
- Menagerie of video models trained on various video datasets☆10Oct 13, 2024Updated 2 years ago
- ☆17Nov 1, 2023Updated 2 years ago