Code for our ACL '23 paper titled "Grokking of Hierarchical Structure in Vanilla Transformers"
☆26Oct 8, 2023Updated 2 years ago
Alternatives and similar repositories for structural-grokking
Users that are interested in structural-grokking are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for "Does syntax need to grow on trees? Sources of inductive bias in sequence to sequence networks"☆24Jan 14, 2020Updated 6 years ago
- Repository for the code and dataset for the paper: "Have LLMs Advanced enough? Towards Harder Problem Solving Benchmarks For Large Langu…☆39Dec 18, 2023Updated 2 years ago
- ☆22Apr 5, 2026Updated last month
- ☆11Apr 4, 2017Updated 9 years ago
- ☆11Jun 28, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Word acquisition in neural language models (TACL 2022).☆21Jan 30, 2025Updated last year
- [ACM MM 2025] Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception☆12Apr 18, 2026Updated last month
- Tasks for describing differences between text distributions.☆17Aug 9, 2024Updated last year
- Code for our EMNLP '22 paper "Fixing Model Bugs with Natural Language Patches"☆19Dec 7, 2022Updated 3 years ago
- Package for defining computation graphs and performing intervention experiments☆15Oct 1, 2021Updated 4 years ago
- Code for EMNLP 2022 Paper: On the Calibration of Massively Multilingual Language Models☆15Jun 12, 2023Updated 2 years ago
- The KiloGram Tangrams dataset☆58Apr 25, 2025Updated last year
- The Implementation for the Paper "Time-Stamped Language Model: Teaching Language Models toUnderstand The Flow of Events"☆11May 6, 2021Updated 5 years ago
- Simple and extensible hypergradient for PyTorch☆18Feb 23, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Oct 18, 2023Updated 2 years ago
- ☆11Oct 3, 2022Updated 3 years ago
- ☆18Jan 3, 2025Updated last year
- JEEBench, EMNLP 2023☆48Dec 18, 2023Updated 2 years ago
- ☆17Oct 22, 2024Updated last year
- FaiRR: Faithful and Robust Deductive Reasoning over Natural Language (ACL 2022)☆13May 19, 2022Updated 4 years ago
- Discovering Universal Geometry in Embeddings with ICA (Published in EMNLP 2023)☆20Jun 17, 2025Updated 11 months ago
- [TMLR 2026] GIOROM, sampling based model-order reduction for Lagrangian systems☆20Mar 12, 2026Updated 2 months ago
- A dataset of 80 millon constraint preserving transformations of CAD sketches☆16Nov 22, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆23Nov 8, 2023Updated 2 years ago
- [EMNLP 2020] PyTorch code of PRover: Proof Generation for Interpretable Reasoning over Rules☆20Jul 6, 2023Updated 2 years ago
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆28Oct 3, 2021Updated 4 years ago
- ☆35Jan 29, 2023Updated 3 years ago
- This is the official code repository for the paper "Language Agents Meet Causality -- Bridging LLMs and Causal World Models"☆29May 6, 2025Updated last year
- Multimodal extreme classification☆21May 1, 2024Updated 2 years ago
- ☆10Updated this week
- AI Assistant for Building Reliable, High-performing and Fair Multilingual NLP Systems☆48Aug 19, 2022Updated 3 years ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆238Jul 19, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official implementation of MARIO: Model Agnostic Recipe for Improving OOD Generalization of Graph Contrastive Learning☆19Jan 27, 2024Updated 2 years ago
- ☆49May 14, 2026Updated last week
- Code for "Multi-scale Abstract Reasoning" paper☆12Oct 17, 2022Updated 3 years ago
- The original Backpack Language Model implementation, a fork of FlashAttention☆71May 29, 2023Updated 2 years ago
- Menagerie of video models trained on various video datasets☆10Oct 13, 2024Updated last year
- (NeurIPS 2024) What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights☆27Oct 28, 2024Updated last year
- Code for paper "Extract, Denoise and Enforce: Evaluating and Improving Concept Preservation for Text-to-Text Generation" EMNLP 2021 and "…☆18Feb 15, 2022Updated 4 years ago