Accelerate pretraining by pre-pretraining on formal languages!
☆22Feb 13, 2026Updated 8 months ago
Alternatives and similar repositories for pre-pretraining
Users that are interested in pre-pretraining are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Earleyx parser was originated from Roger Levy's prefix parser, but has evolved significantly. Earleyx can generate Viterbi parses and…☆16Mar 27, 2014Updated 12 years ago
- Sample-Efficient Online Learning in LM Agents via Hindsight Trajectory Rewriting☆14Jan 2, 2026Updated 9 months ago
- Online Hyperparameter Optimization☆11Feb 17, 2021Updated 5 years ago
- ☆25Jun 2, 2026Updated 4 months ago
- Librarian Agents trains a builder agent to organize a document corpus into a reusable hierarchical filesystem-based workspace before futu…☆28Oct 16, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Lean 4 library for formal linguistics.☆30Updated this week
- Code to compute a word's probability using the fixes from "How to Compute the Probability of a Word"☆12Oct 14, 2024Updated 2 years ago
- ☆14Feb 1, 2024Updated 2 years ago
- A python library for easily querying morphological inflection models trained on Unimorph☆13Oct 23, 2022Updated 4 years ago
- Code for the ACL 2021 paper "Structural Guidance for Transformer Language Models"☆15Sep 17, 2025Updated last year
- ☆12Apr 19, 2022Updated 4 years ago
- Ninety-Nine Haskell Problems. The documentation serves as a standalone list of problems. Includes tests and benchmarks for checking and…☆18Sep 21, 2026Updated last month
- This is a repository for the paper on testing inductive bias with scaled-down RoBERTa models.☆21Jan 10, 2022Updated 4 years ago
- A list of resources dedicated to compositionality☆14Feb 21, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Jul 17, 2025Updated last year
- Design and analyze optimal deep learning models.☆32Aug 2, 2025Updated last year
- ☆16Oct 6, 2026Updated 3 weeks ago
- PhD thesis template with title page according to the University of Amsterdam.☆17Sep 12, 2021Updated 5 years ago
- ☆16Oct 16, 2024Updated 2 years ago
- Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic State☆17Mar 4, 2019Updated 7 years ago
- Automatically exported from code.google.com/p/incremental-top-down-parser☆15Mar 15, 2015Updated 11 years ago
- ☆22Nov 19, 2023Updated 2 years ago
- Probe how GPT-n performs on statutory reasoning☆10Sep 17, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Bayesian Inverse Graphics for Few-Shot Concept Learning☆12Mar 16, 2025Updated last year
- Learning from Neighbors: Unsupervised Text Classification☆17Sep 27, 2022Updated 4 years ago
- ☆10Mar 5, 2024Updated 2 years ago
- PhD/MBA-level human-annotated rubrics dataset across Physics, Chemistry, Finance and Consulting☆34Oct 30, 2025Updated 11 months ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆24Aug 18, 2024Updated 2 years ago
- Easy training for Sparse Linear Autoencoders (https://arxiv.org/abs/2309.08600) with data from TransformerLens models.☆12Nov 1, 2023Updated 2 years ago
- [ICML 2026] Public repository for fine-tuning Masked Diffusion Models toward provable self-correction.☆27Jul 5, 2026Updated 3 months ago
- Create string diagrams with LaTeX!☆14Jan 3, 2025Updated last year
- Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Am…☆23Mar 7, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Reproducing all figures in upcoming draft☆13Oct 14, 2024Updated 2 years ago
- Demo of using ChatGPT API for language learning☆12Mar 6, 2023Updated 3 years ago
- OneStop: A 360-Participant Eye Tracking Dataset with Different Reading Regimes☆20Oct 20, 2026Updated last week
- An educational implementation of some aspects of the DisCoCat framework☆11Mar 17, 2023Updated 3 years ago
- ☆17Jan 31, 2025Updated last year
- ☆12Jul 17, 2025Updated last year
- Fine-tuning GPT-2 to generate research paper abstracts☆12Apr 28, 2021Updated 5 years ago