Accelerate pretraining by pre-pretraining on formal languages!
☆20Feb 13, 2026Updated 5 months ago
Alternatives and similar repositories for pre-pretraining
Users that are interested in pre-pretraining are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Jun 2, 2026Updated last month
- A range of tools related to one-endpoint crossing graphs - parsing, format conversion, and evaluation☆11Nov 8, 2022Updated 3 years ago
- ☆26Aug 19, 2025Updated 11 months ago
- ☆22Apr 5, 2026Updated 3 months ago
- Structural Supervision & Human Psycholinguistic Data☆13Apr 16, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code for the ACL 2021 paper "Structural Guidance for Transformer Language Models"☆14Sep 17, 2025Updated 10 months ago
- HELP: a dataset for Handling Entailments with Lexical and logical Phenomena (Ver.1.0)☆15Jul 20, 2023Updated 3 years ago
- ☆12Apr 19, 2022Updated 4 years ago
- Ninety-Nine Haskell Problems. The documentation serves as a standalone list of problems. Includes tests and benchmarks for checking and…☆18Jun 30, 2026Updated 3 weeks ago
- A benchmark with locally sourced multilingual questions for 31 languages.☆18May 13, 2026Updated 2 months ago
- ☆10Mar 5, 2024Updated 2 years ago
- ☆16Oct 16, 2024Updated last year
- A list of resources dedicated to compositionality☆14Feb 21, 2019Updated 7 years ago
- The Earleyx parser was originated from Roger Levy's prefix parser, but has evolved significantly. Earleyx can generate Viterbi parses and…☆14Mar 27, 2014Updated 12 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Learning from Neighbors: Unsupervised Text Classification☆17Sep 27, 2022Updated 3 years ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆24Aug 18, 2024Updated last year
- EVEVALB is a python version of Evalb which is used to score the bracket tree banks.☆16Apr 22, 2019Updated 7 years ago
- Syntactic evaluation sets, attribute-varying grammars, and code for replicating the CLAMS paper. ACL 2020.☆17Nov 26, 2024Updated last year
- PhD/MBA-level human-annotated rubrics dataset across Physics, Chemistry, Finance and Consulting☆32Oct 30, 2025Updated 8 months ago
- Probe how GPT-n performs on statutory reasoning☆10Sep 17, 2024Updated last year
- [ICML 2026] Public repository for fine-tuning Masked Diffusion Models toward provable self-correction.☆26Jul 5, 2026Updated 2 weeks ago
- Bayesian Inverse Graphics for Few-Shot Concept Learning☆12Mar 16, 2025Updated last year
- Fine-tuning GPT-2 to generate research paper abstracts☆12Apr 28, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The Compositionality article class.☆14Mar 16, 2026Updated 4 months ago
- Code for Pushdown Layers from our EMNLP 2023 paper☆28Dec 3, 2023Updated 2 years ago
- OneStop: A 360-Participant Eye Tracking Dataset with Different Reading Regimes☆20Apr 18, 2026Updated 3 months ago
- Tools for all things related to Combinatory Categorial Grammar☆20Jul 12, 2025Updated last year
- This is the repository for MorphScore, a tokenizer evaluation framework for morphological alignment.☆17Jul 10, 2025Updated last year
- Repository for the listwise reranker Rank-K☆16May 23, 2025Updated last year
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated 2 years ago
- PyTorch implementation of Titans.☆37Jan 20, 2025Updated last year
- ☆23Jul 23, 2021Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- mReasoner is a unified computational implementation of the model theory of thinking and reasoning☆16Aug 17, 2023Updated 2 years ago
- ☆16Feb 4, 2026Updated 5 months ago
- Conveniently export torch.compile compiled products into self-contained Python files☆33Jun 5, 2026Updated last month
- Discretized Integrated Gradients for Explaining Language Models (EMNLP 2021)☆27Mar 26, 2022Updated 4 years ago
- Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speech (ACL-IJCNLP 2021 Findings)☆13Jun 22, 2022Updated 4 years ago
- 200,000+ Sentences about Donald Trump with political bias labels☆17Jun 2, 2020Updated 6 years ago
- Repository for paper Decrypting Cryptic Crosswords☆11Jan 15, 2022Updated 4 years ago