Accelerate pretraining by pre-pretraining on formal languages!
☆22Feb 13, 2026Updated 5 months ago
Alternatives and similar repositories for pre-pretraining
Users that are interested in pre-pretraining are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for our paper "AMR-DA: Data augmentation by abstract meaning representation" in ACL 2022☆13May 17, 2022Updated 4 years ago
- ☆26Aug 19, 2025Updated 11 months ago
- ☆14Feb 1, 2024Updated 2 years ago
- ☆23Apr 5, 2026Updated 4 months ago
- Forecasting scientific progress with AI☆30May 31, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Structural Supervision & Human Psycholinguistic Data☆13Apr 16, 2021Updated 5 years ago
- This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…☆19Sep 15, 2021Updated 4 years ago
- ☆10Jun 19, 2019Updated 7 years ago
- Code for the ACL 2021 paper "Structural Guidance for Transformer Language Models"☆15Sep 17, 2025Updated 10 months ago
- HELP: a dataset for Handling Entailments with Lexical and logical Phenomena (Ver.1.0)☆15Jul 20, 2023Updated 3 years ago
- Ninety-Nine Haskell Problems. The documentation serves as a standalone list of problems. Includes tests and benchmarks for checking and…☆18Updated this week
- Implementing arithmetic operations as a service because why not.☆12Mar 9, 2021Updated 5 years ago
- A benchmark with locally sourced multilingual questions for 31 languages.☆18May 13, 2026Updated 2 months ago
- Design and analyze optimal deep learning models.☆31Aug 2, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code and Results for "Universals of word order reflect optimization of grammars for efficient communication"☆14Aug 5, 2022Updated 4 years ago
- ☆16Oct 16, 2024Updated last year
- The Earleyx parser was originated from Roger Levy's prefix parser, but has evolved significantly. Earleyx can generate Viterbi parses and…☆14Mar 27, 2014Updated 12 years ago
- Learning from Neighbors: Unsupervised Text Classification☆17Sep 27, 2022Updated 3 years ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆24Aug 18, 2024Updated last year
- EVEVALB is a python version of Evalb which is used to score the bracket tree banks.☆16Apr 22, 2019Updated 7 years ago
- Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic State☆17Mar 4, 2019Updated 7 years ago
- ☆16Jul 20, 2026Updated 2 weeks ago
- Gradient accumulation on tf.estimator☆12Dec 15, 2020Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Syntactic evaluation sets, attribute-varying grammars, and code for replicating the CLAMS paper. ACL 2020.☆17Nov 26, 2024Updated last year
- PhD/MBA-level human-annotated rubrics dataset across Physics, Chemistry, Finance and Consulting☆33Oct 30, 2025Updated 9 months ago
- Bayesian Inverse Graphics for Few-Shot Concept Learning☆12Mar 16, 2025Updated last year
- Fine-tuning GPT-2 to generate research paper abstracts☆12Apr 28, 2021Updated 5 years ago
- A LaTeX document class for notes 📝 and textbooks 📚☆14Jul 14, 2021Updated 5 years ago
- PESU Academy WhatsApp Bot for the PESsants and PESts of PES University☆10Apr 10, 2022Updated 4 years ago
- The Compositionality article class.☆14Mar 16, 2026Updated 4 months ago
- Code for Pushdown Layers from our EMNLP 2023 paper☆29Dec 3, 2023Updated 2 years ago
- OneStop: A 360-Participant Eye Tracking Dataset with Different Reading Regimes☆20Apr 18, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Slovak support for Elastic Search (with Dockerfile)☆19Jun 18, 2020Updated 6 years ago
- Tools for all things related to Combinatory Categorial Grammar☆20Jul 12, 2025Updated last year
- This is the repository for MorphScore, a tokenizer evaluation framework for morphological alignment.☆18Jul 10, 2025Updated last year
- Create string diagrams with LaTeX!☆14Jan 3, 2025Updated last year
- This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".☆25Mar 25, 2025Updated last year
- Natural Language Toolkit built using the C Programming Language☆12Oct 5, 2020Updated 5 years ago
- CalBERT - Code-mixed Adaptive Language representations using BERT, published at AAAI-MAKE 2022☆13Dec 18, 2023Updated 2 years ago