Rust library for indexing and quickly searching large pretraining corpora
☆31Oct 30, 2025Updated 11 months ago
Alternatives and similar repositories for rusty-dawg
Users that are interested in rusty-dawg are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A file-backed dictionary for Python☆12Aug 15, 2022Updated 4 years ago
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆35May 24, 2024Updated 2 years ago
- [ACL'21] Data for "An In-depth Study on Internal Structure of Chinese Words".☆14May 27, 2021Updated 5 years ago
- Official Implementation of ACL2023: Don't Parse, Choose Spans! Continuous and Discontinuous Constituency Parsing via Autoregressive Span …☆14Aug 25, 2023Updated 3 years ago
- [ICLR 2024] This is the official implementation for the paper: "Beyond imitation: Leveraging fine-grained quality signals for alignment"☆11May 5, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"☆31Jun 18, 2021Updated 5 years ago
- Rust library for working with data from Wikidata.☆16Sep 6, 2026Updated last month
- Code for "Discovering Non-monotonic Autoregressive Orderings with Variational Inference" (paper and code updated from ICLR 2021)☆12Mar 7, 2024Updated 2 years ago
- Corpus of naturalistic stories with annotation and psycholinguistic measures☆63May 14, 2025Updated last year
- Code for running forward and backward versions of GPT2☆10Nov 20, 2021Updated 4 years ago
- Code accompanying the paper "Automating Involutive MCMC using Probabilistic and Differentiable Programming"☆15Jul 21, 2020Updated 6 years ago
- Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Am…☆23Mar 7, 2024Updated 2 years ago
- ☆12Apr 18, 2025Updated last year
- ☆10Sep 6, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Extracting minimal DFA's from well-trained RNN's☆11Nov 26, 2018Updated 7 years ago
- ☆23Jun 23, 2022Updated 4 years ago
- A file utility for accessing both local and remote files through a unified interface.☆47Apr 27, 2026Updated 5 months ago
- Easy trees in LaTeX and TikZ☆15Dec 16, 2022Updated 3 years ago
- This repository contains the code used for the experiments in the paper "Language Models use Lookbacks to Track Beliefs".☆17Mar 14, 2026Updated 7 months ago
- [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring☆13Dec 1, 2023Updated 2 years ago
- A library for Partially Homomorphic Encryption in Python☆12May 30, 2017Updated 9 years ago
- mReasoner is a unified computational implementation of the model theory of thinking and reasoning☆17Aug 17, 2023Updated 3 years ago
- This is the Orc Simulator, a simple demo game using GPT-3 and the Data / Narrative model.☆12Dec 27, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Data and code for the SciFact-Open task☆29Nov 24, 2023Updated 2 years ago
- 🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset☆13Sep 13, 2021Updated 5 years ago
- A smorgasbord architecture for coreference resolution in biomedical text☆10Apr 16, 2020Updated 6 years ago
- The Earleyx parser was originated from Roger Levy's prefix parser, but has evolved significantly. Earleyx can generate Viterbi parses and…☆16Mar 27, 2014Updated 12 years ago
- Neural ngram language model in PyTorch.☆10Sep 27, 2018Updated 8 years ago
- ☆14Dec 31, 2023Updated 2 years ago
- Evaluating Reward Models in Multilingual Settings (ACL Main '25)☆45May 16, 2025Updated last year
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Mar 6, 2023Updated 3 years ago
- A comprehensive toolkit for streamlining data editing, search, and inspection for large-scale language model training and interpretabilit…☆21Oct 30, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Fast dataset format and loader☆24Updated this week
- ☆18Jan 17, 2024Updated 2 years ago
- Visual Hash for matching copies of visually similar images.☆16Mar 17, 2025Updated last year
- CAMeL Dataset☆15Apr 15, 2025Updated last year
- Second Order Implementation of Hidden Markov Model for Tagging.☆15Mar 17, 2022Updated 4 years ago
- Evaluating Text Representations on Lexical Composition☆24Oct 30, 2019Updated 6 years ago
- A dataset for training interactive plotting agent☆14Dec 8, 2022Updated 3 years ago