Rust library for indexing and quickly searching large pretraining corpora
☆31Oct 30, 2025Updated 8 months ago
Alternatives and similar repositories for rusty-dawg
Users that are interested in rusty-dawg are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A file-backed dictionary for Python☆12Aug 15, 2022Updated 3 years ago
- 3D geoms for plotnine (grammar of graphics in Python)☆13Aug 5, 2022Updated 3 years ago
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆35May 24, 2024Updated 2 years ago
- Structural Supervision & Human Psycholinguistic Data☆13Apr 16, 2021Updated 5 years ago
- Official Implementation of ACL2023: Don't Parse, Choose Spans! Continuous and Discontinuous Constituency Parsing via Autoregressive Span …☆14Aug 25, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICLR 2024] This is the official implementation for the paper: "Beyond imitation: Leveraging fine-grained quality signals for alignment"☆10May 5, 2024Updated 2 years ago
- Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"☆31Jun 18, 2021Updated 5 years ago
- Gantry provides an API that streamlines running experiments in Beaker☆32Updated this week
- Rust implementation of probminhash, superminhash and hyperloglog sketching algorithms☆30Jan 22, 2026Updated 6 months ago
- Corpus of naturalistic stories with annotation and psycholinguistic measures☆62May 14, 2025Updated last year
- Code for running forward and backward versions of GPT2☆10Nov 20, 2021Updated 4 years ago
- Code accompanying the paper "Automating Involutive MCMC using Probabilistic and Differentiable Programming"☆15Jul 21, 2020Updated 6 years ago
- Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Am…☆23Mar 7, 2024Updated 2 years ago
- ☆12Apr 18, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Investigating Cultural Alignment of Large Language Models☆13Aug 14, 2024Updated last year
- ☆10Sep 6, 2024Updated last year
- Codebase describing experiments in Truncation Sampling as Language Model Desmoothing☆13Dec 6, 2022Updated 3 years ago
- This repository contains the code used for the experiments in the paper "Language Models use Lookbacks to Track Beliefs".☆16Mar 14, 2026Updated 4 months ago
- [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring☆12Dec 1, 2023Updated 2 years ago
- A library for Partially Homomorphic Encryption in Python☆12May 30, 2017Updated 9 years ago
- 🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset☆13Sep 13, 2021Updated 4 years ago
- The Earleyx parser was originated from Roger Levy's prefix parser, but has evolved significantly. Earleyx can generate Viterbi parses and…☆14Mar 27, 2014Updated 12 years ago
- Neural ngram language model in PyTorch.☆10Sep 27, 2018Updated 7 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆14Dec 31, 2023Updated 2 years ago
- Code Release for the 2023 NeurIPS Paper How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained langua…☆17Dec 6, 2024Updated last year
- A comprehensive toolkit for streamlining data editing, search, and inspection for large-scale language model training and interpretabilit…☆21Oct 30, 2025Updated 8 months ago
- Simple, extensible implementations of some meta-learning algorithms in Jax☆11Oct 6, 2020Updated 5 years ago
- ☆18Jan 17, 2024Updated 2 years ago
- Second Order Implementation of Hidden Markov Model for Tagging.☆15Mar 17, 2022Updated 4 years ago
- Evaluating Text Representations on Lexical Composition☆24Oct 30, 2019Updated 6 years ago
- A dataset for training interactive plotting agent☆14Dec 8, 2022Updated 3 years ago
- ☆24Apr 8, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Prism themes for plotnine, inspired by ggprism.☆18Aug 13, 2025Updated 11 months ago
- This is a read-only mirror of the CRAN R package repository. randomForestSRC — Fast Unified Random Forests for Survival, Regression, an…☆10Apr 19, 2026Updated 3 months ago
- [NeurIPS 2025] Think-RM: Enabling Long-Horizon Reasoning in Generative Reward Models☆17Nov 2, 2025Updated 8 months ago
- A repository for the EMNLP 2021 paper "Is Information Density Uniform in Task-Oriented Dialogues?" and for the CoNLL 2021 paper "Analysin…☆10Jun 17, 2024Updated 2 years ago
- A string tokenizer library for Rust☆11May 16, 2018Updated 8 years ago
- Silly twitter torch implementations.☆48Oct 14, 2022Updated 3 years ago
- Differentiable and GPU accelerated scattering covariance statistics on the sphere☆16May 27, 2025Updated last year