The evaluation pipeline for the 2024 BabyLM Challenge.
☆34Nov 13, 2024Updated last year
Alternatives and similar repositories for evaluation-pipeline-2024
Users that are interested in evaluation-pipeline-2024 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆27Aug 19, 2025Updated last year
- Evaluation pipeline for the BabyLM Challenge 2023.☆77Oct 18, 2023Updated 3 years ago
- ☆13Nov 5, 2024Updated 2 years ago
- ☆24Apr 14, 2025Updated last year
- Repository for the paper "Discovering and Categorising Language Biases in Reddit" accepted at the International Conference on Web and Soc…☆12Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official implementation of "GPT or BERT: why not both?"☆64Jul 28, 2025Updated last year
- The Benchmark of Linguistic Minimal Pairs☆177Dec 13, 2022Updated 3 years ago
- NAACL'2021: Non-Parametric Few-Shot Learning for Word Sense Disambiguation☆10Jul 1, 2021Updated 5 years ago
- Menagerie of models trained on SAYCam (and more)☆26Mar 23, 2024Updated 2 years ago
- ☆23Apr 5, 2026Updated 7 months ago
- ☆12Feb 25, 2024Updated 2 years ago
- Fast brown clustering using python☆10Aug 21, 2023Updated 3 years ago
- ☆14Feb 1, 2024Updated 2 years ago
- This repository contains the code for the paper: Cooperative Bi-path Metric for Few-shot Learning, Zeyuan Wang, Yifan Zhao, Jia Li, Yongh…☆12Oct 16, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Feb 24, 2022Updated 4 years ago
- Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"☆31Jun 18, 2021Updated 5 years ago
- DEPRECATED: Command-line tool and Python API for targeted syntactic evaluation of language models☆12Feb 13, 2024Updated 2 years ago
- When is multilinguality a curse? Language modeling for 250 high- and low-resource languages (EMNLP 2024).☆11Jan 30, 2025Updated last year
- ☆10Oct 22, 2026Updated 2 weeks ago
- HELP: a dataset for Handling Entailments with Lexical and logical Phenomena (Ver.1.0)☆15Jul 20, 2023Updated 3 years ago
- Code and data for the paper ”Counting the Bugs in ChatGPT's Wugs: A Multilingual Investigation into the Morphological Capabilities of a L…☆10Dec 3, 2023Updated 2 years ago
- A Baseline for Multilingual Sentiment Analysis☆36Oct 17, 2024Updated 2 years ago
- MultiThreaded Web Server in C++☆11May 20, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A list of resources dedicated to compositionality☆14Feb 21, 2019Updated 7 years ago
- ☆19Jul 25, 2023Updated 3 years ago
- Tracks user and draws a path from current location to destination location.☆14Jan 25, 2023Updated 3 years ago
- Python source code for EMNLP 2021 Findings paper: "Subword Mapping and Anchoring Across Languages".☆13Sep 17, 2021Updated 5 years ago
- Syntactic evaluation sets, attribute-varying grammars, and code for replicating the CLAMS paper. ACL 2020.☆18Nov 26, 2024Updated last year
- Repository for Dahl et al., 2024, "Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models"☆14Jun 26, 2024Updated 2 years ago
- The official repo for SocKET: Social Knowledge Evaluation Tests☆24May 12, 2025Updated last year
- Brown clustering in Python☆22Dec 12, 2017Updated 8 years ago
- ☆17Apr 17, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code for the paper "Large Language Models Share Representations of Latent Grammatical Concepts Across Typologically Diverse Languages" (N…☆17Apr 13, 2025Updated last year
- Utility for behavioral and representational analyses of Language Models☆201Oct 6, 2026Updated last month
- Code for ProtAugment: Unsupervised diverse short-texts paraphrasing for intent detection meta-learning☆25Aug 22, 2022Updated 4 years ago
- Religious Hate Speech Detection for Arabic Tweets☆26Feb 1, 2019Updated 7 years ago
- Code and data for "A fine-grained comparison of pragmatic language understanding in humans and language models"☆13Dec 14, 2022Updated 3 years ago
- A really basic HTTP server in the style of Flask/Sinatra, written in Java (that you probably shouldn't use)☆17Aug 23, 2015Updated 11 years ago
- A parallel evaluation data set of SAP software documentation with document structure annotation☆15Jun 12, 2026Updated 4 months ago