facebookresearch / Mephisto
A suite of tools for managing crowdsourcing tasks from the inception through to data packaging for research use.
☆303Updated this week
Related projects: ⓘ
- Task-based datasets, preprocessing, and evaluation for sequence models.☆552Updated this week
- Robustness Gym is an evaluation toolkit for machine learning.☆439Updated 2 years ago
- An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)☆440Updated 3 months ago
- Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging F…☆555Updated 10 months ago
- Adversarial Natural Language Inference Benchmark☆388Updated 2 years ago
- Seminar on Large Language Models (COMP790-101 at UNC Chapel Hill, Fall 2022)☆309Updated last year
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆200Updated 3 years ago
- Repository containing code for "How to Train BERT with an Academic Budget" paper☆309Updated last year
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆168Updated 2 years ago
- Find and fix bugs in natural language machine learning models using adaptive testing.☆181Updated 4 months ago
- NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations☆770Updated 4 months ago
- Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)☆456Updated last year
- AI Data Management & Evaluation Platform☆214Updated 11 months ago
- Library for Knowledge Intensive Language Tasks☆905Updated 2 years ago
- The AI Knowledge Editor☆181Updated 2 years ago
- SummVis is an interactive visualization tool for text summarization.☆252Updated 2 years ago
- ☆225Updated 4 years ago
- Database Reasoning Over Text project for ACL paper☆353Updated 2 years ago
- Used for adaptive human in the loop evaluation of language and embedding models.☆300Updated last year
- Organize your experiments into discrete steps that can be cached and reused throughout the lifetime of your research project.☆525Updated 3 months ago
- A platform for managing machine learning experiments☆814Updated last month
- ☆480Updated 7 months ago
- Interpretable Evaluation for AI Systems☆360Updated last year
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆190Updated 3 months ago
- UnifiedQA: Crossing Format Boundaries With a Single QA System☆426Updated 2 years ago
- A tool to help researchers and product teams understand datasets with the goal of improving data quality, and mitigating fairness and bia…☆281Updated last year
- With the aim of building next generation virtual assistants that can handle multimodal inputs and perform multimodal actions, we introduc…☆130Updated 11 months ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆363Updated 2 years ago
- We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically …☆162Updated 2 years ago
- A library to synthesize text datasets using Large Language Models (LLM)☆151Updated last year