Benchmarking algorithms for assessing quality of data labeled by multiple annotators
☆34Dec 3, 2025Updated 6 months ago
Alternatives and similar repositories for multiannotator-benchmarks
Users that are interested in multiannotator-benchmarks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Oct 27, 2025Updated 7 months ago
- Notebooks demonstrating example applications of the cleanlab library☆134Jan 20, 2026Updated 4 months ago
- Active Learning Helps Pretrained Models Learn the Intended Task (https://arxiv.org/abs/2204.08491) by Alex Tamkin, Dat Nguyen, Salil Desh…☆11Nov 22, 2022Updated 3 years ago
- English Template for PKU Doctoral Dissertation☆14May 28, 2022Updated 4 years ago
- Code for EMNLP 2023 paper: DALE: Generative Data Augmentation for Low-Resource Legal NLP☆10Oct 27, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Not financial advice.☆28Mar 18, 2023Updated 3 years ago
- Data Annotation Tool for Named Entity Recognition using Active Learning and Transfer Learning☆11Aug 20, 2021Updated 4 years ago
- ☆10Sep 13, 2022Updated 3 years ago
- Deep learning for named entity recognition on CoNLL-2003☆10Dec 23, 2016Updated 9 years ago
- Enable RNNLM lattice rescoring with Pytorch [kaldi]☆12Jun 5, 2020Updated 6 years ago
- Using DSPy for NER tasks using LLMs☆17Apr 1, 2024Updated 2 years ago
- [ICML 2025] Official PyTorch implementation of "NegMerge: Sign-Consensual Weight Merging for Machine Unlearning"☆16Nov 25, 2025Updated 6 months ago
- Notebooks using the Neural Magic libraries 📓☆39Jul 24, 2024Updated last year
- Collaborative NLP annotation tool supporting enterprise authentication, inter-annotator statistics, active learning☆13Mar 5, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for our paper 'Learning from Multiple Annotator Noisy Labels via Sample-wise Label Fusion' published on ECCV 2022☆11Jul 27, 2022Updated 3 years ago
- Count based exploration with the successor representation for Unity ML's Pyramid☆12Jun 19, 2019Updated 6 years ago
- Federated Conformal Prediction with Quantile-of-Quantiles (FedCP-QQ)☆11May 6, 2026Updated last month
- Contrastive Continual Learning with Importance Sampling and Prototype-Instance Relation Distillation☆12Jul 22, 2024Updated last year
- Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification☆10May 31, 2022Updated 4 years ago
- [NeurIPS 2024 Spotlight] CLIPLoss and Norm-Based Data Selection Methods for Multimodal Contrastive Learning.☆14Dec 12, 2024Updated last year
- Robust PCA☆21Oct 26, 2018Updated 7 years ago
- Setting up an MLflow Workspace with Docker☆38Aug 23, 2024Updated last year
- 📚 Materials for Advanced Legal Analytics (LAW3027) @ Maastricht University.☆14May 8, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆12Nov 29, 2019Updated 6 years ago
- This library builds a graph-representation of the content of PDFs. The graph is then clustered, resulting page segments are classified an…☆23Sep 11, 2020Updated 5 years ago
- ☆10Jan 31, 2022Updated 4 years ago
- ☆14Jun 6, 2023Updated 3 years ago
- Code for "Thinking Forward: Memory-Efficient Federated Finetuning of Language Models" (NeurIPS 2024). Spry is a federated learning al…☆12Oct 8, 2024Updated last year
- A hands-on tutorial on how to use Active Learning with Transformer models.☆15Oct 3, 2021Updated 4 years ago
- Conformal Prediction + Federated Learning☆16Mar 16, 2024Updated 2 years ago
- ☆10Aug 26, 2022Updated 3 years ago
- [CVPRW 2023] "Many-Task Federated Learning: A New Problem Setting and A Simple Baseline" by Ruisi Cai, Xiaohan Chen, Shiwei Liu, Jayanth …☆13Aug 28, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICLR 2023] Soft Neighbors are Positive Supporters in Contrastive Visual Representation Learning☆15Aug 2, 2023Updated 2 years ago
- An implementation of the Prism layer (https://arxiv.org/abs/2011.04823)☆12Nov 13, 2020Updated 5 years ago
- A dataset for realistic evaluation of noisy label methods☆15Dec 3, 2023Updated 2 years ago
- This repo is about the classification of rhetorical roles in Legal Documents such as: Citation, Findings of Fact, Evidence, Legal Rule, R…☆18Feb 22, 2022Updated 4 years ago
- An implementation of "A Typed, Algebraic Approach to Parsing"☆11Mar 21, 2022Updated 4 years ago
- Yet another LLM☆10Apr 6, 2023Updated 3 years ago
- Code base for the EMNLP 2021 Findings paper: Cartography Active Learning☆14Jun 3, 2025Updated last year