cleanlab / multiannotator-benchmarks

Related projects ⓘ

Alternatives and complementary repositories for multiannotator-benchmarks

• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• fgranese / DOCTOR
  Advances in Neural Information Processing Systems (NeurIPS 2021)
  ☆22Updated 2 years ago
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆35Updated last year
• microsoft / augmented-interpretable-models
  Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.
  ☆38Updated 7 months ago
• BatsResearch / nplm
  A weak supervision framework for (partial) labeling functions
  ☆14Updated 4 months ago
• facebookresearch / UNIREX
  This is the official PyTorch repo for "UNIREX: A Unified Learning Framework for Language Model Rationale Extraction" (ICML 2022).
  ☆23Updated last year
• Am1n3e / active-learning-transformer
  A hands-on tutorial on how to use Active Learning with Transformer models.
  ☆14Updated 3 years ago
• Ankush7890 / ssfinetuning
  A package for fine tuning of pretrained NLP transformers using Semi Supervised Learning
  ☆15Updated 3 years ago
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated 9 months ago
• practicalweaksupervisionbook / companion
  ☆24Updated 3 years ago
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆46Updated last year
• ethz-spylab / superhuman-ai-consistency
  ☆28Updated last year
• EleutherAI / semantic-memorization
  ☆46Updated this week
• pacman100 / peft-codegen-25
  ☆24Updated last year
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆31Updated 5 months ago
• minnesotanlp / select-llm
  Parkar and Kim et al.'s paper on Can LLMs Select Important Instructions to Annotate?"
  ☆12Updated 4 months ago
• PrithivirajDamodaran / vision-language-modelling-series
  Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations
  ☆14Updated 2 years ago
• MurtyShikhar / LanguagePatching
  Code for our EMNLP '22 paper "Fixing Model Bugs with Natural Language Patches"
  ☆19Updated last year
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated last year
• benbo / interactive-weak-supervision
  Interactive Weak Supervision: Learning Useful Heuristics for Data Labeling
  ☆30Updated 3 years ago
• snu-mllab / Neural-Relation-Graph
  Official PyTorch implementation of "Neural Relation Graph: A Unified Framework for Identifying Label Noise and Outlier Data" (NeurIPS'23)
  ☆15Updated 11 months ago
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated 5 months ago
• simran-arora / focus
  This repo contains code for the paper: "Can Foundation Models Help Us Achieve Perfect Secrecy?"
  ☆24Updated last year
• ekinakyurek / google-research
  Google Research
  ☆46Updated 2 years ago
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆43Updated 10 months ago
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆36Updated 2 years ago
• facebookresearch / DejaVu
  Repository for the paper Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning
  ☆37Updated last year
• facebookresearch / GROOV
  Code for "Open Vocabulary Extreme Classification Using Generative Models"
  ☆24Updated 2 years ago
• csinva / tree-prompt
  Tree prompting: easy-to-use scikit-learn interface for improved prompting.
  ☆33Updated last year
• philschmid / optimum-static-quantization
  ☆28Updated last year