Alternatives and similar repositories for multiannotator-benchmarks:

Users that are interested in multiannotator-benchmarks are comparing it to the libraries listed below

• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆35Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• fgranese / DOCTOR
  Advances in Neural Information Processing Systems (NeurIPS 2021)
  ☆22Updated 2 years ago
• PrithivirajDamodaran / vision-language-modelling-series
  Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations
  ☆14Updated 2 years ago
• darrow-labs / LegalLens
  ☆8Updated 9 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 5 months ago
• srush / text2table
  ☆31Updated 2 years ago
• ethz-spylab / superhuman-ai-consistency
  ☆29Updated last year
• ekinakyurek / google-research
  Google Research
  ☆46Updated 2 years ago
• minnesotanlp / select-llm
  Parkar and Kim et al.'s paper on Can LLMs Select Important Instructions to Annotate?"
  ☆12Updated 9 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• seharanul17 / synthetic-tabular-LLM
  ☆11Updated 4 months ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated last year
• NVlabs / HCL
  [CVPR'23 Highlight] Heterogeneous Continual Learning.
  ☆16Updated last year
• pacman100 / peft-codegen-25
  ☆24Updated last year
• facebookresearch / UNIREX
  This is the official PyTorch repo for "UNIREX: A Unified Learning Framework for Language Model Rationale Extraction" (ICML 2022).
  ☆24Updated 2 years ago
• facebookresearch / DejaVu
  Repository for the paper Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning
  ☆36Updated last year
• nlpie-research / Lightweight-Clinical-Transformers
  This project develops compact transformer models tailored for clinical text analysis, balancing efficiency and performance for healthcare…
  ☆18Updated last year
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆46Updated last year
• Netflix / clove
  ☆13Updated 7 months ago
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆23Updated this week
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• philschmid / optimum-static-quantization
  ☆28Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆23Updated 3 months ago
• johnrobinsn / redpajama
  Training and Inference Notebooks for the RedPajama (OpenLlama) models
  ☆18Updated last year
• facebookresearch / synlm
  Code for paper: "Privately generating tabular data using language models".
  ☆15Updated last year
• amzn / extremely-efficient-query-encoder
  efficient query encoding for dense retrieval
  ☆11Updated 8 months ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 2 years ago
• facebookresearch / tce
  Library for the Test-based Calibration Error (TCE) metric to quantify the degree to classifier calibration.
  ☆13Updated last year