avidml / evaluating-LLMs

Related projects ⓘ

Alternatives and complementary repositories for evaluating-LLMs

• huggingface / disaggregators
  🤗 Disaggregators: Curated data labelers for in-depth analysis.
  ☆65Updated last year
• Giskard-AI / awesome-ai-safety
  📚 A curated list of papers & technical articles on AI Quality & Safety
  ☆162Updated last year
• microsoft / adaptive-testing
  Find and fix bugs in natural language machine learning models using adaptive testing.
  ☆182Updated 6 months ago
• JoaoLages / RATransformers
  RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!
  ☆41Updated last year
• NorskRegnesentral / text-anonymization-benchmark
  Annotated corpus + evaluation metrics for text anonymisation
  ☆51Updated 9 months ago
• flairNLP / fabricator
  [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.
  ☆103Updated 6 months ago
• salesforce / AuditNLG
  AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
  ☆97Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆109Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆66Updated 8 months ago
• microsoft / augmented-interpretable-models
  Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.
  ☆38Updated 7 months ago
• g8a9 / ferret
  A python package for benchmarking interpretability techniques on Transformers.
  ☆212Updated last month
• jensjorisdecorte / Skill-Extraction-benchmark
  Dataset used to evaluate Skill Extraction systems based on the ESCO skills taxonomy.
  ☆12Updated 4 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆102Updated last year
• KennethEnevoldsen / augmenty
  Augmenty is an augmentation library based on spaCy for augmenting texts.
  ☆151Updated 6 months ago
• infinitylogesh / mutate
  A library to synthesize text datasets using Large Language Models (LLM)
  ☆151Updated last year
• pmbaumgartner / setfit
  ☆42Updated last year
• cisnlp / GlotLID
  Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆92Updated 3 weeks ago
• salesforce / TaiChi
  Open source library for few shot NLP
  ☆77Updated last year
• UKPLab / acl2024-triple-encoders
  triple-encoders is a library for contextualizing distributed Sentence Transformers representations.
  ☆14Updated 2 months ago
• argilla-io / adept-augmentations
  A Python library aimed at dissecting and augmenting NER training data.
  ☆57Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆64Updated last month
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆68Updated last year
• TheAtticusProject / maud
  ☆75Updated last year
• JulesBelveze / concepcy
  💫 SpaCy wrapper for ConceptNet 💫
  ☆88Updated last year
• UKPLab / lagonn
  Source code and data for Like a Good Nearest Neighbor
  ☆28Updated 9 months ago
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆46Updated last year
• Babelscape / ALERT
  Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"
  ☆33Updated 2 months ago
• IBM / ensemble-instruct
  codebase release for EMNLP2023 paper publication
  ☆19Updated 8 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆171Updated 8 months ago