Alternatives and similar repositories for Data-Provenance-Collection

Users that are interested in Data-Provenance-Collection are comparing it to the libraries listed below

• stanford-crfm / ecosystem-graphs
  ☆267Updated 6 months ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated 3 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆223Updated 8 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆160Updated last year
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆107Updated last month
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 10 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆131Updated last year
• stanford-crfm / fmti
  The Foundation Model Transparency Index
  ☆82Updated last year
• minalee-research / coauthor-interface
  ☆95Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆86Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆260Updated 7 months ago
• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆206Updated this week
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆185Updated 3 weeks ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆150Updated last year
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆104Updated 5 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆268Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆291Updated last month
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆195Updated 8 months ago
• PAIR-code / interpretability
  PAIR.withgoogle.com and friend's work on interpretability methods
  ☆195Updated 3 weeks ago
• rosewang2008 / bridge
  NAACL 2024. Code & Dataset for "🌁 Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistake…
  ☆43Updated last year
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆231Updated 6 months ago
• EleutherAI / elk
  Keeping language models honest by directly eliciting knowledge encoded in their activations.
  ☆209Updated last week
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆70Updated 2 years ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated last year
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆124Updated 10 months ago
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆90Updated last year
• neulab / gemini-benchmark
  ☆149Updated last year
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆162Updated 2 months ago
• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆218Updated last year
• google-deepmind / mishax
  ☆136Updated 4 months ago