Alternatives and similar repositories for fms-dgt

Users that are interested in fms-dgt are comparing it to the libraries listed below

• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆206Updated this week
• IINemo / lm-polygraph
  ☆291Updated this week
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆543Updated last year
• IBM / AssetOpsBench
  AssetOpsBench - Industry 4.0
  ☆121Updated this week
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆146Updated 9 months ago
• Leolty / repobench
  ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024
  ☆169Updated 11 months ago
• gblackout / LogicLLaMA
  Large language model and dataset for natural language to first-order logic translation
  ☆60Updated last year
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆178Updated this week
• amazon-science / cceval
  CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
  ☆149Updated 11 months ago
• Saibo-creator / Awesome-LLM-Constrained-Decoding
  A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.
  ☆235Updated this week
• snap-stanford / MLAgentBench
  ☆297Updated last year
• princeton-nlp / intercode
  [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
  ☆222Updated last year
• intuit / sac3
  Official repo for SAC3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check Consistency
  ☆35Updated 6 months ago
• IBM / ACPBench
  ACPBench: Reasoning about Action, Change, and Planning
  ☆24Updated 2 months ago
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆359Updated 3 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆99Updated last month
• BangLab-UdeM-Mila / NLP4MatSci-HoneyBee
  This repository contains the implementation for our EMNLP 2023 paper: HoneyBee: Progressive Instruction Finetuning of Large Language Mode…
  ☆27Updated last year
• xlang-ai / DS-1000
  [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".
  ☆250Updated 8 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆127Updated last week
• tatsu-lab / opinions_qa
  ☆110Updated last year
• shallinan1 / MarcoDetoxification
  Repository for "Detoxification with MaRCo: Controllable Revision with Experts and Anti-Experts"
  ☆9Updated last year
• teacherpeterpan / Logic-LLM
  The project page for "LOGIC-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning"
  ☆333Updated last year
• princeton-pli / hal-harness
  ☆97Updated 2 weeks ago
• epfl-dlab / transformers-CFG
  🤗 A specialized library for integrating context-free grammars (CFG) in EBNF with the Hugging Face Transformers
  ☆121Updated 3 months ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆132Updated last year
• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆217Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆351Updated last year
• RUCAIBox / HaluEval
  This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.
  ☆488Updated last year
• Shangyint / langProBe
  ☆18Updated last month
• balevinstein / Probes
  ☆51Updated 2 years ago