Alternatives and similar repositories for fms-dgt

Users that are interested in fms-dgt are comparing it to the libraries listed below

• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆208Updated this week
• IBM / AISteer360
  AI Steerability 360 toolkit
  ☆28Updated this week
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆564Updated last year
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆233Updated this week
• IBM / ICX360
  In-Context Explainability 360 toolkit
  ☆28Updated this week
• snap-stanford / MLAgentBench
  ☆306Updated last year
• VectorInstitute / vector-inference
  Efficient LLM inference on Slurm clusters using vLLM.
  ☆77Updated this week
• siegelz / core-bench
  ☆47Updated 6 months ago
• tatsu-lab / opinions_qa
  ☆114Updated last year
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆141Updated last week
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆105Updated 2 years ago
• Saibo-creator / Awesome-LLM-Constrained-Decoding
  A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.
  ☆256Updated last month
• open-lm-engine / lm-engine
  LM engine is a library for pretraining/finetuning LLMs
  ☆66Updated 2 weeks ago
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆148Updated 2 weeks ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆110Updated 3 months ago
• IINemo / lm-polygraph
  ☆359Updated this week
• Shangyint / langProBe
  ☆24Updated 3 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆224Updated 10 months ago
• xlang-ai / DS-1000
  [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".
  ☆256Updated 10 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆248Updated 2 months ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆138Updated last year
• princeton-nlp / intercode
  [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
  ☆224Updated last year
• princeton-pli / hal-harness
  ☆129Updated 2 weeks ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆118Updated last year
• UKGovernmentBEIS / control-arena
  ControlArena is a collection of settings, model organisms and protocols - for running control experiments.
  ☆93Updated last week
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆989Updated 4 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆216Updated last month
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆380Updated 5 months ago
• data-prep-kit / data-prep-kit
  Open source project for data preparation for GenAI applications
  ☆800Updated this week
• instructlab / taxonomy
  Taxonomy tree that will allow you to create models tuned with your data
  ☆281Updated 2 weeks ago