Alternatives and similar repositories for Themis:

Users that are interested in Themis are comparing it to the libraries listed below

• Abbey4799 / CELLO
  Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)
  ☆46Updated 9 months ago
• krystalan / chatgpt_as_nlg_evaluator
  Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study
  ☆43Updated last year
• Spico197 / awesome-lm-evaluation
  🩺 A collection of ChatGPT evaluation reports on various bechmarks.
  ☆48Updated last year
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 6 months ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆57Updated last year
• ntunlp / LLMSanitize
  An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
  ☆46Updated 5 months ago
• GAIR-NLP / MoPS
  [ACL 2024] Code for "MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation"
  ☆33Updated 6 months ago
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆61Updated 5 months ago
• Yale-LILY / ROSE
  ☆36Updated last year
• AI21Labs / factor
  Code and data for the FACTOR paper
  ☆44Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated last year
• qinyiwei / InfoBench
  ☆52Updated 4 months ago
• KaiLv69 / UDR
  ACL'23: Unified Demonstration Retriever for In-Context Learning
  ☆34Updated last year
• littlehacker26 / Discriminator-Cooperative-Unlikelihood-Prompt-Tuning
  The code implementation of the EMNLP2022 paper: DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Gene…
  ☆25Updated last year
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆82Updated 2 months ago
• yinzhangyue / SelfAware
  Do Large Language Models Know What They Don’t Know?
  ☆88Updated 2 months ago
• YJiangcm / FollowBench
  Code for "FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models (ACL 2024)"
  ☆94Updated last month
• lemaoliu / retrieval-generation-reading-list
  This project maintains a reading list for general text generation tasks
  ☆65Updated 3 years ago
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆20Updated 2 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆44Updated 3 weeks ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆55Updated 6 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆31Updated 4 months ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆76Updated 11 months ago
• realtimeqa / realtimeqa_public
  ☆70Updated 11 months ago
• RUCAIBox / HaluEval-2.0
  ☆38Updated last year
• blcuicall / OMGEval
  OMGEval😮: An Open Multilingual Generative Evaluation Benchmark for Foundation Models
  ☆32Updated 6 months ago
• qiancheng0 / CREATOR
  This is the repository for paper "CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Models"
  ☆23Updated last year
• abhika-m / FAVA
  ☆64Updated 11 months ago
• ndaheim / faithful-dialogue
  ☆23Updated last year
• RUCAIBox / BAMBOO
  ☆33Updated 9 months ago