Alternatives and similar repositories for Themis:

Users that are interested in Themis are comparing it to the libraries listed below

• Spico197 / awesome-lm-evaluation
  🩺 A collection of ChatGPT evaluation reports on various bechmarks.
  ☆48Updated 2 years ago
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆76Updated last month
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆34Updated 6 months ago
• qinyiwei / InfoBench
  ☆52Updated 7 months ago
• Abbey4799 / CELLO
  Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)
  ☆48Updated 11 months ago
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆87Updated 5 months ago
• ntunlp / LLMSanitize
  An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
  ☆51Updated 7 months ago
• csitfun / LogiCoT
  the instructions and demonstrations for building a formal logical reasoning capable GLM
  ☆53Updated 6 months ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆56Updated 8 months ago
• halfrot / ALaRM
  [ACL 2024] Code for the paper "ALaRM: Align Language Models via Hierarchical Rewards Modeling"
  ☆25Updated last year
• lemaoliu / retrieval-generation-reading-list
  This project maintains a reading list for general text generation tasks
  ☆65Updated 3 years ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆79Updated last year
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 3 weeks ago
• PlusLabNLP / Active-IT
  Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"
  ☆24Updated last year
• krystalan / chatgpt_as_nlg_evaluator
  Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study
  ☆43Updated 2 years ago
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆78Updated 8 months ago
• DAMO-NLP-SG / TempReason
  ☆31Updated last year
• RUCAIBox / BAMBOO
  ☆34Updated last year
• THUNLP-MT / SKR
  Self-Knowledge Guided Retrieval Augmentation for Large Language Models (EMNLP Findings 2023)
  ☆25Updated last year
• yinzhangyue / SelfAware
  Do Large Language Models Know What They Don’t Know?
  ☆92Updated 4 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆46Updated 3 months ago
• HarlynDN / WebCiteS
  [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations
  ☆12Updated 6 months ago
• ChiyuSONG / dynamics-of-instruction-tuning
  ☆16Updated 3 weeks ago
• ChengpengLi1003 / DotaMath
  ☆29Updated 3 months ago
• sunlab-osu / Understanding-CoT
  ☆86Updated last year
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆90Updated last year
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆123Updated 8 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• KaiLv69 / UDR
  ACL'23: Unified Demonstration Retriever for In-Context Learning
  ☆36Updated last year
• qiancheng0 / CREATOR
  This is the repository for paper "CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Models"
  ☆23Updated last year