Alternatives and similar repositories for awesome-lm-evaluation

Users that are interested in awesome-lm-evaluation are comparing it to the libraries listed below

• yizhen20133868 / CI-ToD
  PyTorch code for EMNLP 2021 paper: Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialog…
  ☆27Updated 3 years ago
• littlehacker26 / Discriminator-Cooperative-Unlikelihood-Prompt-Tuning
  The code implementation of the EMNLP2022 paper: DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Gene…
  ☆26Updated last year
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆61Updated 2 months ago
• krystalan / chatgpt_as_nlg_evaluator
  Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study
  ☆43Updated 2 years ago
• xiami2019 / CLAIF
  [Findings of ACL'2023] Improving Contrastive Learning of Sentence Embeddings from AI Feedback
  ☆39Updated last year
• nuaa-nlp / Evaluation-of-ChatGPT
  ☆14Updated 2 years ago
• ChiyuSONG / dynamics-of-instruction-tuning
  ☆16Updated 2 months ago
• changmenseng / accept_prob
  Calculate the probability of a paper being accepted by EMNLP2023 based on score distribution of ACL2023.
  ☆14Updated last year
• siyuyuan / coscript
  Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning
  ☆36Updated last year
• thu-coai / LOT-LongLM
  ☆71Updated 2 years ago
• HappyGu0524 / MultiControl
  ☆42Updated last year
• Spico197 / writing-comrade
  ✒️ ChatGPT as a writing partner.
  ☆14Updated 2 years ago
• DAMO-NLP-SG / TempReason
  ☆32Updated last year
• KwanWaiChung / M4LE
  Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
  ☆23Updated 9 months ago
• thu-coai / CPT4DST
  Official code for "Continual Prompt Tuning for Dialog State Tracking" (ACL 2022).
  ☆27Updated 2 years ago
• lemaoliu / retrieval-generation-reading-list
  This project maintains a reading list for general text generation tasks
  ☆65Updated 3 years ago
• Spico197 / MoE-SFT
  🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts
  ☆38Updated 7 months ago
• Abbey4799 / CELLO
  Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)
  ☆48Updated last year
• princeton-nlp / EvalConvQA
  [ACL 2022] Ditch the Gold Standard: Re-evaluating Conversational Question Answering
  ☆45Updated 2 years ago
• PKU-TANGENT / ConFiguRe
  Dataset and baseline for Coling 2022 long paper (oral): "ConFiguRe: Exploring Discourse-level Chinese Figures of Speech"
  ☆11Updated last year
• RUCAIBox / LLM-Knowledge-Boundary
  Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"
  ☆80Updated last year
• lemon0830 / TIM
  code for Teaching LM to Translate with Comparison
  ☆39Updated last year
• NEUIR / P3Ranker
  Code for our SIGIR 2022 accepted paper : P3 Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Prompt-based L…
  ☆17Updated last year
• THU-KEG / KoLA
  [ICLR24] The open-source repo of THU-KEG's KoLA benchmark.
  ☆50Updated last year
• microsoft / UniSumm
  UNISUMM: Unified Few-shot Summarization with Multi-Task Pre-Training and Prefix-Tuning
  ☆60Updated last year
• OhadRubin / EPR
  ☆61Updated 2 years ago
• freesunshine0316 / RaST-plus
  ☆21Updated 2 years ago
• GrittyChen / NLG-evaluation
  A toolkit for evaluation of natural language generation (NLG), including BLEU, ROUGE, METEOR, and CIDEr.
  ☆31Updated 4 years ago
• iwangjian / TopDial
  Target-oriented Proactive Dialogue Systems with Personalization: Problem Formulation and Dataset Curation (EMNLP 2023)
  ☆30Updated last year
• Zeng-WH / Prompt-Tuning
  Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"
  ☆57Updated 2 years ago