nlp-uoregon / mlmm-evaluationLinks
Multilingual Large Language Models Evaluation Benchmark
☆129Updated last year
Alternatives and similar repositories for mlmm-evaluation
Users that are interested in mlmm-evaluation are comparing it to the libraries listed below
Sorting:
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆207Updated last year
- ☆184Updated last month
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆196Updated 8 months ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆94Updated 2 years ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆223Updated 9 months ago
- GEMBA — GPT Estimation Metric Based Assessment☆122Updated last year
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆97Updated 2 years ago
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆255Updated 2 years ago
- [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision☆93Updated 9 months ago
- ACL 2023: Evaluating Open-Domain Question Answering in the Era of Large Language Models☆47Updated last year
- A Multilingual Replicable Instruction-Following Model☆94Updated 2 years ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆181Updated 2 years ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆163Updated last year
- ☆77Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆132Updated last year
- NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning☆25Updated 5 months ago
- ☆56Updated last year
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆81Updated last month
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆103Updated last year
- ☆45Updated last year
- contrastive decoding☆203Updated 2 years ago
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆136Updated last year
- Datasets for Instruction Tuning of Large Language Models☆255Updated last year
- Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …☆162Updated 2 months ago
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆70Updated last year
- ☆81Updated 8 months ago
- First explanation metric (diagnostic report) for text generation evaluation☆62Updated 5 months ago
- ☆138Updated 7 months ago
- The geometry of multilingual language model representations (EMNLP 2022).☆21Updated 2 years ago
- Token-level Reference-free Hallucination Detection☆96Updated 2 years ago