microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
☆67Updated 10 months ago
Alternatives and similar repositories for Multilingual-Evaluation-of-Generative-AI-MEGA:
Users that are interested in Multilingual-Evaluation-of-Generative-AI-MEGA are comparing it to the libraries listed below
- Multilingual Large Language Models Evaluation Benchmark☆115Updated 4 months ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆82Updated 5 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆124Updated 10 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆99Updated 8 months ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆70Updated 10 months ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆96Updated last month
- A Multilingual Replicable Instruction-Following Model☆94Updated last year
- ☆65Updated last year
- Token-level Reference-free Hallucination Detection☆93Updated last year
- ☆97Updated 2 years ago
- A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.☆71Updated 5 months ago
- Code for Zero-Shot Tokenizer Transfer☆119Updated this week
- Detect hallucinated tokens for conditional sequence generation.☆64Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆102Updated last year
- Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"☆99Updated 2 years ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆92Updated last year
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆70Updated 3 years ago
- Are foundation LMs multilingual knowledge bases? (EMNLP 2023)☆18Updated last year
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆200Updated 2 months ago
- ☆173Updated last year
- Mr. TyDi is a multi-lingual benchmark dataset built on TyDi, covering eleven typologically diverse languages.☆72Updated 2 years ago
- ☆96Updated 2 years ago
- [TMLR'23] Contrastive Search Is What You Need For Neural Text Generation☆119Updated last year
- ☆124Updated this week
- Resources for cultural NLP research☆77Updated last month
- ☆28Updated 6 months ago
- ☆73Updated last year
- Benchmarking library for RAG☆150Updated this week
- Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"☆59Updated 9 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆66Updated 2 months ago