microsoft / Multilingual-Evaluation-of-Generative-AI-MEGALinks
Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
☆71Updated last year
Alternatives and similar repositories for Multilingual-Evaluation-of-Generative-AI-MEGA
Users that are interested in Multilingual-Evaluation-of-Generative-AI-MEGA are comparing it to the libraries listed below
Sorting:
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆136Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆106Updated last year
- GEMBA — GPT Estimation Metric Based Assessment☆136Updated last week
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆97Updated 2 years ago
- A Multilingual Replicable Instruction-Following Model☆95Updated 2 years ago
- ☆119Updated last year
- Multilingual Large Language Models Evaluation Benchmark☆133Updated last year
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆123Updated 2 months ago
- Token-level Reference-free Hallucination Detection☆97Updated 2 years ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆86Updated last year
- Scalable training for dense retrieval models.☆298Updated 6 months ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆225Updated last year
- ☆189Updated 5 months ago
- A framework for few-shot evaluation of autoregressive language models.☆105Updated 2 years ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆165Updated 2 years ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆182Updated 3 years ago
- Detect hallucinated tokens for conditional sequence generation.☆64Updated 3 years ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆96Updated 2 years ago
- Resources for cultural NLP research☆113Updated 2 months ago
- ☆225Updated 4 months ago
- ☆145Updated 11 months ago
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆82Updated last week
- ☆176Updated 6 years ago
- Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)☆117Updated 3 years ago
- ☆101Updated 3 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆74Updated last year
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆214Updated last year
- Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …☆164Updated 6 months ago
- PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…☆285Updated 3 years ago
- ☆72Updated 2 years ago