MaLA-LM / GlotEvalLinks
GlotEval: a unified evaluation toolkit designed to benchmark multilingual Large Language Models (LLMs) in a language-specific way
☆14Updated 2 months ago
Alternatives and similar repositories for GlotEval
Users that are interested in GlotEval are comparing it to the libraries listed below
Sorting:
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆70Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆104Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆133Updated last year
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆97Updated 2 years ago
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆61Updated last year
- ☆110Updated 9 months ago
- MAFAND-MT☆57Updated last year
- ☆14Updated this week
- Benchmarking Large Language Models☆99Updated 3 months ago
- ☆65Updated 2 years ago
- Multilingual Large Language Models Evaluation Benchmark☆131Updated last year
- A Multilingual Replicable Instruction-Following Model☆95Updated 2 years ago
- 🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment☆11Updated 5 months ago
- Resources for cultural NLP research☆103Updated 4 months ago
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆160Updated 3 months ago
- Efficiently find the best-suited language model (LM) for your NLP task☆127Updated last month
- Code for the NAACL 2024 HCI+NLP Workshop paper "LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tool…☆13Updated last year
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆20Updated last year
- A software for transferring pre-trained English models to foreign languages☆19Updated 2 years ago
- GEMBA — GPT Estimation Metric Based Assessment☆124Updated last year
- [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"☆34Updated 3 months ago
- ☆35Updated last month
- The geometry of multilingual language model representations (EMNLP 2022).☆21Updated 2 years ago
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Updated 2 years ago
- A Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation, Levy et al., Findings of EMNLP 2021☆14Updated 3 years ago
- 🌾 Universal, customizable and deployable fine-grained evaluation for text generation.☆23Updated last year
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆224Updated 10 months ago
- Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)☆114Updated 2 years ago
- OpenNyAI is a mission aimed at developing open source software and datasets to catalyze the creation of AI-powered solutions to improve a…☆41Updated last year
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆85Updated 2 months ago