SEACrowd / seacrowd-datahubLinks
A collaborative project to collect datasets in SEA languages, SEA regions, or SEA cultures.
☆84Updated 6 months ago
Alternatives and similar repositories for seacrowd-datahub
Users that are interested in seacrowd-datahub are comparing it to the libraries listed below
Sorting:
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆103Updated last year
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆97Updated last year
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆147Updated 2 months ago
- A curated list of research papers and resources on Cultural LLM.☆46Updated 10 months ago
- Resources for cultural NLP research☆101Updated 3 months ago
- NusaWrites is an in-depth analysis of corpora collection strategy and a comprehensive language modeling benchmark for underrepresented an…☆25Updated 10 months ago
- Welcome to our repository! This repository hosts the data on "IndoCollex: A Testbed for Morphological Transformation of Indonesian Word …☆22Updated 3 years ago
- A Multilingual Replicable Instruction-Following Model☆94Updated 2 years ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆111Updated 4 months ago
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆70Updated last year
- Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.☆16Updated 10 months ago
- GlotEval: a unified evaluation toolkit designed to benchmark multilingual Large Language Models (LLMs) in a language-specific way☆14Updated 3 weeks ago
- ☆217Updated last week
- This repository contains materials for the SIGIR 2022 tutorial on opinion summarization.☆34Updated 3 years ago
- Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)☆114Updated 2 years ago
- Efficient Attention for Long Sequence Processing☆97Updated last year
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆85Updated 3 weeks ago
- Multilingual Large Language Models Evaluation Benchmark☆128Updated 11 months ago
- Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.☆335Updated 7 months ago
- ☆78Updated 10 months ago
- ☆104Updated 7 months ago
- Repository for research in the field of Responsible NLP at Meta.☆202Updated 2 months ago
- ☆167Updated last year
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆73Updated last year
- We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically …☆184Updated 3 years ago
- The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization☆157Updated 2 years ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆131Updated last year
- ☆99Updated last year
- A multilingual version of MS MARCO passage ranking dataset☆144Updated last year
- Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …☆162Updated last month