SEACrowd / seacrowd-datahubLinks
A collaborative project to collect datasets in SEA languages, SEA regions, or SEA cultures.
☆93Updated 9 months ago
Alternatives and similar repositories for seacrowd-datahub
Users that are interested in seacrowd-datahub are comparing it to the libraries listed below
Sorting:
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆106Updated last year
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆97Updated 2 years ago
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆70Updated last year
- A curated list of research papers and resources on Cultural LLM.☆52Updated last year
- ☆220Updated 3 months ago
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆165Updated 5 months ago
- NusaWrites is an in-depth analysis of corpora collection strategy and a comprehensive language modeling benchmark for underrepresented an…☆27Updated last year
- Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)☆115Updated 3 years ago
- The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization☆157Updated 3 years ago
- ☆169Updated last year
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆119Updated 3 weeks ago
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆87Updated 3 months ago
- This repository contains materials for the SIGIR 2022 tutorial on opinion summarization.☆33Updated 3 years ago
- Resources for cultural NLP research☆106Updated last month
- TimeLMs: Diachronic Language Models from Twitter☆111Updated last year
- Data for evaluating gender bias in coreference resolution systems.☆80Updated 6 years ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆135Updated last year
- Collection of NLP model explanations and accompanying analysis tools☆144Updated 2 years ago
- Repository for research in the field of Responsible NLP at Meta.☆202Updated 5 months ago
- ☆38Updated last year
- Machine learning models from Singapore's NLP research community☆36Updated 2 years ago
- ☆101Updated last year
- We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically …☆187Updated 3 years ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆60Updated last year
- A library of translation-based text similarity measures☆25Updated last year
- ☆115Updated 10 months ago
- GEMBA — GPT Estimation Metric Based Assessment☆130Updated last year
- Framework for unified summarisation and evaluation of English documents using state-of-the-art models and measures.☆33Updated last year
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆338Updated 2 years ago
- ☆80Updated last year