IndoNLP / nusa-writesLinks
NusaWrites is an in-depth analysis of corpora collection strategy and a comprehensive language modeling benchmark for underrepresented and extremely low-resource Indonesian local languages.
☆27Updated last year
Alternatives and similar repositories for nusa-writes
Users that are interested in nusa-writes are comparing it to the libraries listed below
Sorting:
- A collaborative project to collect datasets in SEA languages, SEA regions, or SEA cultures.☆93Updated 9 months ago
- A curated list of research papers and resources on Indonesian languages☆39Updated last year
- NTREX -- News Test References for MT Evaluation☆86Updated last year
- The first large-scale summarization corpus for the Indonesian language. AACL 2020.☆38Updated 4 years ago
- Can LLMs generate code-mixed sentences through zero-shot prompting?☆11Updated 2 years ago
- High-quality parallel resource on sentiment analysis for 10 low-resource Indonesian languages, English, and Indonesian (Outstanding Paper…☆107Updated 2 years ago
- MAFAND-MT☆59Updated last year
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆74Updated last year
- Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"☆25Updated 5 months ago
- Welcome to our repository! This repository hosts the data on "IndoCollex: A Testbed for Morphological Transformation of Indonesian Word …☆23Updated 4 years ago
- ☆52Updated 2 years ago
- Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"☆30Updated 3 years ago
- A tiny BERT for low-resource monolingual models☆31Updated last month
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆60Updated last year
- Benchmarking Multidomain English-Indonesian Machine Translation☆16Updated 4 years ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆106Updated last year
- benchmarks for evaluating MT models☆12Updated last year
- Curriculum training☆18Updated 4 months ago
- The first-ever vast natural language generation benchmark for Indonesian, Sundanese, and Javanese. We provide multiple downstream tasks, …☆76Updated last year
- ☆220Updated 3 months ago
- ☆18Updated last year
- ☆22Updated 9 months ago
- Multilingual Open Text☆25Updated 6 months ago
- Experiments for XLM-V Transformers Integeration☆13Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆96Updated 2 years ago
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.☆85Updated last year
- Crosslingual Question Answering for African Languages☆31Updated last year
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆57Updated 3 years ago
- XL-AMR is a sequence-to-graph cross-lingual AMR parser that exploits transfer learning (EMNLP2020).☆17Updated last year
- Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".☆99Updated 2 years ago