BatsResearch / LexC-Gen
Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.
☆15Updated 5 months ago
Alternatives and similar repositories for LexC-Gen:
Users that are interested in LexC-Gen are comparing it to the libraries listed below
- A curated list of research papers and resources on Cultural LLM.☆41Updated 6 months ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆71Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆100Updated 11 months ago
- This repository contains code and data for the EMNLP 2022 paper "CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about…☆10Updated 2 years ago
- ☆30Updated 9 months ago
- A system for prompted weak supervision. Alfred is a powerful tool that leverages large language models to accelerate data annotation.☆52Updated 5 months ago
- ☆34Updated 5 months ago
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆68Updated last year
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆55Updated 2 years ago
- Multilingual Large Language Models Evaluation Benchmark☆119Updated 7 months ago
- Statistics on multilingual datasets☆17Updated 2 years ago
- CodemixedNLP: An Extensible and Open NLP Toolkit for Code-Switching☆18Updated 4 years ago
- ☆75Updated 3 years ago
- ☆26Updated last month
- A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.☆27Updated 6 months ago
- A Multilingual Replicable Instruction-Following Model☆93Updated last year
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆56Updated 8 months ago
- Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"☆30Updated 2 years ago
- Research code for "What to Pre-Train on? Efficient Intermediate Task Selection", EMNLP 2021☆34Updated 3 years ago
- Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"☆48Updated 2 years ago
- ☆21Updated 10 months ago
- ParaNames: A multilingual resource for parallel names☆31Updated 10 months ago
- ☆14Updated 11 months ago
- Easy multi-task learning with HuggingFace Datasets and Trainer☆55Updated 2 months ago
- Automatically detect errors in annotated corpora.☆47Updated last year
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆57Updated 9 months ago
- Code for our WOAH@ACL 2021 Paper on Data Integration for Toxic Comment Classification: Making More Than 40 Datasets Easily Accessible in …☆27Updated 3 years ago
- A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.☆21Updated 2 years ago
- Frame Semantic Parser based on T5 and FrameNet☆57Updated last year
- A Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation, Levy et al., Findings of EMNLP 2021☆14Updated 2 years ago