google-research / url-nlpLinks
☆220Updated 3 months ago
Alternatives and similar repositories for url-nlp
Users that are interested in url-nlp are comparing it to the libraries listed below
Sorting:
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆106Updated last year
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆117Updated 2 weeks ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆74Updated last year
- NTREX -- News Test References for MT Evaluation☆85Updated last year
- GEMBA — GPT Estimation Metric Based Assessment☆129Updated last year
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆283Updated 2 weeks ago
- The FLORES+ Machine Translation Benchmark☆108Updated 11 months ago
- ☆101Updated 2 years ago
- ☆203Updated 3 years ago
- A simple library for querying the URIEL typological database.☆91Updated last year
- ☆325Updated 4 years ago
- A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations☆56Updated 3 years ago
- A tool that locates, downloads, and extracts machine translation corpora☆159Updated last month
- OpusFilter - Parallel corpus processing toolkit☆110Updated last month
- A repository with the code related to experiments around context-aware machine translation☆51Updated last month
- A Multilingual Replicable Instruction-Following Model☆95Updated 2 years ago
- Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)☆115Updated 3 years ago
- ☆194Updated last year
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆97Updated 2 years ago
- ☆96Updated last month
- We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically …☆187Updated 3 years ago
- a tool for calcualting character n-gram F score☆74Updated 2 years ago
- The pipeline for the OSCAR corpus☆173Updated last year
- PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…☆280Updated 3 years ago
- ☆65Updated 2 years ago
- An official implementation of "BPE-Dropout: Simple and Effective Subword Regularization" algorithm.☆53Updated 4 years ago
- ☆72Updated 2 years ago
- The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization☆157Updated 2 years ago
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆54Updated 2 years ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆60Updated last year