openlanguagedata / seedLinks
Seed Machine Translation Data
☆32Updated 6 months ago
Alternatives and similar repositories for seed
Users that are interested in seed are comparing it to the libraries listed below
Sorting:
- The FLORES+ Machine Translation Benchmark☆104Updated 6 months ago
- NTREX -- News Test References for MT Evaluation☆83Updated last year
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆27Updated 2 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆72Updated last year
- 🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.☆13Updated 2 months ago
- MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki☆23Updated 3 months ago
- Code for SaGe subword tokenizer (EACL 2023)☆25Updated 6 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆52Updated last month
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆101Updated last year
- Tool to fix bitexts and tag near-duplicates for removal☆30Updated 4 months ago
- Translation demonstrator☆34Updated 5 years ago
- Extracts plain text, language identification and more metadata from WARC records☆22Updated 3 months ago
- An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…☆22Updated 3 years ago
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆21Updated 2 years ago
- LTG-Bert☆33Updated last year
- ☆57Updated 2 years ago
- A library for data streaming and augmentation☆20Updated last month
- OpusFilter - Parallel corpus processing toolkit☆104Updated 2 months ago
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated 2 years ago
- Open information and community for machine translation☆77Updated last month
- ☆9Updated last year
- Robust Cross-lingual Embeddings from Parallel Sentences☆22Updated 4 years ago
- Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.☆50Updated last month
- The Open Parallel Corpus☆72Updated 2 months ago
- Library for fast text representation and classification.☆28Updated last year
- PALI: Language identification for Perso-Arabic Scripts☆9Updated last year
- A tiny BERT for low-resource monolingual models☆31Updated 8 months ago
- Post-processing OCR errors with seq2seq models☆28Updated 4 years ago
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval☆29Updated 2 years ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 2 months ago