project-anuvaad / anuvaad-parallel-corpus
☆14Updated 2 years ago
Alternatives and similar repositories for anuvaad-parallel-corpus:
Users that are interested in anuvaad-parallel-corpus are comparing it to the libraries listed below
- Code for extracting parallel corpora from pmindia☆16Updated 5 years ago
- Generate large textual corpora for almost any language by crawling the web☆12Updated last year
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated last year
- OpusFilter - Parallel corpus processing toolkit☆104Updated 3 weeks ago
- ☆36Updated 3 years ago
- This code provides word level language identification tool for identifying language for individual words in Code-Mixed text. e.g. The tex…☆51Updated 4 years ago
- Curated list of publicly available parallel corpus for Indian Languages☆30Updated 3 years ago
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆72Updated last year
- This repository contains the HiNER dataset released with our paper at LREC 2022☆14Updated last year
- These are lists for a variety of languages containing words that are distinctive to each language.☆35Updated 2 years ago
- Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.☆41Updated last year
- indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2☆122Updated last year
- A library of translation-based text similarity measures☆25Updated last year
- Efficient Low-Memory Aligner☆141Updated last month
- Tool to fix bitexts and tag near-duplicates for removal☆29Updated 2 weeks ago
- NTREX -- News Test References for MT Evaluation☆81Updated 8 months ago
- A tiny BERT for low-resource monolingual models☆31Updated 4 months ago
- Appraise code used as part of WMT21 human evaluation campaign☆23Updated this week
- ☆13Updated 4 years ago
- A tool that locates, downloads, and extracts machine translation corpora☆150Updated 8 months ago
- ☆91Updated last year
- MT Evaluation in Many Languages via Zero-Shot Paraphrasing☆101Updated 6 months ago
- Bicleaner fork that uses neural networks☆39Updated 6 months ago
- A tool for converting TMX files into bilingual corpora☆18Updated 5 years ago
- Codebase for Indic-Transliteration using Seq2Seq RNN. For latest repo with Transformer-based models, check: https://github.com/AI4Bharat/…☆60Updated 3 years ago
- Zero-shot Transfer Learning from English to Arabic☆29Updated 2 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆154Updated 8 months ago
- ☆23Updated 5 years ago
- Repository for the English-Hindi Codemixed to Monolingual English Parallel Corpus☆13Updated 6 years ago
- Curriculum training☆16Updated last month