Tool to fix bitexts and tag near-duplicates for removal
☆36Sep 4, 2025Updated last year
Alternatives and similar repositories for bifixer
Users that are interested in bifixer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Transform TMX to text☆27Nov 23, 2022Updated 3 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆159Jun 18, 2024Updated 2 years ago
- Tool for manual evaluation of parallel sentences.☆15Oct 23, 2026Updated last week
- Corset is a web-based data selection portal that helps you getting relevant data from massive amounts of parallel data.☆21Nov 6, 2023Updated 2 years ago
- ☆13Aug 23, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Targetted language identifier, based on FastText and Hunspell.☆38Sep 4, 2025Updated last year
- Program used to split text into segments☆28Oct 27, 2024Updated 2 years ago
- OpusFilter - Parallel corpus processing toolkit☆116Sep 30, 2026Updated 3 weeks ago
- A library for data streaming and augmentation☆22May 5, 2025Updated last year
- HPLT Analytics☆16Oct 16, 2026Updated last week
- A framework for evaluating Machine Translation models.☆14Oct 1, 2026Updated 3 weeks ago
- Repository for the experiments in my paper accepted to the CLIN Journal: "Selecting Parallel In-domain Sentences for Neural Machine Trans…☆11Nov 28, 2025Updated 11 months ago
- Bicleaner fork that uses neural networks☆41Feb 23, 2026Updated 8 months ago
- Efficient Low-Memory Aligner☆148Jan 15, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆83Updated this week
- Material for a course on Advanced NLP☆17Jul 22, 2025Updated last year
- A High-Quality Multilingual Dataset for Structured Documentation Translation☆39May 1, 2025Updated last year
- MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki☆37Updated this week
- Lyrics crawling, pre-processing, embedding generation, model training, and lyrics generation - all in one tool☆14Nov 4, 2018Updated 7 years ago
- Official code and data of "3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset"☆13Dec 8, 2024Updated last year
- Scripts for preprocessing datasets for machine translation.☆11Mar 20, 2018Updated 8 years ago
- Bitextor generates translation memories from multilingual websites☆301Nov 11, 2024Updated last year
- Project OCELoT: an Open, Collaborative Evaluation Leaderboard of Translations☆23Jul 11, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Dec 9, 2015Updated 10 years ago
- Yet Another Neural Machine Translation Toolkit☆180Mar 7, 2025Updated last year
- System Combination☆16Aug 28, 2015Updated 11 years ago
- Generate large textual corpora for almost any language by crawling the web☆14Feb 17, 2024Updated 2 years ago
- Efficient teacher-student models and scripts to make them☆58Dec 16, 2023Updated 2 years ago
- PDF parser and converter to HTML☆95Oct 3, 2024Updated 2 years ago
- Agile reading group that works☆13Feb 2, 2022Updated 4 years ago
- A repository for experiments in quality-aware decoding☆18Jun 7, 2022Updated 4 years ago
- Code for EMNLP 2022 Paper: On the Calibration of Massively Multilingual Language Models☆15Jun 12, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆10Dec 18, 2020Updated 5 years ago
- Library for fast text representation and classification. Fix compatibility with numpy 2☆16Nov 21, 2024Updated last year
- ☆42Jul 17, 2018Updated 8 years ago
- Short Text Similarity as described in https://dl.acm.org/citation.cfm?id=2806475☆17Feb 7, 2019Updated 7 years ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆76Apr 1, 2025Updated last year
- Extension for pie to include taggers with their models and pre/postprocessors☆11Jun 23, 2026Updated 4 months ago
- Github for the conference paper GLOD-Gaussian Likelihood OOD detector☆16Apr 18, 2022Updated 4 years ago