Library for fast text representation and classification.
☆31Jan 9, 2024Updated 2 years ago
Alternatives and similar repositories for fasterText
Users that are interested in fasterText are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Aug 23, 2024Updated 2 years ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆76Apr 1, 2025Updated last year
- Targetted language identifier, based on FastText and Hunspell.☆38Sep 4, 2025Updated last year
- A Python utility for indexing file lines. Best demo honourable mention at ECIR 2024.☆23Nov 9, 2025Updated 11 months ago
- Extracts plain text, language identification and more metadata from WARC records☆22Apr 16, 2026Updated 6 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆58Feb 3, 2026Updated 8 months ago
- NTREX -- News Test References for MT Evaluation☆88Jun 5, 2024Updated 2 years ago
- A Grapheme to Phoneme model using LSTM implemented in pytorch☆15Jul 6, 2022Updated 4 years ago
- Efficient teacher-student models and scripts to make them☆58Dec 16, 2023Updated 2 years ago
- Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenization [ACL 2026]☆20Apr 18, 2026Updated 6 months ago
- Bicleaner fork that uses neural networks☆41Feb 23, 2026Updated 8 months ago
- A collection of public presentations from the Common Crawl Foundation☆13Feb 2, 2026Updated 8 months ago
- Generate shader code (for Shadertoy website) displaying path in provided SVG file.☆10Feb 24, 2026Updated 8 months ago
- Lightweight Python utility for retrieving individual pages from the Common Crawl archives.☆11Feb 21, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Efficient Low-Memory Aligner☆148Jan 15, 2025Updated last year
- The pipeline for the OSCAR corpus☆178Nov 9, 2025Updated 11 months ago
- Code for NeurIPS 2023 paper "Non-autoregressive Machine Translation with Probabilistic Context-free Grammar".☆12Jan 4, 2024Updated 2 years ago
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.☆40Feb 5, 2026Updated 8 months ago
- [WWW 2026] 🕸 GlotWeb: Web Indexing for Minority Languages☆17Apr 14, 2026Updated 6 months ago
- Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ …☆72Aug 24, 2026Updated 2 months ago
- Internet Archive's Sparkling Data Processing Library☆17May 4, 2026Updated 5 months ago
- A C++ library implementing fast language models estimation using the 1-Sort algorithm.☆16May 18, 2023Updated 3 years ago
- ☆32Nov 22, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fast and simple server to host state-of-the-art retrieval models☆15Jun 4, 2026Updated 4 months ago
- ☆40Apr 17, 2024Updated 2 years ago
- ☆17Oct 2, 2026Updated 3 weeks ago
- Implementation of the paper "Deep Indexed Active Learning for Matching Heterogeneous Entity Representations"☆16Dec 20, 2021Updated 4 years ago
- c++ mosestokenizer☆18Mar 13, 2024Updated 2 years ago
- Examples for using the Daft data engine☆15Oct 23, 2026Updated last week
- data related codebase for polyglot project☆19Mar 30, 2023Updated 3 years ago
- A tool that locates, downloads, and extracts machine translation corpora☆167Apr 13, 2026Updated 6 months ago
- ☆16Jun 13, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Command Line Interactive Periodic Table of Elements in multiple languages☆17Mar 28, 2023Updated 3 years ago
- Transform TMX to text☆27Nov 23, 2022Updated 3 years ago
- collaborative web tool to enrich content☆11Nov 13, 2011Updated 14 years ago
- Stanford CoreNLP NER addon for Apache Tika's NamerEntityParser☆13Feb 26, 2022Updated 4 years ago
- 🌸 fastText + Bloom embeddings for compact, full-coverage vectors with spaCy☆347Apr 25, 2025Updated last year
- Code for our project CROWN (Conversational Passage Ranking by Reasoning over Word Networks)☆10Jan 11, 2024Updated 2 years ago
- Efficient, Extensible kNN-MT Framework☆19Sep 7, 2024Updated 2 years ago