Faster, modernized fork of the language identification tool langid.py
☆68Oct 28, 2026Updated this week
Alternatives and similar repositories for py3langid
Users that are interested in py3langid are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Next-generation Punkt sentence boundary detection with zero dependencies☆32Sep 28, 2026Updated last month
- The toolkit called magyarlanc aims at the basic linguistic processing of Hungarian texts. The toolkit consists of only JAVA modules (the…☆13Jun 21, 2016Updated 10 years ago
- Stylometric framework in Python☆17Apr 9, 2015Updated 11 years ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆180Sep 1, 2026Updated 2 months ago
- Downloading all files of a language from the OSCAR (Open Super-large Crawled Aggregated coRpus)☆11Feb 28, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Integration between Reaction ECommerce and Accelerated Text to provide product descriptions for an e-shop.☆13Feb 22, 2021Updated 5 years ago
- A python library for easily querying morphological inflection models trained on Unimorph☆13Oct 23, 2022Updated 4 years ago
- Library for fast text representation and classification.☆31Jan 9, 2024Updated 2 years ago
- The home repository of the NerKor corpus, a Hungarian gold standard named entity annotated corpus containing 1 million tokens.☆16Sep 20, 2023Updated 3 years ago
- Tools for compiling corpora from Common Crawl☆14Nov 24, 2024Updated last year
- [WWW 2026] 🕸 GlotWeb: Web Indexing for Minority Languages☆17Apr 14, 2026Updated 6 months ago
- Extracts plain text, language identification and more metadata from WARC records☆22Apr 16, 2026Updated 6 months ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆159Updated this week
- Combining encoder-based language models☆11Nov 11, 2021Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Aug 13, 2019Updated 7 years ago
- Some useful scripts to run ipptool commands against printers☆13Feb 8, 2017Updated 9 years ago
- 🤘Lemmy is a lemmatizer for Danish 🇩🇰 and Swedish 🇸🇪☆80Sep 20, 2021Updated 5 years ago
- Targetted language identifier, based on FastText and Hunspell.☆38Sep 4, 2025Updated last year
- The most accurate natural language detection library for Python, suitable for short text and mixed-language text☆1,815Jul 20, 2026Updated 3 months ago
- Automatically exported from code.google.com/p/hunpos☆12Apr 9, 2018Updated 8 years ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆219Updated this week
- Corpus of Hungarian poems in TEI XML with machine annotation☆10Sep 29, 2025Updated last year
- Convert an imscc file to a folder with all the content with proper structure☆11Jul 4, 2016Updated 10 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A library to evaluate factual correctness of abstractive summaries.☆11Dec 2, 2022Updated 3 years ago
- A micro service that allows to compile *Tex-files via HTTP☆13Mar 11, 2018Updated 8 years ago
- ☆11Sep 27, 2024Updated 2 years ago
- ☆13Oct 28, 2022Updated 4 years ago
- An evaluation of word-embeddings for classification☆32Feb 19, 2019Updated 7 years ago
- A compute framework for building Search, RAG, Recommendations and Analytics over complex (structured+unstructured) data, with ultra-modal…☆12Sep 16, 2024Updated 2 years ago
- Multilingual library to easily parse date strings to java.util.Date objects.☆34Sep 4, 2019Updated 7 years ago
- مجموعة من الكُنَّاشات على Google Colab تسمح للمستخدمين بأداء المهام بشكل أسرع☆10Jan 4, 2025Updated last year
- A list where most values will be None (or default)☆11Oct 25, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Easily crawl news portals or blog sites using Storm Crawler.☆22Nov 15, 2022Updated 3 years ago
- Terminal tool that converts files encoding to UTF-8☆10Oct 5, 2019Updated 7 years ago
- A gem for memoization in Ruby.☆16Aug 4, 2026Updated 2 months ago
- e-magyar text processing system -- inter-module communication via tsv + REST API☆33Aug 23, 2025Updated last year
- A parallel evaluation data set of SAP software documentation with document structure annotation☆15Jun 12, 2026Updated 4 months ago
- ☆13Sep 1, 2023Updated 3 years ago
- ☆14Updated this week