These are lists for a variety of languages containing words that are distinctive to each language.
☆42Apr 5, 2022Updated 4 years ago
Alternatives and similar repositories for TF-IDF-IIF-top100-wordlists
Users that are interested in TF-IDF-IIF-top100-wordlists are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tool for translating wikipedia articles into other languages☆17Jun 20, 2010Updated 16 years ago
- Creating super-parallel corpora of more than 1500+ unique languages for NLP research☆33Dec 8, 2022Updated 3 years ago
- generate rules from lists of words☆16Jul 9, 2021Updated 5 years ago
- universal tokenizer☆17Nov 29, 2021Updated 4 years ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆76Apr 1, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository contains the source code and links to some datasets used in the CoNLL 2019 paper "Learning to Represent Bilingual Diction…☆12Oct 1, 2020Updated 5 years ago
- Python module for interacting with Wikipedia's API with an interest in multilingual capabilities☆17Jan 13, 2010Updated 16 years ago
- Toki Pona corpus for NLTK☆15Dec 29, 2018Updated 7 years ago
- Code for "BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognition"☆32Jun 20, 2023Updated 3 years ago
- [WWW 2026] 🕸 GlotWeb: Web Indexing for Minority Languages☆17Apr 14, 2026Updated 4 months ago
- ☆26Feb 26, 2023Updated 3 years ago
- ☆16Oct 4, 2024Updated last year
- ☆18Feb 1, 2023Updated 3 years ago
- ☆17Nov 20, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Python package for Natural Language Processing (NLP), focused on low-resource languages spoken in Mexico.☆24Sep 4, 2025Updated last year
- Trigram files for 500+ languages☆24Mar 21, 2025Updated last year
- The pipeline for the OSCAR corpus☆178Nov 9, 2025Updated 9 months ago
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆26Nov 4, 2022Updated 3 years ago
- A word alignment tool based on famous GIZA++, extended to support multi-threading, resume training and incremental training.☆167May 12, 2021Updated 5 years ago
- [LREC 2024] 🖋 Resource and Tool for Writing System Identification☆23Mar 29, 2026Updated 5 months ago
- Dataset of sentences from Hindi stories tagged with different emotion tags☆11Nov 26, 2019Updated 6 years ago
- A library for fetching and reading Tatoeba's weekly exports☆24Feb 5, 2026Updated 7 months ago
- downloads and parses subtitle dataset from opensubtitles.org☆15Apr 19, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- code to remove "noise" from hOCR output of Tesseract OCR.☆14Oct 24, 2016Updated 9 years ago
- Extensible DL-based automatic Arabic diacritization tool allowing the restoration of different types of diacritics.☆24Jul 25, 2023Updated 3 years ago
- Documents produced by the Digital Publishing Interest Group☆14Apr 3, 2019Updated 7 years ago
- How to add direction and language metadata to strings☆16Jul 19, 2026Updated last month
- OpusFilter - Parallel corpus processing toolkit☆116Jul 1, 2026Updated 2 months ago
- Multilingual Open Text☆27May 8, 2025Updated last year
- FontForge Simplepolator based on Pablo Impallari's script for FontLab/RoboFont☆14May 19, 2020Updated 6 years ago
- ☆13May 2, 2018Updated 8 years ago
- More Information about Features, Deliverables and Publications @☆11May 17, 2016Updated 10 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- a repository containing the details of natural language inference dataset in Hindi☆14Dec 28, 2020Updated 5 years ago
- A set of pipelines for performing experiments on various NLP tasks with a focus on resource-poor/minority languages.☆37Updated this week
- TRAPPIST: Totally Rad Analysis Pipelines Python Informatics Super Tool (actually, a python-based genomics analysis toolbox)☆14Jan 25, 2018Updated 8 years ago
- TensorFlow implementation of Barlow Twins (https://arxiv.org/abs/2103.03230).☆41Jun 11, 2021Updated 5 years ago
- ☆23Apr 8, 2022Updated 4 years ago
- Tools to isolate speaker and transcribe unstructured audio clips☆11Dec 4, 2022Updated 3 years ago
- Korean BERT model using character tokenizer☆27Apr 8, 2021Updated 5 years ago