An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
☆86Apr 21, 2021Updated 4 years ago
Alternatives and similar repositories for goclassy
Users that are interested in goclassy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The pipeline for the OSCAR corpus☆176Nov 9, 2025Updated 4 months ago
- Converter from UD-trees to BART representation☆35Mar 6, 2024Updated 2 years ago
- Ukrainian ELECTRA model☆12Mar 11, 2023Updated 3 years ago
- German GPT-2 model☆32Aug 17, 2021Updated 4 years ago
- Highly specialized crate to parse and use `google/sentencepiece` 's precompiled_charsmap in `tokenizers`☆21Jan 8, 2026Updated 2 months ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Analytic platform for the HAL research archive (in development)☆13Oct 2, 2020Updated 5 years ago
- Tools to download and cleanup Common Crawl data☆1,038Apr 25, 2023Updated 2 years ago
- Specification of a stand-off element for the TEI guidelines☆12Apr 29, 2021Updated 4 years ago
- Minimal code to train ELMo models in recent versions of TensorFlow☆14Apr 30, 2023Updated 2 years ago
- ☆13Mar 27, 2020Updated 6 years ago
- A Knowledge Base for research software relying on large-scale text mining and curated knowledge sources☆17May 14, 2023Updated 2 years ago
- ☆18Mar 20, 2022Updated 4 years ago
- Bouton ISTEX : extension web capable d'insérer dynamiquement sur la page web consultée un lien vers le fulltext d'un document si ce dern…☆11May 30, 2023Updated 2 years ago
- Python source code for EMNLP 2021 Findings paper: "Subword Mapping and Anchoring Across Languages".☆13Sep 17, 2021Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13Dec 11, 2021Updated 4 years ago
- UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…☆31Dec 5, 2022Updated 3 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆359Feb 22, 2022Updated 4 years ago
- speech engine training projects☆29Apr 19, 2021Updated 4 years ago
- Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework☆52Feb 1, 2020Updated 6 years ago
- ☆12Dec 8, 2022Updated 3 years ago
- Inter-annotator agreement for Doccano☆28May 3, 2020Updated 5 years ago
- NLP library designed for reproducible experimentation management☆294Jul 25, 2024Updated last year
- ☆40May 2, 2021Updated 4 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Corpus preprocessing☆100Mar 16, 2024Updated 2 years ago
- Python source code for EMNLP 2020 paper "Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT".☆35Mar 16, 2022Updated 4 years ago
- A Keras version of Google's BERT model☆35Nov 4, 2019Updated 6 years ago
- Natural language detection, Java bindings for CLD2☆17Feb 26, 2026Updated last month
- Parallel Universal Dependencies.☆15Nov 12, 2025Updated 4 months ago
- MultiCQA: Zero-Shot Transfer of Self-Supervised Text Matching Models on a Massive Scale☆14Mar 22, 2021Updated 5 years ago
- ☆12Nov 15, 2016Updated 9 years ago
- Viewer for the 🤗 datasets library.☆86Jul 30, 2021Updated 4 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆160Jun 18, 2024Updated last year
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆45Nov 3, 2019Updated 6 years ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆225Dec 20, 2022Updated 3 years ago
- Open Thai Wikipedia QA Dataset made by iApp Technology☆14Feb 17, 2021Updated 5 years ago
- ☆99Jul 7, 2020Updated 5 years ago
- ☆14Sep 10, 2021Updated 4 years ago
- Standalone pre-training recipe with JAX+Flax☆35Apr 3, 2023Updated 2 years ago
- New dataset☆311Aug 31, 2021Updated 4 years ago