domanchi / gibberish-detectorLinks
Train a model, and detect gibberish strings with it.
☆64Updated 3 years ago
Alternatives and similar repositories for gibberish-detector
Users that are interested in gibberish-detector are comparing it to the libraries listed below
Sorting:
- Pythonic search engine based on PyLucene.☆128Updated 8 months ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆142Updated 7 months ago
- A python package to simulate typographical errors.☆36Updated last year
- 80x faster and 95% accurate language identification with Fasttext☆160Updated last year
- Efficient Trie-based regex unions for blacklist/whitelist filtering and one-pass mapping-based string replacing☆74Updated last month
- 🐍 A CPython extension for the Hyperscan regular expression matching library.☆183Updated this week
- Fast and robust date extraction from web pages, with Python or on the command-line☆136Updated last week
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆154Updated 2 years ago
- Language detection using Spacy and Fasttext☆57Updated last year
- A python utility for downloading Common Crawl data☆242Updated 2 years ago
- ☆69Updated 3 years ago
- A helper library full of URL-related heuristics.☆70Updated 2 months ago
- 🍏 Make Thinc faster on macOS by calling into Apple's native Accelerate library☆99Updated last month
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- A research python package for detecting, categorizing, and assessing the severity of personal identifiable information (PII)☆89Updated 2 years ago
- Common crawl extractor☆78Updated last year
- 🔎 A Prodigy plugin for evaluating spaCy pipelines☆13Updated last year
- 🧬 A VS Code extension for annotating data with Prodigy☆30Updated 3 years ago
- An open-source package for python to clean raw text data☆70Updated 2 years ago
- ☆172Updated 4 months ago
- ☆76Updated 7 months ago
- A python based HTML to text conversion library, command line client and Web service.☆315Updated this week
- 🖍️ Highlight text in documents☆109Updated 3 months ago
- Python package for deduplication/entity resolution using active learning☆81Updated 11 months ago
- This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.☆80Updated last year
- A fully customisable language detection pipeline for spaCy☆93Updated 6 years ago
- Multi-Langauge Identification☆28Updated last year
- Next-generation Punkt sentence boundary detection with zero dependencies☆17Updated this week
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆16Updated 2 years ago
- Email Datasets can be found here☆69Updated 5 years ago