domanchi / gibberish-detectorLinks
Train a model, and detect gibberish strings with it.
☆68Updated 3 years ago
Alternatives and similar repositories for gibberish-detector
Users that are interested in gibberish-detector are comparing it to the libraries listed below
Sorting:
- 80x faster and 95% accurate language identification with Fasttext☆164Updated 2 years ago
- Nostril: Nonsense String Evaluator☆199Updated 3 years ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆158Updated last month
- Fast and robust date extraction from web pages, with Python or on the command-line☆145Updated 2 months ago
- Find strings/words in text; convenience and C speed☆126Updated 3 years ago
- Pythonic search engine based on PyLucene.☆132Updated last month
- ☆68Updated 3 years ago
- Multi-Langauge Identification☆28Updated last year
- An open-source package for python to clean raw text data☆74Updated 2 years ago
- Language detection using Spacy and Fasttext☆57Updated 2 years ago
- Targetted language identifier, based on FastText and Hunspell.☆38Updated 4 months ago
- Fuzzy matching and more functionality for spaCy.☆258Updated last year
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆155Updated 2 years ago
- Detecting gibberish as a type of sentiment analysis with GPT2☆25Updated 5 years ago
- 🐍 A CPython extension for the Hyperscan regular expression matching library.☆191Updated last month
- ☆43Updated 2 years ago
- A fully customisable language detection pipeline for spaCy☆93Updated 6 years ago
- This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.☆81Updated 2 years ago
- 🧬 A VS Code extension for annotating data with Prodigy☆30Updated 4 years ago
- Simply, faster, sentence-transformers☆144Updated last year
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …☆86Updated last year
- Named entity recognition for the legal domain☆42Updated 4 years ago
- A fast python implementation of the SimHash algorithm.☆27Updated 4 years ago
- A python package to simulate typographical errors.☆38Updated 2 years ago
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆17Updated 2 years ago
- 🖍️ Highlight text in documents☆111Updated 9 months ago
- Next-generation Punkt sentence boundary detection with zero dependencies☆27Updated 2 months ago
- 🔎 A Prodigy plugin for evaluating spaCy pipelines☆13Updated last year
- Efficient Trie-based regex unions for blacklist/whitelist filtering and one-pass mapping-based string replacing☆76Updated last week