Alternatives and similar repositories for gibberish-detector

Users that are interested in gibberish-detector are comparing it to the libraries listed below

• michaelharms / comcrawl
  A python utility for downloading Common Crawl data
  ☆243Updated 2 years ago
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆162Updated last year
• darvid / python-hyperscan
  🐍 A CPython extension for the Hyperscan regular expression matching library.
  ☆183Updated 3 weeks ago
• adbar / htmldate
  Fast and robust date extraction from web pages, with Python or on the command-line
  ☆138Updated 3 weeks ago
• coady / lupyne
  Pythonic search engine based on PyLucene.
  ☆129Updated last week
• adbar / courlan
  Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters
  ☆145Updated 8 months ago
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆154Updated 2 years ago
• pmbaumgartner / spacy-html-tokenizer
  ☆69Updated 3 years ago
• alvarobartt / opentrain
  🚂 Fine-tune OpenAI models for text classification, question answering, and more
  ☆16Updated 2 years ago
• hiredscorelabs / seqtolang
  Multi-Langauge Identification
  ☆28Updated last year
• gandersen101 / spaczz
  Fuzzy matching and more functionality for spaCy.
  ☆257Updated last year
• commoncrawl / cc-crawl-statistics
  Statistics of Common Crawl monthly archives mined from URL index files
  ☆188Updated last week
• neuml / txtmarker
  🖍️ Highlight text in documents
  ☆108Updated 4 months ago
• aboSamoor / pycld2
  ☆173Updated 5 months ago
• scrapinghub / product-extraction-benchmark
  ☆16Updated last year
• Abhijit-2592 / spacy-langdetect
  A fully customisable language detection pipeline for spaCy
  ☆93Updated 6 years ago
• opensearch-project / opensearch-py-ml
  ☆51Updated this week
• cocrawler / cdx_toolkit
  A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
  ☆183Updated 7 months ago
• hybridtheory / floc-simhash
  A fast python implementation of the SimHash algorithm.
  ☆27Updated 3 years ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆321Updated last year
• ruanchaves / hashformers
  Hashformers is a framework for hashtag segmentation with Transformers and Large Language Models (LLMs).
  ☆73Updated last year
• weblyzard / inscriptis
  A python based HTML to text conversion library, command line client and Web service.
  ☆315Updated 3 weeks ago
• commoncrawl / cc-pyspark
  Process Common Crawl data with Python and Spark
  ☆440Updated this week
• EdyVision / pii-codex
  A research python package for detecting, categorizing, and assessing the severity of personal identifiable information (PII)
  ☆89Updated last week
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆37Updated 6 months ago
• flairNLP / fabricator
  [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.
  ☆110Updated last year
• Senzing / awesome
  Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
  ☆61Updated this week
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆63Updated last year
• Snowflake-Labs / arctic-embed
  ☆76Updated 8 months ago
• richardpaulhudson / coreferee
  Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…
  ☆126Updated last year