Alternatives and similar repositories for BUbiNG:

Users that are interested in BUbiNG are comparing it to the libraries listed below

• Norconex / crawlers
  Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…
  ☆188Updated this week
• Smerity / cc-warc-examples
  CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
  ☆56Updated 4 years ago
• deezer / weslang
  A language detection Web Service
  ☆53Updated 7 years ago
• searchhub / preDict
  Lightning fast spell correction / fuzzy search library based on SymSpell by Commerce-Experts
  ☆81Updated 6 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• commoncrawl / cc-warc-examples
  CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
  ☆38Updated 4 months ago
• mapio / py-web-graph
  A simple package allowing to use WebGraph data in Python (via the Jython interpreter).
  ☆19Updated 4 years ago
• helgeho / Web2Warc
  An easy-to-use and highly customizable crawler that enables you to create your own little Web archives (WARC/CDX)
  ☆24Updated 7 years ago
• crawler-commons / crawler-commons
  A set of reusable Java components that implement functionality common to any web crawler
  ☆244Updated 3 weeks ago
• ikreymer / cdx-index-client
  A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
  ☆189Updated 6 years ago
• o19s / splainer-search
  Angular JS Solr and Elasticsearch and OpenSearch Diagnostic Search Services
  ☆26Updated last month
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆118Updated last month
• commoncrawl / commoncrawl-crawler
  The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
  ☆213Updated 2 years ago
• commoncrawl / cc-index-server
  Common Crawl Index Server
  ☆68Updated last month
• crawler-commons / url-frontier
  API definition, resources and reference implementation of URL Frontiers
  ☆48Updated this week
• Anant / awesome-solr
  A curated list of Awesome Apache Solr links and resources.
  ☆107Updated 3 years ago
• commoncrawl / nutch
  Common Crawl fork of Apache Nutch
  ☆33Updated 3 weeks ago
• diffbot / wikistatsextractor
  Extract statistics from Wikipedia Dump files.
  ☆26Updated 3 years ago
• MighTguY / customized-symspell
  Java port of SymSpell: 1 million times faster through Symmetric Delete spelling correction algorithm
  ☆67Updated 4 years ago
• rholder / nilsimsa
  This module contains an implementation of the Nilsimsa locality-sensitive hashing algorithm in Java.
  ☆18Updated 5 years ago
• USCDataScience / SentimentAnalysisParser
  Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.
  ☆34Updated last year
• spinscale / cookiecutter-elasticsearch-ingest-processor
  A cookiecutter template for an elasticsearch ingest processor plugin
  ☆47Updated 2 years ago
• Anant / awesome-lucene
  A curated list of Awesome Apache Lucene links and resources.
  ☆26Updated 6 years ago
• openpreserve / pagelyzer
  Suite of tools for detecting changes in web pages and their rendering
  ☆54Updated last year
• ept / warc-hadoop
  WARC (Web Archive) Input and Output Formats for Hadoop
  ☆35Updated 10 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆56Updated last year
• lucidworks / auto-phrase-tokenfilter
  Lucene Auto Phrase TokenFilter implementation
  ☆59Updated 6 years ago
• solrpl / solrgraph
  Visualization of result returning by Solr 6 graph query
  ☆10Updated 8 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• InteractiveAdvertisingBureau / taxonomy
  Machine-readable Taxonomies with ID mappings
  ☆65Updated 7 years ago