Alternatives and similar repositories for url-frontier

Users that are interested in url-frontier are comparing it to the libraries listed below

• crawler-commons / crawler-commons
  A set of reusable Java components that implement functionality common to any web crawler
  ☆244Updated 2 weeks ago
• iipc / webarchive-commons
  Common web archive utility code.
  ☆55Updated last month
• iipc / jwarc
  Java library for reading and writing WARC files with a typed API
  ☆48Updated 6 months ago
• netarchivesuite / solrwayback
  A search interface and wayback machine for the UKWA Solr based warc-indexer framework.
  ☆114Updated 3 weeks ago
• querqy / querqy
  Query preprocessor for Java-based search engines (Querqy Core and Solr implementation)
  ☆184Updated 3 weeks ago
• ukwa / webarchive-discovery
  WARC and ARC indexing and discovery tools.
  ☆124Updated 3 months ago
• ubleipzig / solrdump
  Export SOLR documents efficiently with cursors.
  ☆38Updated 2 months ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• frictionlessdata / datapackage-java
  A Java library for working with Frictionless Data Data Packages.
  ☆22Updated 2 weeks ago
• apache / commons-rdf
  Apache Commons RDF
  ☆48Updated last week
• apache / any23
  Apache Anything To Triples (Any23) is a library, a web service and a command line tool that extracts structured data in RDF format from a…
  ☆97Updated 2 years ago
• semarglproject / semargl
  Highly performant, lightweight framework for linked data processing. Supports RDFa, JSON-LD, RDF/XML and plain text formats, runs on Andr…
  ☆52Updated 2 years ago
• o19s / pdf-discovery-demo
  Demonstration of searching PDF document with Solr, Tika, and Tesseract
  ☆31Updated 8 months ago
• querqy / chorus
  Towards an open source stack for e-commerce search
  ☆149Updated 3 months ago
• LAW-Unimi / BUbiNG
  The LAW next generation crawler.
  ☆87Updated 3 years ago
• opensemanticsearch / solr-ontology-tagger
  Automatic tagging and analysis of documents in an Apache Solr index for faceted search by RDF(S) Ontologies & SKOS thesauri
  ☆47Updated 3 years ago
• ukwa / shine
  Prototype SOLR-powered web archive exploration UI.
  ☆43Updated 5 years ago
• opensemanticsearch / solr-relevance-ranking-analysis
  Solr Relevance Ranking Analysis and Visualization Tool
  ☆17Updated 5 years ago
• netarchivesuite / netarchivesuite
  Netarchivesuite development
  ☆21Updated 2 months ago
• searchhub / search-collector
  A fast and simple JavaScript library specifically targeted at collecting search and search related browser events.
  ☆40Updated 10 months ago
• Smerity / cc-warc-examples
  CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
  ☆56Updated 4 years ago
• querqy / querqy-elasticsearch
  Querqy for Elasticsearch
  ☆46Updated 2 months ago
• commoncrawl / example-warc-java
  ☆49Updated 8 years ago
• behas / lucene-skos
  SKOS Support for Apache Lucene and Solr
  ☆56Updated 4 years ago
• helgeho / Web2Warc
  An easy-to-use and highly customizable crawler that enables you to create your own little Web archives (WARC/CDX)
  ☆25Updated 7 years ago
• commoncrawl / cc-index-server
  Common Crawl Index Server
  ☆68Updated 3 months ago
• helgeho / ArchiveSpark
  An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed…
  ☆150Updated last week
• CommerceExperts / open-commerce-search
  Framework for building Commerce Search Solutions around open source search technology like Elasticsearch
  ☆41Updated last week
• nla / outbackcdx
  Web archive index server based on RocksDB
  ☆34Updated last month
• mitre / rhapsode
  Advanced desktop search/corpus exploration prototype
  ☆21Updated 4 years ago