Alternatives and similar repositories for memex-program-index:

Users that are interested in memex-program-index are comparing it to the libraries listed below

• VIDA-NYU / domain_discovery_tool
  This repository contains the Domain Discovery Tool (DDT) project. DDT is an interactive system that helps users explore and better unders…
  ☆46Updated 3 years ago
• TeamHG-Memex / Formasaurus
  Formasaurus tells you the type of an HTML form and its fields using machine learning
  ☆118Updated 7 months ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆55Updated last year
• usc-isi-i2 / dig-etl-engine
  Download DIG to run on your laptop or server.
  ☆101Updated 6 years ago
• nasa-jpl-memex / memex-explorer
  Viewers for statistics and dashboarding of Domain Search Engine data
  ☆122Updated 9 years ago
• helgeho / ArchiveSpark
  An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed…
  ☆148Updated 4 months ago
• ukwa / webarchive-discovery
  WARC and ARC indexing and discovery tools.
  ☆121Updated 5 months ago
• netarchivesuite / solrwayback
  A search interface and wayback machine for the UKWA Solr based warc-indexer framework.
  ☆107Updated 2 weeks ago
• nasa-jpl-memex / memex-gate
  General Architecture for Text Engineering
  ☆46Updated 8 years ago
• ikreymer / cdx-index-client
  A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
  ☆182Updated 6 years ago
• sangaline / scrapy-wayback-machine
  A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
  ☆112Updated 11 months ago
• trivio / common_crawl_index
  Index URLs in Common Crawl
  ☆194Updated 7 years ago
• TeamHG-Memex / undercrawler
  A generic crawler
  ☆78Updated 6 years ago
• cocrawler / cdx_toolkit
  A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
  ☆166Updated 3 weeks ago
• machawk1 / awesome-memento
  A list of things related to software, literature, and other content for 🕣 Memento
  ☆94Updated 8 months ago
• chrismattmann / imagecat
  ImageCat is an Apache OODT RADIX application that uses Apache Solr, Apache Tika and Apache OODT to ingest 10s of millions of files (image…
  ☆94Updated 6 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• datatogether / research
  📚 A compilation of research relevant to Data Together's efforts tackling the general problem of data resilience & interactivity
  ☆96Updated 6 years ago
• usc-isi-i2 / etk
  Extraction Toolkit
  ☆82Updated 3 years ago
• TeamHG-Memex / autologin
  A project to attempt to automatically login to a website given a single seed
  ☆123Updated 2 years ago
• VIDA-NYU / ache
  ACHE is a web crawler for domain-specific search.
  ☆460Updated last year
• gwu-libraries / sfm-ui
  Social Feed Manager user interface application.
  ☆155Updated 7 months ago
• N0taN3rd / Squidwarc
  Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
  ☆171Updated 4 years ago
• credcoalition / community-site
  community site
  ☆16Updated 6 years ago
• osome-iu / hoaxy-frontend
  Frontend component for Hoaxy, a tool to visualize the spread of claims and fact checking
  ☆72Updated 2 years ago
• opensemanticsearch / open-semantic-visual-graph-explorer
  Open Semantic Visual Linked Data Graph Explorer: Open Source tool (web app) and user interace (UI) for discovery, exploration and visuali…
  ☆83Updated 5 years ago
• TeamHG-Memex / docker-tor-rotator
  A rotating socks proxy using Tor, Delegate and Haproxy
  ☆14Updated 5 years ago
• trendsci / linkrun
  LinkRun - Data Engineering project done in 3 weeks during the Insight fellowship
  ☆38Updated 4 years ago
• Sotera / newman
  Quickly analyze and explore email with advanced analytics and visualization.
  ☆56Updated 3 years ago
• mitll / topic-clustering
  ☆43Updated 9 years ago