Alternatives and similar repositories for crawl-to-the-future

Users that are interested in crawl-to-the-future are comparing it to the libraries listed below

• coastalcph / rungsted

  View on GitHub
  Fast structured perceptron sequential labeler
  ☆15Dec 8, 2015Updated 10 years ago
• rmax / databrewer

  View on GitHub
  The missing datasets manager. Like hombrew but for datasets. CLI-tool for search and discover datasets!
  ☆41May 29, 2017Updated 8 years ago
• newslynx / zuckup

  View on GitHub
  get facebook data
  ☆10Sep 14, 2014Updated 11 years ago
• bhavishya235 / Web-Classification

  View on GitHub
  This project deals with hierarchical classification of web pages based on dmoz dataset.
  ☆14Apr 10, 2014Updated 11 years ago
• ldodds / slug

  View on GitHub
  A semantic web crawler
  ☆20Sep 20, 2010Updated 15 years ago
• elsonidoq / fito

  View on GitHub
  Fito is a python library that helps to organize your data so you can access it in a more understandable and easy way
  ☆10Feb 26, 2018Updated 7 years ago
• cx-lukas-salkauskas-x / FastLinks

  View on GitHub
  Fast links parser for Python & Humans
  ☆11Dec 27, 2012Updated 13 years ago
• rodricios / eatiht

  View on GitHub
  An exercise in unsupervised machine learning: Extract Article's Text in HTml documents.
  ☆432Jan 16, 2026Updated last month
• mitll / graph-qube

  View on GitHub
  Pattern-of-Behavior Search Tool
  ☆11Jun 20, 2022Updated 3 years ago
• paulhoule / telepath

  View on GitHub
  System for mining Wikipedia Usage data to read our collective mind
  ☆20Sep 28, 2014Updated 11 years ago
• trickvi / datapackage

  View on GitHub
  Manage and load dataprotocols.org Data Packages
  ☆27Sep 17, 2015Updated 10 years ago
• mitll / vizlinc

  View on GitHub
  Vizlinc
  ☆15Jan 14, 2016Updated 10 years ago
• numercfd / aws-fasi

  View on GitHub
  Failover AWS Spot Instances
  ☆11Dec 8, 2017Updated 8 years ago
• apache / usergrid-javascript

  View on GitHub
  Mirror of Apache usergrid JavaScript SDK
  ☆15Apr 28, 2017Updated 8 years ago
• csarven / linked-sdmx

  View on GitHub
  Linked SDMX
  ☆17Oct 26, 2014Updated 11 years ago
• blaze / datafabric

  View on GitHub
  A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.
  ☆13Feb 12, 2016Updated 10 years ago
• kmi / iserve

  View on GitHub
  iServe is what we refer to as service warehouse which unifies service publication, analysis, and discovery through the use of lightweigh…
  ☆24Feb 18, 2016Updated 9 years ago
• zygmuntz / stardose

  View on GitHub
  A recommender system for GitHub repositories
  ☆14Jun 21, 2014Updated 11 years ago
• csirtfoundry / BulkWhois

  View on GitHub
  Python interfaces to popular bulk WHOIS servers such as Shadowserver and Team Cymru.
  ☆21Sep 12, 2011Updated 14 years ago
• USCDataScience / AgePredictor

  View on GitHub
  Age classification from text using PAN16, blogs, Fisher Callhome, and Cancer Forum
  ☆18Jul 1, 2022Updated 3 years ago
• edsu / whisper-transcript

  View on GitHub
  A Lit web-component for viewing a Whisper JSON transcript file
  ☆14Updated this week
• nournia / wikifier

  View on GitHub
  Links parts of input text to Wikipedia articles
  ☆16Sep 9, 2012Updated 13 years ago
• coastalcph / supersense-data-twitter

  View on GitHub
  Tweets annotated with coarse-grained sense labels (supersenses)
  ☆13Jun 13, 2014Updated 11 years ago
• commoncrawl / commoncrawl-examples

  View on GitHub
  A library of examples showing how to use the Common Crawl corpus (2008-2012, ARC format)
  ☆65Aug 5, 2016Updated 9 years ago
• datalib / libextract

  View on GitHub
  Extract data from websites using basic statistical magic
  ☆505Oct 2, 2020Updated 5 years ago
• socialsensor / storm-focused-crawler

  View on GitHub
  Collects multimedia content shared through social networks.
  ☆19Feb 18, 2015Updated 10 years ago
• the-pudding / last-two-minute-report

  View on GitHub
  ☆16Jun 7, 2018Updated 7 years ago
• idiap / cbrec

  View on GitHub
  Content-based Recommendation Generator
  ☆13Jan 21, 2015Updated 11 years ago
• philippesaade-wmde / WikidataTextEmbedding

  View on GitHub
  Convert Wikidata Items to vector embeddings
  ☆33Oct 1, 2025Updated 4 months ago
• asanoja / segmentations

  View on GitHub
  Tools for web page segmentation. In development
  ☆17Nov 7, 2018Updated 7 years ago
• TellMeFirst / tellmefirst

  View on GitHub
  TellMeFirst is a tool for classifying and enriching textual documents via Linked Open Data.
  ☆25Sep 1, 2022Updated 3 years ago
• alexbyrnes / Datapiece

  View on GitHub
  Investigative tool for extracting relevant areas from many documents
  ☆14Nov 17, 2015Updated 10 years ago
• seagatesoft / sde

  View on GitHub
  Structured Data Extractor. An application to extract structured data from web pages. It uses Data Extraction Based on Partial Tree Alignm…
  ☆49Jun 9, 2012Updated 13 years ago
• Sotera / Datawake

  View on GitHub
  Browser add-on and web server to support collection and analysis of web browsing data.
  ☆14Mar 9, 2016Updated 9 years ago
• seomoz / mltk

  View on GitHub
  mltk - Moz Language Tool Kit
  ☆12Mar 6, 2015Updated 10 years ago
• jmccrae / lemon.patterns

  View on GitHub
  Design patterns for the ontology-lexicon interface using lemon and OWL
  ☆21Jul 27, 2018Updated 7 years ago
• simonw / dcinbox_explorer

  View on GitHub
  A Flask+Elasticsearch UI for exploring the DC Inbox dataset from http://web.stevens.edu/dcinbox/Home.html
  ☆16Jan 21, 2022Updated 4 years ago
• o19s / bearded-wookie

  View on GitHub
  An experiment in visualizing your Solr index via term counts, document counts, and memory usage per field and data type.
  ☆15Feb 13, 2015Updated 11 years ago
• Yelp / fido

  View on GitHub
  Asynchronous HTTP client built on top of Crochet and Twisted
  ☆20Mar 3, 2021Updated 4 years ago