Common Crawl fork of Apache Nutch
☆44Oct 20, 2026Updated last week
Alternatives and similar repositories for nutch
Users that are interested in nutch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Dec 11, 2024Updated last year
- A neural dependency parser that does its best☆17Updated this week
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆226Dec 22, 2022Updated 3 years ago
- Poor man's simple harvester for arXiv resources☆14Jul 14, 2023Updated 3 years ago
- A browser extension providing Open Access bibliographical services☆18Dec 9, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A robust web archive analytics toolkit☆152Updated this week
- Web archiving utility library☆12Oct 1, 2026Updated last month
- Natural language detection, Java bindings for CLD2☆20Aug 2, 2026Updated 2 months ago
- WARC (Web Archive) Input and Output Formats for Hadoop☆38Dec 7, 2014Updated 11 years ago
- Library for Distributed Retrieval☆15Feb 21, 2014Updated 12 years ago
- A Nutch 2.2.1 plugin which allows users to shuffle off the responsibility for retrieving pages to a selenium hub/node spoke system. This …☆16Jun 9, 2016Updated 10 years ago
- Extracts plain text, language identification and more metadata from WARC records☆22Apr 16, 2026Updated 6 months ago
- Train transformer-based models.☆28Apr 12, 2026Updated 6 months ago
- The server component of LogUI, a framework-agnostic JavaScript library for logging user interactions on webpages.☆17Feb 3, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Grobid module for superconductor material and properties extraction☆25Sep 2, 2026Updated 2 months ago
- Material for git workshop☆12Mar 13, 2018Updated 8 years ago
- A polite and user-friendly downloader for Common Crawl data☆98Updated this week
- A Topic Modeling algorithm that extracts the core topics from a text corpus. Implements the algorithm described in R. S. Randhawa, P. Jai…☆11Jan 7, 2017Updated 9 years ago
- normalize.css (from http://necolas.github.com/normalize.css/)☆12Mar 1, 2024Updated 2 years ago
- GROBID extension for identifying and normalizing physical quantities.☆86Sep 13, 2026Updated last month
- Crawlera tools☆26Feb 9, 2016Updated 10 years ago
- ☆14Sep 7, 2021Updated 5 years ago
- ☆14Jun 15, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Keeping It Simple is Hard☆11Feb 12, 2024Updated 2 years ago
- CVS import of qemacs for some experiments☆11Oct 2, 2022Updated 4 years ago
- Script in Python that scrapes the comments from top posts of a subreddit and calculates the most commonly used words☆17Dec 6, 2018Updated 7 years ago
- Load, build and explore Patstat using the Google Cloud Platform☆10Jan 19, 2019Updated 7 years ago
- Material parsers and other tools, scripts Initially developed for Grobid Superconductor☆14Feb 21, 2025Updated last year
- A half-day workshop on Scalding, the Scala API for Cascading☆12Mar 25, 2016Updated 10 years ago
- Terminal tool that converts files encoding to UTF-8☆10Oct 5, 2019Updated 7 years ago
- A machine learning software for extracting astronomical entities from scholarly documents☆10Oct 31, 2022Updated 4 years ago
- Bouton ISTEX : extension web capable d'insérer dynamiquement sur la page web consultée un lien vers le fulltext d'un document si ce dern…☆11May 30, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆18Aug 9, 2025Updated last year
- Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in t…☆134Nov 21, 2025Updated 11 months ago
- Repository hosting the common code for the entity-fishing clients☆10May 18, 2026Updated 5 months ago
- News crawling with StormCrawler - stores content as WARC☆382Updated this week
- A scalable, mature and versatile web crawler based on Apache Storm☆1,011Updated this week
- Food-Biomarker Ontology defines the relationships between foods and their associated metabolites (biomarkers) through a formal ontology☆19May 3, 2022Updated 4 years ago
- Extract text information from warc files☆12Sep 1, 2022Updated 4 years ago