CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆56Apr 26, 2021Updated 5 years ago
Alternatives and similar repositories for cc-warc-examples
Users that are interested in cc-warc-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- WARC (Web Archive) Input and Output Formats for Hadoop☆38Dec 7, 2014Updated 11 years ago
- Common web archive utility code.☆66Updated this week
- Tools to analyze web archives☆20Jul 12, 2016Updated 10 years ago
- ☆14Jan 3, 2024Updated 2 years ago
- Quick starter guide for java based Natural Language Processing training, saving model, loading model and inference.☆12Jul 9, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The Historian's WARC Toolkit☆16May 14, 2015Updated 11 years ago
- Because we're all tired of answering questions when people should clearly RTFM.☆15Aug 28, 2016Updated 10 years ago
- Neural Solr = Solr 9 + Mighty Inference + Node☆18Jun 9, 2022Updated 4 years ago
- RediSearch demo based on data from discogs.com☆11Aug 1, 2020Updated 6 years ago
- API to store Spring Batch (version 3+) job execution data in MongoDB☆12Jun 25, 2022Updated 4 years ago
- Saves proxied HTTP traffic to a WARC file.☆28Oct 22, 2013Updated 13 years ago
- How deep does Google Analytics go? Efficiently tackling Common Crawl using AWS & MapReduce☆17Feb 5, 2014Updated 12 years ago
- This is a NLP pipeline based on RedisGears☆14Mar 26, 2023Updated 3 years ago
- Dresden Web Table Corpus Java library☆11Jun 16, 2015Updated 11 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆178Aug 18, 2025Updated last year
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Aug 12, 2018Updated 8 years ago
- Transaction scoring demo with RedisAI☆18May 15, 2024Updated 2 years ago
- Form builder integrated with Camunda☆11Jun 2, 2017Updated 9 years ago
- ggtikz: Add TikZ annotations with absolute data or relative plot coordinates to ggplots☆11Nov 6, 2025Updated last year
- fork of .net port and adaptation of libots, initially by PatrickBurrows☆20Aug 15, 2019Updated 7 years ago
- Source code and data files for "PEMT: A patent enrichment tool with applicability in drug discovery"☆17Sep 28, 2026Updated last month
- ☆11Jan 15, 2016Updated 10 years ago
- A library of examples showing how to use the Common Crawl corpus (2008-2012, ARC format)☆67Aug 5, 2016Updated 10 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A queue-controlled browser automation tool for improving web crawl quality☆69Nov 6, 2026Updated last week
- Merged search-arctika and search-achon into a multi-module project☆14May 20, 2022Updated 4 years ago
- My personal blog, generated using Hakyll☆11Apr 5, 2021Updated 5 years ago
- ☆15Jul 5, 2022Updated 4 years ago
- Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in t…☆134Nov 21, 2025Updated 11 months ago
- UPenn Talk about Julia and ML☆14Nov 14, 2014Updated 12 years ago
- Generic framework for information extraction tasks, including recognition of named entities, temporal expressions, spatial expressions an…☆13Jun 5, 2023Updated 3 years ago
- Comet Marc21 to RDF conversion and publishing project code dump.☆12Oct 16, 2012Updated 14 years ago
- mahout-scala-api-samples☆10Apr 28, 2014Updated 12 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- some scripts and things for processing scanned books☆13Nov 28, 2013Updated 12 years ago
- Web-based page layout editor created for EMOP (Early Modern OCR Project).☆11May 21, 2021Updated 5 years ago
- Vector Plugin for Solr: calculate dot product / cosine similarity on documents☆16Oct 24, 2018Updated 8 years ago
- scanning script for the noisebridge book scanner☆14May 12, 2017Updated 9 years ago
- The functional group identification toolkits for ChemDFM-R☆14Dec 29, 2025Updated 10 months ago
- ☆12Nov 5, 2026Updated 2 weeks ago
- VisNAB☆12Apr 5, 2013Updated 13 years ago
Are these results useful?