CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆38Mar 12, 2026Updated 2 months ago
Alternatives and similar repositories for cc-warc-examples
Users that are interested in cc-warc-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Launch AWS Elastic MapReduce jobs that process Common Crawl data.☆49Feb 15, 2017Updated 9 years ago
- Common web archive utility code.☆63May 2, 2026Updated 3 weeks ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆53Jun 12, 2020Updated 5 years ago
- Events and Situations Ontology☆14Apr 20, 2018Updated 8 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Aug 12, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Goblin OGM on top of TinkerPop 3☆11Jul 20, 2023Updated 2 years ago
- Several scripts to analyse Wikidata dumps☆33Apr 7, 2014Updated 12 years ago
- Implementation of W3C's R2RML and Direct Mapping specifications☆10Oct 12, 2020Updated 5 years ago
- Index Common Crawl archives in tabular format☆128Updated this week
- A simple Node.js wrapper for the BitX API.☆11Jun 23, 2022Updated 3 years ago
- AWS Lambda layer containing latest version of Apache Tika☆14Jul 10, 2025Updated 10 months ago
- Content and Instructions for completing the "Making Things Right with AWS Lambda and AWS Config Rules" Workshop.☆22Nov 27, 2017Updated 8 years ago
- ☆15Apr 29, 2026Updated 3 weeks ago
- This repository contains a series of 4 jupyter notebooks demonstrating how AWS AI Services like Amazon Rekognition, Amazon Transcribe and…☆12Nov 26, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A library of examples showing how to use the Common Crawl corpus (2008-2012, ARC format)☆66Aug 5, 2016Updated 9 years ago
- A SPARQL client for Amazon Neptune that includes AWS Signature Version 4 signing. Implemented as an RDF4J repository.☆23Updated this week
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆225Dec 22, 2022Updated 3 years ago
- Internet Object vs. JSON data size benchmark☆20Nov 6, 2025Updated 6 months ago
- ☆20Jan 19, 2019Updated 7 years ago
- PETRARCH actor, agent and verb dictionaries☆22Aug 3, 2018Updated 7 years ago
- CIKM Cup 2016 (1st Place) - Track 1 - Cross Device Entity Linking☆18Sep 19, 2017Updated 8 years ago
- AI-powered YouTube video analysis toolkit using MCP. Extract transcripts, generate knowledge graphs, generate high-quality detailed note…☆14Jul 5, 2025Updated 10 months ago
- ☆15Jul 1, 2025Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repository contains sample code to help you extend your LSF cluster to the cloud. It provides fully functional examples of how to s…☆16Dec 17, 2025Updated 5 months ago
- Virtual patent marking crawler at iproduct.epfl.ch☆15Sep 13, 2017Updated 8 years ago
- A whirlwind tour of Common Crawl's data using Python☆44Apr 13, 2026Updated last month
- Pure JAX-RS 2.0 ClientRequestFilter/WriterInterceptor used to sign AWS REST requests. Also has presign capabilities.☆15Jan 4, 2022Updated 4 years ago
- ☆33Nov 14, 2013Updated 12 years ago
- ☆14Mar 19, 2025Updated last year
- Two simple cheatsheets about graphs in SPARQL☆15May 29, 2020Updated 5 years ago
- Process Common Crawl data with Python and Spark☆454Mar 26, 2026Updated last month
- ☆14Jul 7, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Jun 13, 2024Updated last year
- Triple Pattern Fragment server that uses Blazegraph as backend☆14May 20, 2023Updated 3 years ago
- admin-ui-boshrelease☆17Mar 16, 2017Updated 9 years ago
- Stupid Experiments in Elasticsearch Image Search☆14Oct 18, 2019Updated 6 years ago
- JSON logging configuration for Spring Boot and ELK☆20May 6, 2017Updated 9 years ago
- A set of reusable Java components that implement functionality common to any web crawler☆257Updated this week
- Terrafrom ONTAP provider☆22May 18, 2026Updated last week