CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆38Aug 2, 2026Updated last month
Alternatives and similar repositories for cc-warc-examples
Users that are interested in cc-warc-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Launch AWS Elastic MapReduce jobs that process Common Crawl data.☆49Feb 15, 2017Updated 9 years ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆54Jun 12, 2020Updated 6 years ago
- Common web archive utility code.☆65Updated this week
- Set of scripts to aid in the download of the GDELT data files from www.gdeltproject.org☆12May 17, 2014Updated 12 years ago
- Demonstrations of markdown presentation features to the GitPitch community.☆10Jul 24, 2019Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A Python library to simplify batch requests to AWS Services☆12Apr 25, 2020Updated 6 years ago
- Rainfall is an extensible java framework to implement custom DSL based stress and performance tests☆13Mar 31, 2026Updated 5 months ago
- Code for the paper Faster Phrase-Based Decoding by Refining Feature State☆14Jan 9, 2023Updated 3 years ago
- QWIQ is a Quick Work Item Query library for Team Foundation Server / Visual Studio Online.☆14Jul 17, 2026Updated last month
- AWS Lambda precomiled binaries for lxml 3.6.4 built for python 2.7 and python 3.6 runtimes☆12Apr 17, 2019Updated 7 years ago
- A simple Node.js wrapper for the BitX API.☆11Jun 23, 2022Updated 4 years ago
- The Dynamic Rules Engine is a serverless application that enables real-time evaluation of rules against sensor data, leveraging AWS Kines…☆11Sep 25, 2024Updated last year
- Index Common Crawl archives in tabular format☆132Updated this week
- Goblin OGM on top of TinkerPop 3☆11Jul 20, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Implementation of W3C's R2RML and Direct Mapping specifications☆10Oct 12, 2020Updated 5 years ago
- My attempt to learn more than one Deep Learning framework☆15Apr 7, 2019Updated 7 years ago
- AWS Lambda layer containing latest version of Apache Tika☆14Aug 22, 2026Updated last week
- Set of scripts to aid in the download of the GDELT data files from gdelt.utdallas.edu☆18May 14, 2014Updated 12 years ago
- This repository contains a series of 4 jupyter notebooks demonstrating how AWS AI Services like Amazon Rekognition, Amazon Transcribe and…☆12Nov 26, 2021Updated 4 years ago
- A bidirectional LSTM example for sequence labeling.☆13May 23, 2018Updated 8 years ago
- Virtual patent marking crawler at iproduct.epfl.ch☆15Sep 13, 2017Updated 8 years ago
- Several scripts to analyse Wikidata dumps☆33Apr 7, 2014Updated 12 years ago
- Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends☆57Jan 28, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A Hadoop job that runs GATE applications☆15Oct 16, 2013Updated 12 years ago
- A simple CDK app written in Kotlin using Gradle DSL☆12Dec 28, 2018Updated 7 years ago
- A sample Java web app that implements the client credential auth flow to call Microsoft Graph.☆10Dec 3, 2022Updated 3 years ago
- Ready-to-use examples of dkpro-core components and pipelines.☆34Dec 16, 2023Updated 2 years ago
- Huawei IDEOS build configuration☆14Dec 9, 2016Updated 9 years ago
- ☆15Jul 24, 2026Updated last month
- Add interfaces to classes generated by other plugins☆16Jul 1, 2023Updated 3 years ago
- CIKM Cup 2016 (1st Place) - Track 1 - Cross Device Entity Linking☆18Sep 19, 2017Updated 8 years ago
- AWS Batch solution for processing S3 events taking longer than 15 minutes☆24Apr 9, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Materiały do szkolenia: HADOOP Projektowanie rozwiązań Big Data z wykorzystaniem Apache Hadoop & Family☆17Oct 18, 2022Updated 3 years ago
- A general purpose metrics monitor implemented with Apache Spark. Kafka source, Elastic sink, aggregate metrics, different analysis, notif…☆18Nov 19, 2018Updated 7 years ago
- This repository contains sample code to help you extend your LSF cluster to the cloud. It provides fully functional examples of how to s…☆16Dec 17, 2025Updated 8 months ago
- FPGA code for NeTV2☆16Dec 3, 2018Updated 7 years ago
- admin-ui-boshrelease☆17Mar 16, 2017Updated 9 years ago
- Process Common Crawl data with Python and Spark☆458Mar 26, 2026Updated 5 months ago
- Pure JAX-RS 2.0 ClientRequestFilter/WriterInterceptor used to sign AWS REST requests. Also has presign capabilities.☆15Jan 4, 2022Updated 4 years ago