WARC (Web Archive) Input and Output Formats for Hadoop
☆38Dec 7, 2014Updated 11 years ago
Alternatives and similar repositories for warc-hadoop
Users that are interested in warc-hadoop are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A flexible pure-Java OCR implementation. Eventually.☆20Jan 2, 2015Updated 11 years ago
- The Historian's WARC Toolkit☆16May 14, 2015Updated 11 years ago
- A Python library to simplify batch requests to AWS Services☆12Apr 25, 2020Updated 6 years ago
- Rainfall is an extensible java framework to implement custom DSL based stress and performance tests☆12Mar 31, 2026Updated 3 months ago
- ☆25Jul 17, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Blog crawler for the blogforever project.☆23Jan 31, 2014Updated 12 years ago
- IPython Notebook for Sentiment Classification☆10Nov 12, 2014Updated 11 years ago
- ☆19Feb 7, 2016Updated 10 years ago
- TREC Core track☆11Jul 5, 2017Updated 9 years ago
- A set of reusable Java components that implement functionality common to any web crawler☆259Jul 2, 2026Updated 2 weeks ago
- bindings to some parts of opencv to lua+torch☆15Feb 14, 2013Updated 13 years ago
- A simple CDK app written in Kotlin using Gradle DSL☆12Dec 28, 2018Updated 7 years ago
- Launch AWS Elastic MapReduce jobs that process Common Crawl data.☆49Feb 15, 2017Updated 9 years ago
- The shared memory version of the Alternating Directions Implicit Solver for Isogeometric Analysis☆10Jan 26, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A reinforcement learning package implemented in Torch☆11Jan 24, 2016Updated 10 years ago
- Stanford CoreNLP NER addon for Apache Tika's NamerEntityParser☆13Feb 26, 2022Updated 4 years ago
- Spring Cloud Data Flow Streaming Example☆10Mar 17, 2018Updated 8 years ago
- Concurrent and distributed Prolog via join patterns (join calculus)☆12Mar 10, 2015Updated 11 years ago
- Hi Spring fans! Welcome to another super short mid-season interregnum installment of Spring Tips in which I introduce a *super* prelimina…☆12Mar 21, 2019Updated 7 years ago
- Arteria is a high performance message channel system for IPC and network communication☆12Jun 21, 2017Updated 9 years ago
- Generate a graph on Graph Commons from Instagram activity☆10Jan 25, 2016Updated 10 years ago
- Warcbase is an open-source platform for managing analyzing web archives☆162Dec 8, 2017Updated 8 years ago
- Lambda Function to extract EXIF data from images uploaded to an S3 bucket and store it in DynamoDB.☆15Aug 17, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- TREC Real-Time Summarization Tools☆15Jul 19, 2017Updated 9 years ago
- Spring Data Aerospike☆37Jan 30, 2020Updated 6 years ago
- ☆10Aug 21, 2015Updated 10 years ago
- Simple app to manage currencies conversion in Django using openexchangerates.org service.☆10Nov 17, 2014Updated 11 years ago
- [FFCV-PL] manage fast data loading with ffcv and pytorch lightning☆16Jul 17, 2023Updated 3 years ago
- This is the source code accompanying my blog post explaining the upside of using pure functions in Java.☆11Nov 5, 2020Updated 5 years ago
- Deep Learning (PyTorch) Models Deployment using SQL databases☆10Jul 25, 2021Updated 4 years ago
- Java library for reading and writing WARC files with a typed API☆60Jun 27, 2026Updated 3 weeks ago
- ☆16Aug 8, 2014Updated 11 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- TWS Market Data Adapter☆20May 10, 2018Updated 8 years ago
- A FUSE module to exposes a Kafka cluster in the filesystem.☆19Feb 3, 2014Updated 12 years ago
- Matcher for json and json template. Can help you with testing of REST API, Database, 3d party systems etc☆15Apr 24, 2021Updated 5 years ago
- ☆24Jul 13, 2022Updated 4 years ago
- PyLucene with our patches☆15Apr 11, 2012Updated 14 years ago
- Load WARC files into Apache Spark with sparklyr☆12Jan 11, 2022Updated 4 years ago
- A short ScalaCheck tutorial for the Programming Principles course☆14Oct 4, 2021Updated 4 years ago