WARC (Web Archive) Input and Output Formats for Hadoop
☆38Dec 7, 2014Updated 11 years ago
Alternatives and similar repositories for warc-hadoop
Users that are interested in warc-hadoop are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Historian's WARC Toolkit☆16May 14, 2015Updated 11 years ago
- Python library for reading ClueWeb09's warc files☆21Sep 6, 2018Updated 7 years ago
- A Python library to simplify batch requests to AWS Services☆12Apr 25, 2020Updated 6 years ago
- This is a TREC evaluation demonstration written for a lecture on information retrieval evaluation.☆24Feb 12, 2018Updated 8 years ago
- Rainfall is an extensible java framework to implement custom DSL based stress and performance tests☆12Mar 31, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- My implementation of the Gilded Kata.☆30Sep 29, 2015Updated 10 years ago
- TREC Core track☆11Jul 5, 2017Updated 9 years ago
- ☆25Apr 6, 2015Updated 11 years ago
- A collection of demonstration languages in Lua/Terra suitable for learning or for forking when creating a new language☆11Aug 27, 2015Updated 10 years ago
- A reinforcement learning package implemented in Torch☆11Jan 24, 2016Updated 10 years ago
- Application for ground-truthing semantic segmentation datasets in PyQt4/OpenCV.☆11Aug 15, 2017Updated 8 years ago
- Hi Spring fans! Welcome to another super short mid-season interregnum installment of Spring Tips in which I introduce a *super* prelimina…☆12Mar 21, 2019Updated 7 years ago
- Arteria is a high performance message channel system for IPC and network communication☆12Jun 21, 2017Updated 9 years ago
- Javascript class to create ajax data tables using a django-tastypie api backend. Includes a way to easily paginate, sort and filter table…☆20Oct 26, 2014Updated 11 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Stanford CoreNLP NER addon for Apache Tika's NamerEntityParser☆13Feb 26, 2022Updated 4 years ago
- Warcbase is an open-source platform for managing analyzing web archives☆162Dec 8, 2017Updated 8 years ago
- Lambda Function to extract EXIF data from images uploaded to an S3 bucket and store it in DynamoDB.☆15Aug 17, 2018Updated 7 years ago
- TREC Real-Time Summarization Tools☆15Jul 19, 2017Updated 9 years ago
- NG Tool is Bash Script to allow create, delete, enable all, disable all, enable single or disable single vhosts for nginx virtual hosts …☆13Dec 15, 2023Updated 2 years ago
- Spring Data Aerospike☆37Jan 30, 2020Updated 6 years ago
- Pure JAX-RS 2.0 ClientRequestFilter/WriterInterceptor used to sign AWS REST requests. Also has presign capabilities.☆15Jan 4, 2022Updated 4 years ago
- ☆10Aug 21, 2015Updated 10 years ago
- Spark Custome Stream Source and Sink☆12Jan 19, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is the source code accompanying my blog post explaining the upside of using pure functions in Java.☆11Nov 5, 2020Updated 5 years ago
- [FFCV-PL] manage fast data loading with ffcv and pytorch lightning☆16Jul 17, 2023Updated 3 years ago
- Generate a graph on Graph Commons from Instagram activity☆10Jan 25, 2016Updated 10 years ago
- Deep Learning (PyTorch) Models Deployment using SQL databases☆10Jul 25, 2021Updated 5 years ago
- Application simulating external APIs for the Practical Rx Workshop☆10May 16, 2015Updated 11 years ago
- Command Line Tool to Help You Send Newsletters by Email☆13Updated this week
- Java library for reading and writing WARC files with a typed API☆60Jun 27, 2026Updated last month
- TWS Market Data Adapter☆20May 10, 2018Updated 8 years ago
- JSON logging configuration for Spring Boot and ELK☆20May 6, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A FUSE module to exposes a Kafka cluster in the filesystem.☆19Feb 3, 2014Updated 12 years ago
- PyLucene with our patches☆15Apr 11, 2012Updated 14 years ago
- Load WARC files into Apache Spark with sparklyr☆12Jan 11, 2022Updated 4 years ago
- Cassandra NoSQL + Bokeh + Prophet for stock time series analysis☆13Jul 13, 2018Updated 8 years ago
- ☆20Jun 15, 2017Updated 9 years ago
- Implement functions to split strings☆13May 12, 2017Updated 9 years ago
- pip install spot-connect. Module that makes it easy to use AWS virtual machines at discount pricing☆21May 7, 2021Updated 5 years ago