Java implementation of the Internet Research Lab Web Crawler (IRLbot) as presented by Hsin-Tsang Lee, Derek Leonard, Xiaoming Wang, and Dmitri Loguinov in their paper "IRLbot: Scaling to 6 Billion Pages and Beyond"
☆17May 25, 2017Updated 9 years ago
Alternatives and similar repositories for JIRLbot
Users that are interested in JIRLbot are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A flexible pure-Java OCR implementation. Eventually.☆20Jan 2, 2015Updated 11 years ago
- The Historian's WARC Toolkit☆16May 14, 2015Updated 11 years ago
- w3act is an annotation and curation tool for building web archive collections☆21Jan 30, 2024Updated 2 years ago
- Scientific articles using or citing Common Crawl data☆31Jul 8, 2026Updated 3 months ago
- ☆25Jul 21, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Blog crawler for the blogforever project.☆23Jan 31, 2014Updated 12 years ago
- WARC (Web Archive) Input and Output Formats for Hadoop☆38Dec 7, 2014Updated 11 years ago
- A set of reusable Java components that implement functionality common to any web crawler☆259Oct 1, 2026Updated last week
- Toys for sifting through large sets of documents.☆13Feb 3, 2017Updated 9 years ago
- A library and command line tool utility to organise your media ( Photos and videos ) better☆16Nov 15, 2018Updated 7 years ago
- [Deprecated] Bitmap utilities for Android☆15Sep 4, 2013Updated 13 years ago
- Sorted grep.☆13Mar 26, 2015Updated 11 years ago
- ☆17May 25, 2015Updated 11 years ago
- Simple Service Discovery Protocol (SSDP) Java Library☆11May 1, 2017Updated 9 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Dataspec for SII☆10Jan 4, 2017Updated 9 years ago
- D-Link DCS-8600LH usage info tools☆13Jan 17, 2020Updated 6 years ago
- Customizable Knowledge Engineering Tool☆13Jun 6, 2016Updated 10 years ago
- Pattern-of-Behavior Search Tool☆11Jun 20, 2022Updated 4 years ago
- Dat link resolver [ DEPRECATED - More info on active projects and modules at https://dat-ecosystem.org/ ]☆18Jan 6, 2022Updated 4 years ago
- A simple demo of Android's new bottom sheet component from the support library.☆18Feb 25, 2016Updated 10 years ago
- An example of how to integrate AndroidAnnotations with Dagger. Experimental.☆15Oct 7, 2012Updated 14 years ago
- A java library for creating standalone, portable, schema-full object databases supporting pagination and faceted search, and offering str…☆17Mar 17, 2017Updated 9 years ago
- Waterwheel is a distributed append-only store supporting millions insertions per second and realtime temporal and key range query☆14Jan 23, 2019Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆12Nov 24, 2017Updated 8 years ago
- Ligthweight generation of protobuf <-> bean mappers☆15Nov 24, 2014Updated 11 years ago
- Common Crawl Index Server☆71Feb 28, 2025Updated last year
- Insight into your Google App Engine datastore costs☆17May 9, 2023Updated 3 years ago
- Faceted Browsing over Wikidata triples☆18Jun 16, 2018Updated 8 years ago
- A command line tool that detect JavaScript file can be bundled.☆17Oct 5, 2026Updated last week
- Documentation parser, doc blocks and annotations (fully compliant with phpDoc and doctrine annotations)☆13Jul 26, 2021Updated 5 years ago
- Go package for grouping items in batches☆21Nov 16, 2016Updated 9 years ago
- 更好的jieba java版☆22Apr 19, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An NIO.2 substitute for Android☆20May 10, 2024Updated 2 years ago
- PETRARCH actor, agent and verb dictionaries☆22Aug 3, 2018Updated 8 years ago
- Common web archive utility code.☆66Oct 1, 2026Updated last week
- Common Issues When Developing Native Reason Projects☆12Aug 6, 2020Updated 6 years ago
- ECMAScript Proposal Diff/Table generate☆11Oct 6, 2026Updated last week
- FWRF is a open source tool for firmware web-side analysis.☆11Aug 27, 2015Updated 11 years ago
- Redis, with SSL/TLS termination, transactions, and more☆17Apr 30, 2018Updated 8 years ago