This is a Java library which can be used to crawl the content of some of web properties (www.salesforce.com, blogs.salesforce.com for example). It supports dynamic scaling (depending on available machine power (CPU, RAM) and network capacity) out of the box. It also has a Plugin structure, which allows others to write code (plugins) that act on …
☆26May 15, 2025Updated last year
Alternatives and similar repositories for SiteCrawler
Users that are interested in SiteCrawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- mihai surdeanu's Semantic Role Labeler. Updated headers to be gcc > 4.3 compatible.☆11Oct 22, 2012Updated 14 years ago
- The SRL-based Open IE extractor. A principal component of Open IE 4.0.☆19Oct 31, 2017Updated 9 years ago
- Adds a $log.table method to the $logProvider allowing output of sortable tables to the Chrome Dev Tools console☆10Jan 26, 2014Updated 12 years ago
- Fureteur is a simple, configurable, fault-tolerant web crawler written is Scala☆29Oct 14, 2014Updated 12 years ago
- A Play Framework plugin for the Pusher REST API.☆10Oct 11, 2011Updated 15 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Python Liberal XSPF parser☆11Feb 2, 2010Updated 16 years ago
- A Java Google App Engine library for the Pusher REST API (http://www.pusherapp.com)☆11Jun 2, 2011Updated 15 years ago
- Secure REST service to index, search, retrieve and aggregate content from heterogeneous sources.☆20Oct 3, 2024Updated 2 years ago
- ☆11Apr 24, 2013Updated 13 years ago
- iOS objective-c sample of grabbing all contacts from your addressbook, displaying on tableview and allowing filtering and multi-select on…☆10Apr 15, 2015Updated 11 years ago
- google language translate library☆16Nov 9, 2011Updated 14 years ago
- A NLP (natural language processing) toolkit in javascript☆13Dec 4, 2024Updated last year
- ☆12Feb 12, 2022Updated 4 years ago
- 分布式消息总线 (iOS平台)☆15Dec 28, 2017Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The pam_ldap module provides the means for Solaris and Linux servers and workstations to authenticate against LDAP directories, and to ch…☆14Jul 1, 2024Updated 2 years ago
- TexNLP: Texas Natural Language Processing tools☆14Jan 14, 2012Updated 14 years ago
- Rapid Realistic Routing on Real-world and Reimagined networks☆13Jan 6, 2023Updated 3 years ago
- Crawl an entire domain with Zillabyte☆17Aug 6, 2014Updated 12 years ago
- Parse, modify, and create change logs☆20Jun 2, 2021Updated 5 years ago
- A semantic analysis tool to generate synonym.txt files for Solr. [RETIRED]☆25Sep 14, 2016Updated 10 years ago
- eXist-db JMS based messaging and document replication extension (JMS based)☆15Oct 21, 2026Updated 2 weeks ago
- Lightweight threads for Java, with message passing, nio, http and scheduling support.☆21Nov 5, 2010Updated 16 years ago
- Connect with fellow conference attendees from your geo-aware mobile device.☆20Aug 11, 2012Updated 14 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10Jul 10, 2026Updated 3 months ago
- ☆19Jun 23, 2015Updated 11 years ago
- 🧝♀️ A MacDown plugin that formats your headings and offers shorthand syntax for callouts, images, and links.☆12Dec 3, 2018Updated 7 years ago
- YARE is a rules engine for Java that simplifies processing rules☆27Jul 12, 2025Updated last year
- Vert.x 2.x is deprecated - use instead☆16Nov 2, 2016Updated 10 years ago
- 数据驱动视图开发在 Android 平台的实现☆23Dec 28, 2017Updated 8 years ago
- Generate your pages statically without using payload extractors.☆17Aug 7, 2024Updated 2 years ago
- Cyberinfrastructure Shell (CIShell) is an open source, community-driven framework/application for the integration and utilization of data…