A smart distributed crawler that infers navigation models of structured websites, used to cluster pages based on their structure and extract data from them.
☆10Aug 17, 2025Updated 9 months ago
Alternatives and similar repositories for smart-crawler
Users that are interested in smart-crawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Demos for the MiniWoB++ benchmark☆21Feb 23, 2018Updated 8 years ago
- Html article content extractor in Golang.☆12Oct 31, 2022Updated 3 years ago
- A simple application that converts currency☆18Nov 12, 2021Updated 4 years ago
- Eth-initium (ethereum start) is an open source repository for those who want to understand how the ethereum blockchain functions along wi…☆14Dec 10, 2022Updated 3 years ago
- Linux BPF plugins for Volatility3☆23Jan 19, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A support library for Ronin. Like activesupport, but for hacking!☆28Jan 15, 2026Updated 4 months ago
- Gathers Kubernetes cost information for a cluster☆13Dec 18, 2018Updated 7 years ago
- A utility for catching non-deterministic test failures☆17Jul 23, 2024Updated last year
- Rust bindings for rdma-core☆18Apr 4, 2018Updated 8 years ago
- K8S (kubernetes) Network Test Daemonset - checks integrity of your cluster's virtual network☆14Oct 29, 2020Updated 5 years ago
- Pure-Python x86 disassembler, ported to modern Python, with bugfixes☆26Jan 24, 2018Updated 8 years ago
- 使用vue1.x写的博客（前端部分）☆10Aug 23, 2018Updated 7 years ago
- Host a Tor hidden service inside a Docker container without exposing any clearnet ports.☆13Oct 7, 2020Updated 5 years ago
- A Terraform Module for Controlling AWS Config (via CloudFormation)☆10Mar 30, 2017Updated 9 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Demo kafka kubernetes setup + monitoring☆12Jul 8, 2019Updated 6 years ago
- ☆10Oct 15, 2019Updated 6 years ago
- Custom Lambda Authorizer for ApiGateway using Node and Promise Pattern☆13Feb 10, 2019Updated 7 years ago
- Go library for interacting with Atlassian Crowd☆13Aug 31, 2018Updated 7 years ago
- Command line utility for interacting with OAuth2 infrastructure to generate tokens☆19Oct 26, 2022Updated 3 years ago
- Companion application used for dynamically managing the environment variables for a target application.☆16Mar 9, 2016Updated 10 years ago
- A python module to process data for Frame Semantic Parsing☆23Nov 3, 2020Updated 5 years ago
- A minimal Keycloak IdentityProvider implementation of OpenID2 for Steam☆18May 2, 2019Updated 7 years ago
- An Android RSS reader built with Kotlin and Jetpack Compose☆15Jan 25, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Simplifies the task of creating unit tests that depend on an LDAP directory server.☆12Apr 30, 2026Updated 2 weeks ago
- Helper script to encrypt and decrypt data using Amazon KMS☆14Aug 13, 2015Updated 10 years ago
- Korean grammar checker extension for whale browser☆17Mar 8, 2023Updated 3 years ago
- Quick and simple library for creating floating views and activities☆20Jan 7, 2024Updated 2 years ago
- Apache CloudStack EC2 Stack☆15Jan 30, 2023Updated 3 years ago
- Java Binary Executables☆17Aug 21, 2019Updated 6 years ago
- Kobo's version of ODK Collect, for use with KoboToolbox☆23Dec 25, 2025Updated 4 months ago
- SQL over RPC, specifically for SQLite☆10Jul 17, 2018Updated 7 years ago
- Code & Slides for my "Securing Spring Apps with Keycloak" talk at WJAX 2018☆14Dec 6, 2018Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- My Obsidian Homepage Loadout☆49Sep 24, 2025Updated 7 months ago
- A basic Android eBook Reader app with hands off reading feature - use gestures to control the page turn and use automatic scrolling for p…☆13Apr 8, 2021Updated 5 years ago
- Calculator app made with Jetpack Compose☆16Jun 3, 2022Updated 3 years ago
- Spring Cloud example application☆10Oct 7, 2015Updated 10 years ago
- A script for migrating hidden Vault secrets out of an etcd storage backend☆19Jan 28, 2021Updated 5 years ago
- Software Requirement Specification for the Twitter Sentiment Analysis project☆13Feb 11, 2015Updated 11 years ago
- A Java implementation of the Trie data structure☆23May 13, 2018Updated 8 years ago