Easily crawl news portals or blog sites using Storm Crawler.
☆22Nov 15, 2022Updated 3 years ago
Alternatives and similar repositories for crawling-framework
Users that are interested in crawling-framework are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Easily run HTTP GET requests against a list of URLs to check their HTTP status.☆12Sep 4, 2019Updated 7 years ago
- Integration between Reaction ECommerce and Accelerated Text to provide product descriptions for an e-shop.☆13Feb 22, 2021Updated 5 years ago
- Multilingual library to easily parse date strings to java.util.Date objects.☆34Sep 4, 2019Updated 7 years ago
- Beagle helps you identify keywords, phrases, regexes, and complex search queries of interest in streams of text documents.☆55Jun 30, 2021Updated 5 years ago
- Leiningen template for AWS Lambda custom runtime with GraalVM native image compiled Clojure projects.☆45Oct 5, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Accelerated Text is a no-code natural language generation platform. It will help you construct document plans which define how your data …☆805Mar 10, 2023Updated 3 years ago
- Clojure wrapper for the `jackson-jq `. Embed `jq` scripts into your app. Compatible with GraalVM native-image.☆21Sep 29, 2023Updated 3 years ago
- Convert a number to an approximated text expression: from '0.23' to 'less than a quarter'.☆200Jan 20, 2021Updated 5 years ago
- Python wrapper for Accelerated Text☆12Oct 5, 2021Updated 5 years ago
- A Domain Specific Language (DSL) for building language patterns. These can be later compiled into spaCy patterns, pure regex, or any othe…☆72Oct 25, 2026Updated last week
- CommonCrawl Test version of Nutch☆16Jul 10, 2014Updated 12 years ago
- A curated list of resources dedicated to Natural Language Generation (NLG)☆483Sep 22, 2026Updated last month
- Storm / Solr Integration☆19Feb 2, 2024Updated 2 years ago
- Visualize pipeline definitions for AWS Data Pipeline☆23Feb 3, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Run Mattermost on Heroku☆35Sep 19, 2022Updated 4 years ago
- Convert powerpoint (pptx) files into raw text org or LaTeX files☆15Aug 28, 2018Updated 8 years ago
- Access to HuggingFace datasets via Clojure☆15Dec 30, 2025Updated 10 months ago
- GOPHI: an AMR-to-English Verbalizer☆12Feb 5, 2020Updated 6 years ago
- A http proxy demo written with Rust/Tokio☆16Sep 17, 2020Updated 6 years ago
- Ready-to-use examples of dkpro-core components and pipelines.☆34Dec 16, 2023Updated 2 years ago
- common crawl quick hack examples☆19Feb 11, 2015Updated 11 years ago
- Set up your GitHub Actions workflow with a specific version of babashka☆14Jul 7, 2021Updated 5 years ago
- GraalVM GitHub action☆13Jun 25, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- StrapiRuby is a Ruby wrapper gem around Strapi REST API. #hacktoberfest☆15Jul 20, 2025Updated last year
- Simple background tasks for Django☆21Jun 4, 2023Updated 3 years ago
- Chinese Tokenizer module for Python☆16Jul 3, 2018Updated 8 years ago
- Experimental Distributed Web Crawling with Python + Gearman☆22May 2, 2012Updated 14 years ago
- Tooling to build LLM applications: prompt templating and composition, agents, LLM memory, and other instruments for builders of AI applic…☆379Sep 30, 2026Updated last month
- A GitHub action for use with tools.deps based Clojure projects☆10Jul 30, 2021Updated 5 years ago
- Opinionated command line argument handling, with excellent support for subcommands☆60Aug 24, 2026Updated 2 months ago
- A robots.txt parser written in Clojure.☆16Dec 15, 2011Updated 14 years ago
- The Solr Package Directory and Sanctuary☆13May 28, 2026Updated 5 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Demo using Apache Lucene has a reverse geocoder, running as a CLI app via Graal, AWS Lambda or Google Cloud Run☆12Apr 20, 2021Updated 5 years ago
- Morphological analysis of Finnish language for Java☆15Feb 20, 2024Updated 2 years ago
- Create and manipulate PDFs on the fly with iText/OpenPDF☆11Updated this week
- A simple accounting applications for Django☆19Sep 13, 2013Updated 13 years ago
- Finnish language analysis for Elasticsearch using Raudikko☆14Sep 16, 2026Updated last month
- A tool to assign Sustainable Development Goals to a scientific abstract☆18Feb 25, 2021Updated 5 years ago
- Load-testing framework for writing load/stress test scenarios in c#☆21Aug 28, 2024Updated 2 years ago