Easily crawl news portals or blog sites using Storm Crawler.
☆22Nov 15, 2022Updated 3 years ago
Alternatives and similar repositories for crawling-framework
Users that are interested in crawling-framework are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multilingual library to easily parse date strings to java.util.Date objects.☆32Sep 4, 2019Updated 6 years ago
- Beagle helps you identify keywords, phrases, regexes, and complex search queries of interest in streams of text documents.☆55Jun 30, 2021Updated 4 years ago
- Accelerated Text is a no-code natural language generation platform. It will help you construct document plans which define how your data …☆806Mar 10, 2023Updated 3 years ago
- Clojure wrapper for the `jackson-jq `. Embed `jq` scripts into your app. Compatible with GraalVM native-image.☆21Sep 29, 2023Updated 2 years ago
- Dataset of Lithuania legal entities☆14Nov 21, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Convert a number to an approximated text expression: from '0.23' to 'less than a quarter'.☆200Jan 20, 2021Updated 5 years ago
- A Domain Specific Language (DSL) for building language patterns. These can be later compiled into spaCy patterns, pure regex, or any othe…☆69Apr 14, 2026Updated last month
- Opinionated command line argument handling, with excellent support for subcommands☆53Apr 10, 2026Updated last month
- A Java library that can do URL normalization, unshorten URL, and URL extraction.☆19Oct 19, 2017Updated 8 years ago
- Clojure LLM - Dataset curation for fine tuning an LLM for Clojure.☆17Jun 12, 2023Updated 2 years ago
- Mavuno: A Hadoop-Based Text Mining Toolkit☆48Feb 7, 2012Updated 14 years ago
- API definition, resources and reference implementation of URL Frontiers☆60May 18, 2026Updated last week
- GOPHI: an AMR-to-English Verbalizer☆11Feb 5, 2020Updated 6 years ago
- Ready-to-use examples of dkpro-core components and pipelines.☆35Dec 16, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Zulia Search Engine☆36May 20, 2026Updated last week
- A package to simplify the thread declaration directly either by using decorator or pass it through function. It also allows you to stop t…☆14Aug 5, 2025Updated 9 months ago
- A robots.txt parser written in Clojure.☆16Dec 15, 2011Updated 14 years ago
- w3act is an annotation and curation tool for building web archive collections☆21Jan 30, 2024Updated 2 years ago
- ☆13Oct 16, 2025Updated 7 months ago
- A set of machine learning experiments in Clojure☆30Nov 30, 2012Updated 13 years ago
- About Web accessible Chrome inside an Debian Container☆49May 19, 2026Updated last week
- Tooling to build LLM applications: prompt templating and composition, agents, LLM memory, and other instruments for builders of AI applic…☆371Jan 8, 2026Updated 4 months ago
- GraalVM GitHub action☆13Jun 25, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Polyglot workflows without leaving the comfort of your technology stack.☆862Apr 3, 2023Updated 3 years ago
- Linguistic slovak stemmer based on Lucene stemmers☆11Apr 15, 2016Updated 10 years ago
- Demo using Apache Lucene has a reverse geocoder, running as a CLI app via Graal, AWS Lambda or Google Cloud Run☆12Apr 20, 2021Updated 5 years ago
- The Clojure programming language☆15May 13, 2026Updated 2 weeks ago
- A graph database built on top of mysql using a node adjacency table and joins for traversal.☆19May 9, 2010Updated 16 years ago
- A tool to assign Sustainable Development Goals to a scientific abstract☆18Feb 25, 2021Updated 5 years ago
- Finnish language analysis for Elasticsearch using Raudikko☆12Mar 4, 2026Updated 2 months ago
- ArchiveWeb.page Express!☆14Nov 1, 2024Updated last year
- Explorations relative to cloning FlumeJava☆94Oct 13, 2020Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A Clojure code formatter using cljfmt built with graalvm.☆16May 7, 2018Updated 8 years ago
- Przyjazne forum webmasterskie☆14Jun 28, 2016Updated 9 years ago
- A collection of GGUF and quantizations for jina-embeddings-v4☆37Sep 18, 2025Updated 8 months ago
- Docker Compose based system for running remote browsers (including Flash and Java support) connected to web archives☆16Jun 10, 2021Updated 4 years ago
- Distributed restful text mining.☆22Jan 19, 2016Updated 10 years ago
- Dockerized Stanford Core NLP scala server☆14Jun 19, 2015Updated 10 years ago
- GPT model token counter, with extra support for OpenAI's completion API☆23Jul 21, 2025Updated 10 months ago