Crawling framework, RSS reader and parser
☆257Oct 22, 2026Updated 2 weeks ago
Alternatives and similar repositories for crawler-buddy
Users that are interested in crawler-buddy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Self-hostable link database and RSS reader☆149Sep 25, 2026Updated last month
- Database of Internet places. Mostly domains☆468Updated this week
- CLI recon tool for scraper developers. Detects TLS fingerprinting, JS challenges, bot protection, and rate limits across 4 stages☆44May 23, 2026Updated 5 months ago
- ☆48Jan 3, 2026Updated 10 months ago
- A curated, structured database of RSS feeds☆115Oct 18, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Open‑source alternative to Perplexity Comet, director.ai and firecrawl combined☆180Jul 26, 2026Updated 3 months ago
- Quickly generate an RSS feed from any website☆74Dec 18, 2025Updated 10 months ago
- Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.☆7,132Oct 9, 2026Updated 3 weeks ago
- Scrape Reddit for marketing pain points using GPT — built to fuel Cronlytic's growth.☆216Feb 16, 2026Updated 8 months ago
- Pull reddit data from APIs and store it in local db☆13Aug 9, 2025Updated last year
- A Chrome extension for quick scraping of elements from web pages.☆28Sep 24, 2025Updated last year
- Apache Pekko based web crawler that uses Playwright to crawl websites and extract text data and links for further processing.☆22Jun 3, 2026Updated 5 months ago
- Minimalistic AI-powered web scraping☆17Nov 9, 2025Updated 11 months ago
- Python requests on steroids.☆176Sep 24, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A mobile app for forwarding otps to a server for scraping☆30Jun 6, 2026Updated 5 months ago
- Write code your way while ensuring remote consistency.☆16Jul 3, 2026Updated 4 months ago
- TypeScript library for Google search scraping using http requests with proxy support, pagination, and regional customization. Built for w…☆63Feb 13, 2025Updated last year
- ☆10Jun 3, 2021Updated 5 years ago
- A simple self-hosted RSS reader with AI article summarization feature. 🧶☕️📜☆11Apr 18, 2026Updated 6 months ago
- AI-powered web scraping CLI. Describe what you want, get a production-ready Scrapy spider. Write once, reuse forever.☆117Oct 26, 2026Updated last week
- Self-hosted feed generation toolkit for turning webpages, email folders, APIs, and messy web sources into reliable RSS feeds.☆285Sep 23, 2026Updated last month
- Puppeteer-like API for Android automation - Control Android devices with familiar web automation syntax for testing, scraping, and automa…☆53Jun 19, 2025Updated last year
- MODE (Mixture of Document Experts) is an advanced RAG framework that enhances query response quality by combining hierarchical document c…☆17Sep 3, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A python library for syncing Google Calendar to local storage.☆14Updated this week
- This project is a starter template for building a server-client application using Hono Rpc and TypeScript☆12Jun 19, 2025Updated last year
- Reverse engineered Amazon antibot system called AWSWAF. This also includes a FASTAPI to use it as an API. Used on sites like binance, hug…☆61Mar 14, 2026Updated 7 months ago
- Non sucking cross-platform extremely fast C++ crawler to convert entire websites into LLM readable data☆16Jun 7, 2026Updated 5 months ago
- Browser automation engine benchmark - Test bypass rates, performance & stealth against Cloudflare, DataDome, reCAPTCHA, Kasada, Imperva, …☆416Sep 1, 2026Updated 2 months ago
- Scheduled RSS to Email with Github Actions☆31Aug 21, 2025Updated last year
- wxpath - declarative web crawling with XPath; a Web Query Language (WQL)☆110Sep 30, 2026Updated last month
- ☆26Jul 28, 2026Updated 3 months ago
- High quality data curation for training AI models for robotics☆10Jul 27, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Drop-in replacement for PostgreSQL with surgical, dependency-aware undo of transactions. Makes incident recovery zero-cortisol.☆36Sep 14, 2026Updated last month
- Cross-browser extension for CommaFeed☆26Jun 18, 2023Updated 3 years ago
- SaaS to auto generate alternative text, caption, title & more☆13Updated this week
- Inspired by classic RSS screensavers from the past, RSSence transforms your screen into a dynamic news hub, displaying headlines in a vis…☆104Nov 4, 2025Updated last year
- Interactive documentation tool for building tutorials, guides, and playgrounds using markdown with embedded executable code blocks☆31Jul 25, 2026Updated 3 months ago
- Obsidian plugin for creating notes with templatable filenames☆10Jun 13, 2025Updated last year
- pybond is a spying and stubbing library for python, inspired by the clojure bond library.☆13Mar 3, 2024Updated 2 years ago