Crawling framework, RSS reader and parser
☆250Aug 10, 2026Updated this week
Alternatives and similar repositories for crawler-buddy
Users that are interested in crawler-buddy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆43Feb 20, 2026Updated 5 months ago
- Self-hostable link database and RSS reader☆142Jul 13, 2026Updated last month
- ☆43Jan 3, 2026Updated 7 months ago
- CLI recon tool for scraper developers. Detects TLS fingerprinting, JS challenges, bot protection, and rate limits across 4 stages☆42May 23, 2026Updated 2 months ago
- Database of Internet places. Mostly domains☆433Aug 6, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A curated, structured database of RSS feeds☆93Updated this week
- ☆18Nov 24, 2025Updated 8 months ago
- Quickly generate an RSS feed from any website☆73Dec 18, 2025Updated 7 months ago
- ☆16Nov 26, 2025Updated 8 months ago
- Scrape Reddit for marketing pain points using GPT — built to fuel Cronlytic's growth.☆205Feb 16, 2026Updated 5 months ago
- Pull reddit data from APIs and store it in local db☆13Aug 9, 2025Updated last year
- Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.☆7,020Updated this week
- A Chrome extension for quick scraping of elements from web pages.☆28Sep 24, 2025Updated 10 months ago
- TypeScript library for Google search scraping using http requests with proxy support, pagination, and regional customization. Built for w…☆63Feb 13, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- HTTP Proxy that allows you to define the IP address at connect time☆20Jan 11, 2026Updated 7 months ago
- Minimalistic AI-powered web scraping☆17Nov 9, 2025Updated 9 months ago
- wxpath - declarative web crawling with XPath; a Web Query Language (WQL)☆111Jul 9, 2026Updated last month
- AI-powered CLI that analyzes websites and generates real Playwright web scrapers with built-in data quality checks☆35Jul 1, 2026Updated last month
- MODE (Mixture of Document Experts) is an advanced RAG framework that enhances query response quality by combining hierarchical document c…☆17Sep 3, 2025Updated 11 months ago
- Python requests on steroids.☆175May 7, 2025Updated last year
- Reverse engineered Amazon antibot system called AWSWAF. This also includes a FASTAPI to use it as an API. Used on sites like binance, hug…☆59Mar 14, 2026Updated 5 months ago
- AI-powered web scraping CLI. Describe what you want, get a production-ready Scrapy spider. Write once, reuse forever.☆114Updated this week
- Puppeteer-like API for Android automation - Control Android devices with familiar web automation syntax for testing, scraping, and automa…☆52Jun 19, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Cloudflare Turnstile solver & bypass — Python, real Chrome browser, no paid APIs. Local HTTP API service included. Auto-solves invisible …☆91Mar 31, 2026Updated 4 months ago
- Self-hosted feed generation toolkit for turning webpages, email folders, APIs, and messy web sources into reliable RSS feeds.☆284May 26, 2026Updated 2 months ago
- Reverse-engineering AI assistant for the Web☆160Aug 7, 2026Updated last week
- ☆26Jul 28, 2026Updated 2 weeks ago
- "fast" sqlite to parquet and csv converter☆32Nov 5, 2025Updated 9 months ago
- A completely free and independent mobile RSS reader with no algorithmic timeline☆20Jul 12, 2025Updated last year
- Miniflux client that deliveres updates to email.☆30Jan 17, 2026Updated 6 months ago
- Cross-browser extension for CommaFeed☆25Jun 18, 2023Updated 3 years ago
- Node and browser-based code that helps developers support OPML in outliners, feed readers and renderers.☆41Dec 8, 2025Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Interactive documentation tool for building tutorials, guides, and playgrounds using markdown with embedded executable code blocks☆30Jul 25, 2026Updated 3 weeks ago
- A Model Context Protocol (MCP) server library that gives LLMs access to information about a candidate.☆81Jun 10, 2026Updated 2 months ago
- A Chrome extension for web scraping with visual element selection and data export.☆24Sep 17, 2025Updated 10 months ago
- Scrape.md is a Python package that allows you to scrape text from any website and generate a comprehensive summary of the text using Ope…☆14Nov 24, 2024Updated last year
- Powerful Google Maps Crawler / Scraper tool with REST API, Docker support & multi-format export☆84Jun 16, 2026Updated last month
- JavaScript library for "fuzzy" HTML data extraction based on templates☆44Dec 25, 2025Updated 7 months ago
- Inspired by classic RSS screensavers from the past, RSSence transforms your screen into a dynamic news hub, displaying headlines in a vis…☆104Nov 4, 2025Updated 9 months ago