gosom / scrapemateLinks
Golang Crawling and scraping framework
☆188Updated this week
Alternatives and similar repositories for scrapemate
Users that are interested in scrapemate are comparing it to the libraries listed below
Sorting:
- The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler☆124Updated last year
- Automated web scraping spider generation using Browser Use and LLMs. Streamline the creation of Playwright-based spiders with minimal man…☆210Updated 4 months ago
- CLI utility to scrape emails from websites☆171Updated last month
- go-trafilatura is a Go port of the trafilatura Python library.☆114Updated 3 months ago
- Self-hosted version of Microsoft's OmniParser Image-to-text model☆82Updated 7 months ago
- TypeScript library for Google search scraping using http requests with proxy support, pagination, and regional customization. Built for w…☆59Updated 10 months ago
- Run a content embedding analysis with Gemini's 3k dimensions model with Claude 3.7 Sonnet Thinking☆30Updated 8 months ago
- An AI agent that writes SEO-optimised blog posts and outputs a properly formatted markdown document.☆72Updated 10 months ago
- A high-performance proxy rotation engine with automated IP management and real-time health monitoring☆238Updated last month
- Open-source plug-and-play blogging platform. Launch SEO-friendly blogs, changelogs, and write newsletters without coding. 🔥☆125Updated 2 weeks ago
- Reverse Engineered Twitter's API☆80Updated 2 years ago
- Detects the presence of anti-bot and fingerprinting technologies on websites by analyzing requests, headers, cookies, and more. Built on …☆54Updated last year
- Get structured JSON data from any page.☆178Updated 2 years ago
- Open source SEO audit tool.☆616Updated 3 months ago
- anti-bot-detection with rod☆309Updated last year
- New way for collect information from the API's/Websites☆123Updated 8 months ago
- n8n node to interact with browserless instance☆205Updated last year
- ➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are compl…☆627Updated 7 months ago
- Generate high-quality articles for your blog using a SERP workflow and AI☆294Updated last year
- Scrape the Twitter frontend API without authentication with Golang.☆235Updated 8 months ago
- Discover Exceptional MCP Servers☆282Updated 4 months ago
- Undetected web-scraping & seamless HTML parsing in Python!☆334Updated 5 months ago
- ☆258Updated 5 months ago
- Headless browser - reliable high performance setup for cloud providers like Fargate, CloudRun, K8, and more.☆77Updated last week
- pyppeteer stealth plugin, attempts to look like a normal browser☆25Updated last year
- A fork of https://github.com/AtuboDad/playwright_stealth☆157Updated last week
- Amazon crawler made in Go☆40Updated 9 months ago
- Undetectable browser automation in Docker using Python/Zendriver. Full VNC debugging support.☆72Updated 6 months ago
- codex port in Go☆43Updated 8 months ago
- Puppeteer-like API for Android automation - Control Android devices with familiar web automation syntax for testing, scraping, and automa…☆45Updated 6 months ago