Alternatives and similar repositories for distributed-web-crawler:

Users that are interested in distributed-web-crawler are comparing it to the libraries listed below

• tonywangcn / ten-million-domains
  27.6% of the Top 10 Million Sites are Dead
  ☆105Updated 4 months ago
• spider-rs / spider-py
  Spider ported to Python
  ☆71Updated 2 months ago
• johnbalvin / gobnb
  Airbnb scraper made in Go
  ☆34Updated 2 weeks ago
• tamboto2000 / golinkedin
  Golinkedin is a library written in pure golang for scraping Linkedin
  ☆41Updated 11 months ago
• gosom / scrapemate
  Golang Crawling and scraping framework
  ☆108Updated last month
• johnbalvin / gozon
  Amazon crawler made in Go
  ☆39Updated 2 weeks ago
• practical-data-science / ShopifyScraper
  Shopify Scraper package to extract all products from a Shopify site and return them in a Pandas dataframe.
  ☆30Updated last year
• omkarcloud / botasaurus-starter
  🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
  ☆23Updated last month
• tech-engine / goscrapy
  GoScrapy: Harnessing Go's power for blazingly fast web scraping, inspired by Python's Scrapy framework.
  ☆95Updated 2 weeks ago
• tkattkat / google-search-scraper
  TypeScript library for Google search scraping using http requests with proxy support, pagination, and regional customization. Built for w…
  ☆29Updated last month
• ContextData / VectorETL
  Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications
  ☆91Updated 5 months ago
• instructor-ai / instructor-go
  structured outputs for llms
  ☆137Updated 7 months ago
• ryszard / agency
  Agency: Robust LLM Agent Management with Go
  ☆66Updated last year
• sanders41 / meilisearch-tui
  A TUI for Managing and Searching with Meilisearch
  ☆16Updated this week
• DataDog / documentor
  Improve technical documentation with the power of AI.
  ☆30Updated 3 weeks ago
• supermassivedb / supermassive
  A distributed in-memory, durable key value database designed for massive amounts of critical data and low latency.
  ☆57Updated last month
• TheGP / Everything-About-Captchas
  Curated list of everything related to captchas, including libraries, solvers and scoring
  ☆26Updated 8 months ago
• customeros / mailsherpa
  CLI to verify an if an email address is deliverable. Uses SMTP to validate email addresses without sending an email.
  ☆20Updated 2 weeks ago
• TheWebScrapingClub / TheScrapingClubFree
  The Web Scraping Club Free Repository
  ☆137Updated 4 months ago
• getdera / dera
  Data Encoding and Representation Analysis
  ☆40Updated last year
• semanser / JsonGenius
  Get structured JSON data from any page.
  ☆175Updated last year
• apify / super-scraper
  Generic REST API for scraping websites. Drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!
  ☆25Updated 4 months ago
• docqai / docq
  Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.
  ☆62Updated 5 months ago
• lawzava / scrape
  CLI utility to scrape emails from websites
  ☆159Updated last year
• mmatongo / chew
  Chew is a Go library for processing various content types into markdown/plaintext.
  ☆41Updated last month
• anhnmt / backup-pg2minio
  Backup PostgreSQL to MinIO
  ☆16Updated last month
• sausheong / breeze
  A simple ChatGPT clone built using Go
  ☆36Updated last year
• gitpack-ai / gitpack-ai
  Automate Pull Request Reviews with AI 🪄
  ☆59Updated 2 weeks ago
• MicahParks / magiclinksdev
  Transactional email magic link and One-Time Password (OTP) authentication platform. Sign up, log in, password resets, email verification,…
  ☆30Updated 2 months ago
• kiselitza / progzee
  Progzee is a Python library for simplifying IP proxy usage in HTTP requests.
  ☆16Updated last month