xelzmm/proxy_server_crawler external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

xelzmm/proxy_server_crawler

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/xelzmm/proxy_server_crawler)

Close

xelzmm / proxy_server_crawlerView on GitHubMore

• External links
• Readme badge

an awesome public proxy server crawler based on scrapy framework

☆91May 17, 2017Updated 8 years ago

Alternatives and similar repositories for proxy_server_crawler

Users that are interested in proxy_server_crawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• scrapy-plugins / scrapy-pagestorage

  View on GitHub
  A scrapy extension to store requests and responses information in storage service
  ☆27Mar 11, 2022Updated 4 years ago
• kohn / HttpProxyMiddleware

  View on GitHub
  A middleware for scrapy. Used to change HTTP proxy from time to time.
  ☆322Feb 1, 2018Updated 8 years ago
• rmax / scrapydo

  View on GitHub
  Crochet-based blocking API for Scrapy.
  ☆47Feb 24, 2017Updated 9 years ago
• bufubaoni / SimpleSpider

  View on GitHub
  ☆10Mar 14, 2017Updated 9 years ago
• thouger / android_study

  View on GitHub
  ☆19Feb 10, 2026Updated last month
• NordVPN Special Discount Offer • Ad
  Save on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
• CloudXNS / mss

  View on GitHub
  基于workerman实现的异步高性能邮件、短信发送服务
  ☆19Oct 10, 2016Updated 9 years ago
• alecxe / scrapy-beautifulsoup

  View on GitHub
  Simple Scrapy middleware to process non-well-formed HTML with BeautifulSoup
  ☆21Sep 26, 2016Updated 9 years ago
• shikanon / proxy_scrapy

  View on GitHub
  proxy_scrapy是一个scrapy搭建的代理模块，主要包括代理抓取、代理测试和使用代理三个模块。包括了对主要的代理网站的抓取和代理稳定性的测试，并整合进scrapy爬虫当中。
  ☆10Jan 20, 2017Updated 9 years ago
• aaldaber / Distributed-Multi-User-Scrapy-System-with-a-Web-UI

  View on GitHub
  Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner
  ☆112May 11, 2018Updated 7 years ago
• Greyh4t / ProxyPool

  View on GitHub
  Crawl and validate proxies from Internet
  ☆78Dec 8, 2016Updated 9 years ago
• leeyis / ip_proxy_pool

  View on GitHub
  Generating spiders dynamically to crawl and check those free proxy ip on the internet with scrapy.
  ☆43Oct 6, 2018Updated 7 years ago
• scrapinghub / scrapy-training

  View on GitHub
  Scrapy Training companion code
  ☆173Jan 30, 2019Updated 7 years ago
• movingname / vulysisBugBounty

  View on GitHub
  ☆20May 12, 2016Updated 9 years ago
• michael-yin / scrapy_guru

  View on GitHub
  Everybody can be scrapy guru
  ☆143Oct 25, 2018Updated 7 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• aivarsk / scrapy-proxies

  View on GitHub
  Random proxy middleware for Scrapy
  ☆1,672Oct 1, 2019Updated 6 years ago
• wuchong / scrapy-dynamic-configurable

  View on GitHub
  A dynamic configurable news crawler based Scrapy
  ☆164Jul 24, 2017Updated 8 years ago
• WhatQ / mobilesafe

  View on GitHub
  这是一个手机安全卫士，基于Android开发，属于个人实践项目，涉及知识点较多，适合新手入门学习使用...
  ☆10Oct 27, 2012Updated 13 years ago
• scrapy / scrapyd-client

  View on GitHub
  Command line client for Scrapyd server
  ☆775Feb 27, 2026Updated last month
• wenguonideshou / spider_collection

  View on GitHub
  各种爬虫的集合，包括requests、pyquery、bs4、代理池、selenium、appium、mitmproxy等的使用
  ☆14Jul 19, 2018Updated 7 years ago
• scrapy-plugins / scrapy-zyte-smartproxy

  View on GitHub
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆366Mar 24, 2025Updated last year
• gityf / minirpc

  View on GitHub
  This is mini rpc depend on google protobuf.
  ☆12Jul 24, 2019Updated 6 years ago
• geekan / scrapy-examples

  View on GitHub
  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
  ☆3,266Nov 3, 2023Updated 2 years ago
• Tang-wei / Python-Django

  View on GitHub
  Django WEB商城网站项目
  ☆11Nov 1, 2017Updated 8 years ago
• DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• holgerd77 / django-dynamic-scraper

  View on GitHub
  Creating Scrapy scrapers via the Django admin interface
  ☆1,161Feb 19, 2022Updated 4 years ago
• sebdah / scrapy-mongodb

  View on GitHub
  MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…
  ☆359Apr 6, 2021Updated 5 years ago
• easychen / WeixinBot

  View on GitHub
  网页版微信API，包含终端版微信及微信机器人
  ☆13Oct 25, 2016Updated 9 years ago
• spriteray / dbproxy

  View on GitHub
  DBProxy - A Database Proxy Server base on MySQL
  ☆10Sep 30, 2020Updated 5 years ago
• Rafiot / Whois-Server

  View on GitHub
  Implementation of a Whois Server with a redis backend
  ☆15Oct 31, 2010Updated 15 years ago
• jin10086 / copyheaders

  View on GitHub
  方便的从浏览器复制浏览器头
  ☆44May 31, 2020Updated 5 years ago
• cleure / Amazon-Scraper

  View on GitHub
  Amazon Price scraping tool
  ☆39Feb 9, 2014Updated 12 years ago
• leafney / wxSpider

  View on GitHub
  搜狗微信公众号文章爬虫
  ☆19Feb 25, 2017Updated 9 years ago
• qidunwei / linuxsocket

  View on GitHub
  Linux下C语言实现即时通讯系统
  ☆12Jun 3, 2018Updated 7 years ago
• End-to-end encrypted cloud storage - Proton Drive • Ad
  Special offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
• LoranWong / QGroupRobot

  View on GitHub
  qq group robot 一个使用imqq webqq协议的QQ群机器人
  ☆14Jan 4, 2015Updated 11 years ago
• ainrm / safeGate

  View on GitHub
  一个基于openresty开发的安全网关demo
  ☆30Mar 3, 2022Updated 4 years ago
• umputun / mongo-auth

  View on GitHub
  mongo docker with auth
  ☆12Jul 24, 2018Updated 7 years ago
• jiyaping / http-proxy-pool

  View on GitHub
  收集免费http代理资源，供其它程序调用。
  ☆37Aug 16, 2016Updated 9 years ago
• jamy0801 / LGScanViewController

  View on GitHub
  swift QRCode
  ☆18Sep 11, 2016Updated 9 years ago
• hhr66 / saltweb-v2.0

  View on GitHub
  saltweb v2.0运维管理平台
  ☆31Feb 28, 2018Updated 8 years ago
• DormyMo / SpiderKeeper

  View on GitHub
  admin ui for scrapy/open source scrapinghub
  ☆2,778May 4, 2023Updated 2 years ago