xelzmm/proxy_server_crawler external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

xelzmm/proxy_server_crawler

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/xelzmm/proxy_server_crawler)

Close

xelzmm / proxy_server_crawlerView on GitHubMore

• External links
• Readme badge

an awesome public proxy server crawler based on scrapy framework

☆90May 17, 2017Updated 9 years ago

Alternatives and similar repositories for proxy_server_crawler

Users that are interested in proxy_server_crawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• TeamHG-Memex / tor-proxy

  View on GitHub
  a tor socks proxy docker image
  ☆12Apr 8, 2026Updated 6 months ago
• scrapy-plugins / scrapy-pagestorage

  View on GitHub
  A scrapy extension to store requests and responses information in storage service
  ☆27Mar 11, 2022Updated 4 years ago
• kakaok / scrapy_multi_pipeline

  View on GitHub
  ☆13Feb 25, 2016Updated 10 years ago
• kohn / HttpProxyMiddleware

  View on GitHub
  A middleware for scrapy. Used to change HTTP proxy from time to time.
  ☆323Feb 1, 2018Updated 8 years ago
• alecxe / scrapy-fake-useragent

  View on GitHub
  Random User-Agent middleware based on fake-useragent
  ☆687Sep 18, 2023Updated 3 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• ZhuPeng / trackupdates

  View on GitHub
  A simple yaml-based xpath crawler framework for easy tracking site updates. https://zhupeng.github.io/
  ☆21Mar 1, 2024Updated 2 years ago
• das-lab / VpatchFinder

  View on GitHub
  面向项目版本差异性的漏洞识别技术研究
  ☆14Mar 29, 2022Updated 4 years ago
• rmax / scrapydo

  View on GitHub
  Crochet-based blocking API for Scrapy.
  ☆47Feb 24, 2017Updated 9 years ago
• gotlium / django-proxylist

  View on GitHub
  Proxy-list management application for Django
  ☆23Mar 5, 2018Updated 8 years ago
• aaldaber / Distributed-Multi-User-Scrapy-System-with-a-Web-UI

  View on GitHub
  Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner
  ☆111May 11, 2018Updated 8 years ago
• CloudXNS / mss

  View on GitHub
  基于workerman实现的异步高性能邮件、短信发送服务
  ☆19Oct 10, 2016Updated 10 years ago
• Greyh4t / ProxyPool

  View on GitHub
  Crawl and validate proxies from Internet
  ☆78Aug 20, 2026Updated last month
• leeyis / ip_proxy_pool

  View on GitHub
  Generating spiders dynamically to crawl and check those free proxy ip on the internet with scrapy.
  ☆43Oct 6, 2018Updated 8 years ago
• movingname / vulysisBugBounty

  View on GitHub
  ☆20May 12, 2016Updated 10 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• scrapinghub / scrapy-training

  View on GitHub
  Scrapy Training companion code
  ☆173Jan 30, 2019Updated 7 years ago
• michael-yin / scrapy_guru

  View on GitHub
  Everybody can be scrapy guru
  ☆143Oct 25, 2018Updated 7 years ago
• Refactoring / docker_rabbitmq_cluster

  View on GitHub
  RabbitMQ集群 Docker一键配置
  ☆14Nov 20, 2015Updated 10 years ago
• dchrostowski / autoproxy

  View on GitHub
  Public proxy farm that automatically records and queues suitable proxy servers for web crawling
  ☆17Nov 4, 2022Updated 3 years ago
• wuchong / scrapy-dynamic-configurable

  View on GitHub
  A dynamic configurable news crawler based Scrapy
  ☆164Jul 24, 2017Updated 9 years ago
• ClericPy / torequests

  View on GitHub
  Async wrapper for requests / aiohttp, and some crawler toolkits. Let synchronization code enjoy the performance of asynchronous programmi…
  ☆24Feb 9, 2025Updated last year
• binux / xunlei-lixian-proxy

  View on GitHub
  a http/ftp proxy for xunlei lixian
  ☆29Nov 17, 2013Updated 12 years ago
• aivarsk / scrapy-proxies

  View on GitHub
  Random proxy middleware for Scrapy
  ☆1,666Oct 1, 2019Updated 7 years ago
• pang1567 / rsmovie

  View on GitHub
  通过python爬虫，对将睿思每周新上传的电影进行打分，分数取自豆瓣电影评分。然后将最终数据做统计，分数高于7分的电影筛选出来，方便我们下载好看的电影。
  ☆14Dec 31, 2014Updated 11 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• scrapy / scrapyd-client

  View on GitHub
  Command line client for Scrapyd server
  ☆770Feb 27, 2026Updated 7 months ago
• z1px / itchat

  View on GitHub
  python 分析朋友圈好友
  ☆14Nov 11, 2017Updated 8 years ago
• PyCN / -scrapy-

  View on GitHub
  仿造scrapy制作轻量级爬虫框架，旨在提升编程能力
  ☆19Jan 29, 2017Updated 9 years ago
• hughsk / circular-list

  View on GitHub
  Circular linked lists
  ☆17Apr 18, 2016Updated 10 years ago
• Tang-wei / Python-Django

  View on GitHub
  Django WEB商城网站项目
  ☆11Nov 1, 2017Updated 8 years ago
• scrapy-plugins / scrapy-zyte-smartproxy

  View on GitHub
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆365May 4, 2026Updated 5 months ago
• scrapy-plugins / scrapy-splitvariants

  View on GitHub
  Scrapy spider middleware to split an item into multiple items using a multi-valued key
  ☆21Feb 8, 2017Updated 9 years ago
• geekan / scrapy-examples

  View on GitHub
  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
  ☆3,256Nov 3, 2023Updated 2 years ago
• sebdah / scrapy-mongodb

  View on GitHub
  MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…
  ☆357Apr 6, 2021Updated 5 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• terry2tan / weibo_search

  View on GitHub
  【工具】基于selenium的微博搜索爬虫
  ☆13Jun 25, 2014Updated 12 years ago
• mrkn / scikit-learn.rb

  View on GitHub
  scikit-learn wrapper for Ruby
  ☆12Oct 14, 2016Updated 9 years ago
• DormyMo / scrappy

  View on GitHub
  scrapy best practice
  ☆38Sep 30, 2020Updated 6 years ago
• snailxr / weixin

  View on GitHub
  微信群发
  ☆10Sep 16, 2013Updated 13 years ago
• WilsonDhChen / transcodesrv_linux

  View on GitHub
  转码服务器，IPCAM转RTMP/RTSP，带频道管理，可接入各种流媒体服务器
  ☆10Oct 27, 2017Updated 8 years ago
• jin10086 / copyheaders

  View on GitHub
  方便的从浏览器复制浏览器头
  ☆43May 31, 2020Updated 6 years ago
• qidunwei / linuxsocket

  View on GitHub
  Linux下C语言实现即时通讯系统
  ☆12Jun 3, 2018Updated 8 years ago