CrawlScript/WebCollector-Python external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

CrawlScript/WebCollector-Python

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/CrawlScript/WebCollector-Python)

Close

CrawlScript / WebCollector-PythonView on GitHubMore

• External links
• Readme badge

WebCollector-Python is an open source web crawler framework based on Python.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.

☆56Aug 19, 2019Updated 7 years ago

Alternatives and similar repositories for WebCollector-Python

Users that are interested in WebCollector-Python are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• uncle-mark / pypass

  View on GitHub
  A simple and powerful remote ports mapping tool
  ☆26Apr 26, 2018Updated 8 years ago
• DanMcInerney / mailspy

  View on GitHub
  Catch IMAP/POP passwords and see incoming and outgoing messages
  ☆16Sep 15, 2013Updated 13 years ago
• shinians / springboot-demos

  View on GitHub
  springboot-demos是以springboot为基础集成各个应用组件demo的案例项目，主要供开发者学习使用的案例
  ☆12Jun 5, 2024Updated 2 years ago
• digoal / gp_tpch

  View on GitHub
  ☆13Sep 3, 2018Updated 8 years ago
• zuobangbang / text-decoding

  View on GitHub
  use python to decode text
  ☆11Jun 17, 2019Updated 7 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• codercaizh / springboot-dubbo

  View on GitHub
  springboot集成dubbo
  ☆11Jun 17, 2022Updated 4 years ago
• hanqunfeng / SpringBootStudy

  View on GitHub
  ☆12Dec 5, 2024Updated last year
• url2io / url2io-python-sdk

  View on GitHub
  ⛔ [DEPRECATED] URL2io Python SDK，用于网页信息提取，如正文提取
  ☆41Dec 5, 2020Updated 5 years ago
• PyCN / -scrapy-

  View on GitHub
  仿造scrapy制作轻量级爬虫框架，旨在提升编程能力
  ☆20Jan 29, 2017Updated 9 years ago
• aoximin / ViralCollapse

  View on GitHub
  render China map in Viral by echarts
  ☆10Feb 13, 2020Updated 6 years ago
• wieck / benchmarksql

  View on GitHub
  A TPC-C like test tool
  ☆15Jan 12, 2024Updated 2 years ago
• strongbugman / ant_nest

  View on GitHub
  Simple, clear and fast Web Crawler framework build on python3.6+, powered by asyncio.
  ☆93Jun 15, 2026Updated 3 months ago
• OFZFZS / fuckporn

  View on GitHub
  为保护广大青少年,于是用易语言开发了色情网址一键采集并向12321举报的软件...
  ☆10Aug 12, 2018Updated 8 years ago
• hahaha108 / JDSpider

  View on GitHub
  京东爬虫，可以实现输入一个关键字后自动爬取相关的商品信息，也可以用于自定义爬取商品的评论。
  ☆11Mar 23, 2018Updated 8 years ago
• Simple, predictable pricing with DigitalOcean hosting • Ad
  Always know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
• m0n5t3r / sentry-zabbix

  View on GitHub
  Send Sentry counts to Zabbix
  ☆15Dec 15, 2016Updated 9 years ago
• semicircle / gocors

  View on GitHub
  A tiny toolkit for Go HTTP CORS support
  ☆11Nov 8, 2013Updated 12 years ago
• outini / pymailq

  View on GitHub
  Simple mails queue management
  ☆32Feb 10, 2020Updated 6 years ago
• CUCmehp / occiwrapper

  View on GitHub
  occiwrapper is an open source and cross platform Oracle Driver that delivers efficient access to Oracle databases.It was writen by C++, a…
  ☆17Aug 26, 2015Updated 11 years ago
• JoneXiong / MoleSys

  View on GitHub
  基于Mole的一个企业级web应用的架子
  ☆25Jan 30, 2015Updated 11 years ago
• srault95 / mongo-mail-server

  View on GitHub
  SMTP server based on Python Gevent - Recording messages in MongoDB
  ☆17Mar 13, 2018Updated 8 years ago
• Huangtuzhi / GoLink

  View on GitHub
  A web app to restore the bookmarks you encounter based on Flask.
  ☆25Apr 9, 2015Updated 11 years ago
• huifurepo / bspay-go-sdk

  View on GitHub
  ☆12Sep 24, 2026Updated 2 weeks ago
• xioxu / sinaWeiboLogin

  View on GitHub
  想要抓取新浪微博数据，必须先要登录，但新浪也做了一定的预防措施，这是我用c#写了一个使用http模拟登录新浪微博的示例代码。
  ☆11Oct 22, 2014Updated 11 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• ibm-apiconnect / apichol

  View on GitHub
  API Connect Hands-On Labs
  ☆15Dec 31, 2021Updated 4 years ago
• jiangq28 / Subway_Data

  View on GitHub
  爬取全国地铁站数据的代码集成
  ☆16Nov 30, 2018Updated 7 years ago
• hq-cml / spider-face

  View on GitHub
  一个基于Go的web框架
  ☆10Aug 8, 2019Updated 7 years ago
• wcl9900 / FrameAnimationView

  View on GitHub
  多功能帧动画视图控件，可播放高分辨率图片，减少内存开销
  ☆17Jul 28, 2017Updated 9 years ago
• newnius / scripts

  View on GitHub
  Scripts about docker and cluster managemant
  ☆13Jul 15, 2019Updated 7 years ago
• ferreousbox / jquery.stamper

  View on GitHub
  一款在网页上模拟现实中的盖章效果的JQuery插件
  ☆51Sep 13, 2015Updated 11 years ago
• xbynet / mdwiki

  View on GitHub
  markdown wiki by python
  ☆112Dec 27, 2017Updated 8 years ago
• chrisyue / my-vimrc

  View on GitHub
  vim configs for mac and linux
  ☆11May 26, 2020Updated 6 years ago
• easy30 / easy-task

  View on GitHub
  Easy Task为简单易用的分布式任务调度平台. An elastic distributed job scheduler system
  ☆40Dec 16, 2022Updated 3 years ago
• GPUs on demand by Runpod - Special Offer Available • Ad
  Run AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
• NXROBO / scorpio

  View on GitHub
  This repository contains the ROS wrapper of scorpio's driver plus various ROS applications.
  ☆12Jan 29, 2026Updated 8 months ago
• iteratorx / iteratorx

  View on GitHub
  IteratorX
  ☆37Sep 8, 2022Updated 4 years ago
• bezzad / WHOis

  View on GitHub
  Whois Online Domain Database for check domains are reserved or not as parallel
  ☆16May 31, 2019Updated 7 years ago
• aquavit / OpenCL.Net

  View on GitHub
  OpenCL.Net clone (from git svn clone https://openclnet.svn.codeplex.com/svn/trunk)
  ☆18Sep 17, 2015Updated 11 years ago
• easychen / WeixinBot

  View on GitHub
  网页版微信API，包含终端版微信及微信机器人
  ☆12Oct 25, 2016Updated 9 years ago
• yangmoling / doubaoime-asr

  View on GitHub
  豆包输入法语音识别的非官方 Python 客户端
  ☆35Feb 4, 2026Updated 8 months ago
• rayzgithub / ZhiHuSpider

  View on GitHub
  自写爬虫爬取知乎问题及回答
  ☆39Jun 10, 2019Updated 7 years ago