qinxuye/cola external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

qinxuye/cola

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/qinxuye/cola)

Close

qinxuye / colaView on GitHubMore

• External links
• Readme badge

A high-level distributed crawling framework.

☆1,498Jul 31, 2022Updated 4 years ago

Alternatives and similar repositories for cola

Users that are interested in cola are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• gnemoug / distribute_crawler

  View on GitHub
  使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
  ☆3,234Apr 18, 2017Updated 9 years ago
• binux / pyspider

  View on GitHub
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,748Apr 30, 2024Updated 2 years ago
• scrapinghub / portia

  View on GitHub
  Visual scraping for Scrapy
  ☆9,499Jun 26, 2024Updated 2 years ago
• matiasb / demiurge

  View on GitHub
  PyQuery-based scraping micro-framework.
  ☆118Jan 14, 2022Updated 4 years ago
• rmax / scrapy-redis

  View on GitHub
  Redis-based components for Scrapy.
  ☆5,647Updated this week
• AI Agents on DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• lorien / grab

  View on GitHub
  Web Scraping Framework
  ☆2,462Sep 19, 2025Updated last year
• douban / dpark

  View on GitHub
  Python clone of Spark, a MapReduce alike framework in Python
  ☆2,662Dec 25, 2020Updated 5 years ago
• jmg / crawley

  View on GitHub
  Pythonic Crawling / Scraping Framework based on Non Blocking I/O operations.
  ☆193Oct 7, 2026Updated 3 weeks ago
• geekan / scrapy-examples

  View on GitHub
  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
  ☆3,258Nov 3, 2023Updated 2 years ago
• egrcc / zhihu-python

  View on GitHub
  获取知乎内容信息，包括问题，答案，用户，收藏夹信息
  ☆2,336Feb 8, 2022Updated 4 years ago
• yoyzhou / weibo_scrapy

  View on GitHub
  WEIBO_SCRAPY is a Multi-Threading SINA WEIBO data extraction Framework in Python.
  ☆155Jun 3, 2026Updated 4 months ago
• shell909090 / siren

  View on GitHub
  spider framework and utils written by python
  ☆47Jul 2, 2013Updated 13 years ago
• isnowfy / snownlp

  View on GitHub
  Python library for processing Chinese text
  ☆6,634Jan 19, 2020Updated 6 years ago
• scrapy / scrapy

  View on GitHub
  Scrapy, a fast high-level web crawling & scraping framework for Python.
  ☆65,125Updated this week
• End-to-end encrypted email - Proton Mail • Ad
  Special offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
• princehaku / pyrailgun

  View on GitHub
  Simple And Easy Python Crawler Framework，支持抓取javascript渲染的页面的简单实用高效的python网页爬虫抓取模块
  ☆379Sep 3, 2021Updated 5 years ago
• PaulGuo / F2E.im

  View on GitHub
  A community for front-end-developer.
  ☆610Apr 30, 2015Updated 11 years ago
• fxsjy / jieba

  View on GitHub
  结巴中文分词
  ☆35,223Aug 21, 2024Updated 2 years ago
• tpeng / weibosearch

  View on GitHub
  A distributed Sina Weibo Search spider base on Scrapy and Redis.
  ☆146May 31, 2013Updated 13 years ago
• jmcarp / robobrowser

  View on GitHub
  ☆3,686Sep 10, 2020Updated 6 years ago
• airlsyn / sina-weibo-crawler

  View on GitHub
  sina weibo crawler
  ☆45Mar 26, 2015Updated 11 years ago
• rq / rq

  View on GitHub
  Simple job queues for Python
  ☆10,701Updated this week
• offu / WeRoBot

  View on GitHub
  WeRoBot 是一个微信公众号开发框架
  ☆4,663Jan 13, 2026Updated 9 months ago
• gnemoug / sina_reptile

  View on GitHub
  获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写，多进程爬取，将数据存储在了mongodb中
  ☆474Mar 22, 2013Updated 13 years ago
• GPUs on demand by Runpod - Special Offer Available • Ad
  Run AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
• michaelliao / sinaweibopy

  View on GitHub
  新浪微博Python SDK
  ☆1,266Nov 7, 2020Updated 5 years ago
• pythoncn / june

  View on GitHub
  June is a forum (Deprecated)
  ☆1,100Sep 15, 2022Updated 4 years ago
• tornadoweb / tornado

  View on GitHub
  Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed.
  ☆22,165Updated this week
• scrapy-plugins / scrapy-splash

  View on GitHub
  Scrapy+Splash for JavaScript integration
  ☆3,225Feb 11, 2025Updated last year
• SohuTech / essay

  View on GitHub
  Python项目自动化多服务器部署的工具
  ☆537Aug 3, 2018Updated 8 years ago
• doraemonext / wechat-python-sdk

  View on GitHub
  微信公众平台 Python 开发包 [DEPRECATED]
  ☆1,347Oct 1, 2020Updated 6 years ago
• wklken / stackoverflow-py-top-qa

  View on GitHub
  stackoverflow上Python相关回答整理翻译
  ☆843Mar 25, 2021Updated 5 years ago
• LiuXingMing / SinaSpider

  View on GitHub
  新浪微博爬虫（Scrapy、Redis）
  ☆3,284Sep 5, 2018Updated 8 years ago
• laiwei / thepast

  View on GitHub
  thepast.me ｜ 个人杂志计划
  ☆748Jul 14, 2015Updated 11 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• qiyeboy / IPProxyPool

  View on GitHub
  IPProxyPool代理池项目，提供代理ip
  ☆4,288Jul 13, 2018Updated 8 years ago
• codelucas / newspaper

  View on GitHub
  newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
  ☆15,181Updated this week
• scrapy / scrapyd

  View on GitHub
  A service daemon to run Scrapy spiders
  ☆3,098Oct 23, 2026Updated last week
• gevent / gevent

  View on GitHub
  Coroutine-based concurrency library for Python
  ☆6,443Sep 16, 2026Updated last month
• JobsDong / tigerspider

  View on GitHub
  tigerspider: a fast high-level screen scraping and web crawling framework for Python.
  ☆33May 25, 2015Updated 11 years ago
• ideawu / ssdb

  View on GitHub
  SSDB - A fast NoSQL database, an alternative to Redis
  ☆8,309Aug 20, 2022Updated 4 years ago
• mher / tornado-celery

  View on GitHub
  Non-blocking Celery client for Tornado
  ☆563Apr 25, 2017Updated 9 years ago