基于Scrapy的通用爬虫框架
☆25Jan 9, 2019Updated 7 years ago
Alternatives and similar repositories for ScrapyUniversal
Users that are interested in ScrapyUniversal are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 一个api， 提供在线实时查询 被执行人/失信被执行人查询结果☆12Dec 29, 2018Updated 7 years ago
- 可能是全网最方便的水印图床，支持宝塔一键部署、也支持Docker版部署至服务器或本地电脑☆10Jul 16, 2019Updated 6 years ago
- 文字自动生成视频 - 文 字生成视频的AI工具软件汇总☆12Apr 17, 2025Updated last year
- 基于selenium的携程酒店评论爬取☆13May 10, 2021Updated 4 years ago
- 用于下载QQ音乐中需要VIP权限才能下载的歌曲☆13Aug 8, 2018Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- selenium 携程酒店爬虫+简单数据分析☆10Dec 6, 2018Updated 7 years ago
- 一个基于 Scrapy 的优酷资讯视频爬虫☆19Jun 25, 2018Updated 7 years ago
- 利用 selenium 自动化控制 Chrome 浏览器以 Excel 格式导出 Web of Science 搜索结果☆11Aug 15, 2022Updated 3 years ago
- Tinepeas，我们自己的爬虫框架。☆60Aug 9, 2024Updated last year
- 基于HTML5 div+css布局的视频网站，实现视频播放、音乐播放以及图片浏览功能☆15May 21, 2019Updated 6 years ago
- 多线程下载小说，换成mobi格式，自动推送☆17May 25, 2019Updated 6 years ago
- Python制作的小姐姐颜值查询工具☆14Mar 11, 2020Updated 6 years ago
- 采用微信小程序来控制智能家居，包括数据采集显示，远程控制，蓝牙控制，语音控制等。☆11Feb 19, 2019Updated 7 years ago
- homepage☆10Feb 15, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- BloomFilter Based on py3(基于py3的布隆过滤器)☆25Dec 7, 2022Updated 3 years ago
- 抖音直播视频流下载☆16Apr 16, 2023Updated 3 years ago
- 百度图片爬虫, 爬取百度图片 ,scrapy，百度图片爬取☆19Feb 28, 2020Updated 6 years ago
- ☆30Jul 5, 2018Updated 7 years ago
- Python JA3 request library, support customize JA3 fingerprints. Full free & OpenSource.☆25Oct 23, 2025Updated 6 months ago
- 大数据下的移动 APP 数据分析指南☆13Jun 27, 2019Updated 6 years ago
- A chrome extension to get XPath of list items in webpage easily.☆34Mar 11, 2022Updated 4 years ago
- 用于解析列表页链接和提取详细页内容的库☆19Oct 26, 2023Updated 2 years ago
- Scrapy + selenium/webdriver + 随机User-Agent + IP proxy + twisted ConnectionPool + mysql 爬取某书整站爬虫☆15Dec 8, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 🎶基于Python3.6+django1.11的音乐网站，附带视频播放，响应式设计，支持评论，收藏和查看历史播放记录。☆17Dec 8, 2022Updated 3 years ago
- 基于图灵机器人，科大讯飞win版，百度语音合成的语音 聊天和音乐播放机器人。☆22Jul 25, 2017Updated 8 years ago
- 基于Scrapy和Django的二手房爬虫及可视化☆10Nov 22, 2022Updated 3 years ago
- 百度搜索指数 对标 股票数据，分析相关性，后面研究 搜索数量、热度 与 股票价值、涨跌预测的 数学模型☆16Jan 25, 2021Updated 5 years ago
- 去除抖音、微视水印的脚本工具☆20Apr 30, 2020Updated 6 years ago
- 一个简单的选课系统实现，基于微信小程序云开发，前端采用vant weapp框架☆14Jul 11, 2019Updated 6 years ago
- django框架中使用支付宝支付，微信native模式支付，中国银联支付☆14Feb 7, 2023Updated 3 years ago
- Spider_pj☆23Nov 26, 2024Updated last year
- improve justtrustme☆22Apr 27, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 豆瓣资料备份☆13Sep 5, 2020Updated 5 years ago
- 增加新的项目，爬取前程无忧，大街网，拉勾网，百度贴吧，美团商家，美团酒店，信托协会，微信步数，土流网，破解验证码，链家，百度文库，wallaven壁纸，音效，☆17Aug 1, 2021Updated 4 years ago
- A股数据异步下载器☆23Dec 22, 2020Updated 5 years ago
- convert m3u8 to mp4☆20Aug 5, 2018Updated 7 years ago
- Use Python3, Django, Django-rest-framework to achieve wechat payment. 微信支付、服务器异步通知、订单查询、退款☆21Sep 21, 2018Updated 7 years ago
- scrapy-redis-expiredupefilter是基于scrapy-redis修改来的一款scrapy分布式爬虫框架，它支持为请求指纹设置生命周期，请求指纹生命周期结束后将在不影响其他指纹的情况下自动清除。☆10Aug 6, 2019Updated 6 years ago
- bilibili-api☆15Oct 18, 2018Updated 7 years ago