通过headless chrome实现selenium+scrapy的伪并发,提高动态网站爬取效率。
☆10Mar 12, 2018Updated 8 years ago
Alternatives and similar repositories for multi-selenium-in-scrapy
Users that are interested in multi-selenium-in-scrapy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 蜂巢爬虫系统 是一套只需要定义XPath,就可实现爬取网站,APP的系统, 支持多种解析方式(XPath,正则表达式),多种下载方式(HttpClient库, PhantomJs, Selenium),多种输出方式(Excel,MongoDB)。 可不做任何修改发布到Yar…☆10Sep 5, 2016Updated 10 years ago
- Some practical gadgets. ✔☆11Sep 5, 2026Updated 2 months ago
- Recommender system based on SVD☆10Aug 10, 2015Updated 11 years ago
- ☆11Oct 24, 2018Updated 8 years ago
- Rock Your Java!☆28May 11, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- (Not maintained) Script for batch downloading tut+ premium videos☆34Nov 14, 2014Updated 11 years ago
- A general movie recommending system involving python, numpy, sklearn, pandas. Applied feature-based modeling, content-based filtering, co…☆21Feb 22, 2018Updated 8 years ago
- An implementation of label propagation from the paper "Learning from labeled and unlabeled data with label propagation"☆20Mar 19, 2016Updated 10 years ago
- 用Vue框架搭建的类似于淘宝的小商城☆10Jan 5, 2023Updated 3 years ago
- Scrapy project to fetch movies data from IMDB and put on MySQL DB. It download movie covers also and more scrapers will be done on future…☆15Aug 28, 2012Updated 14 years ago
- ☆22Feb 3, 2018Updated 8 years ago
- 日常爬虫☆16Dec 28, 2020Updated 5 years ago
- 写一些爬虫代码,,喜欢可以star☆16Mar 24, 2017Updated 9 years ago
- VMware Workstation 一键汉化与恢复工具,内嵌中文语言包,支持自动检测安装目录。☆47Sep 9, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Community Detection in Julia☆21Dec 25, 2024Updated last year
- ☆17Dec 6, 2021Updated 4 years ago
- An LLM text adventure game☆27Updated this week
- Blazingly fast strategy backtest with polars☆13Mar 14, 2026Updated 7 months ago
- Scrapy 项目实例☆16Aug 19, 2017Updated 9 years ago
- Google AI Studio CSS样式脚本。包含user/modal区分、对话内目录导航、Markdown渲染优化、UI布局调整。☆25May 29, 2026Updated 5 months ago
- 对词典进行解析单词的含义,提供Anki的Fast Words Query插件词库☆11Apr 1, 2021Updated 5 years ago
- Springboot与Thymeleaf模板引擎整合☆13Sep 27, 2017Updated 9 years ago
- a video downloader for Pornhub | pornhub视频下载器☆11Jan 18, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Scrapy example project using Tor (through Privoxy) in a Docker Compose multi-container application☆11Oct 28, 2017Updated 9 years ago
- Local dev environment using Docker, NodeJs, Redis, MongoDB☆17Dec 7, 2022Updated 3 years ago
- Framework for multi-page Dash apps☆12May 25, 2019Updated 7 years ago
- Gitlib coin ,for every git user. Thanks everyone contribute your ideas and code on git~☆10Aug 12, 2021Updated 5 years ago
- Blazingly fast portfolio backtesting for Polars☆17Updated this week
- Minimal Pairs scraping/anki deck creation☆10Dec 8, 2022Updated 3 years ago
- A Sokoban Game written in python using pyGame Library☆12Updated this week
- docker for HF wav2vec2-sprint☆13Mar 26, 2021Updated 5 years ago
- 币安公告实时监控工具☆15Sep 6, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Get and parse data from Twitter User Timelines☆11Jan 9, 2019Updated 7 years ago
- Accessible Web UI Framework for Enterprise☆27Oct 27, 2026Updated last week
- Sample for Flutter☆16Mar 26, 2025Updated last year
- Watery Traders 是一个通过 uiautomator2 控制安卓手机上的同花顺APP进行自动化交易的 Python 系统。该项目提供 RESTful API 和 MCP (Model Context Protocol) 支持,可以与 AI 助手(如 Claude…☆20Jul 26, 2026Updated 3 months ago
- follow-the-regularized-leader implemented by java, with an example using criteo dataset.☆37Oct 4, 2015Updated 11 years ago
- Arabic Dialects Segmenter Using Keras/BiLSTM/ChainCRF☆11Jun 2, 2020Updated 6 years ago
- Spring Security 通用框架,(手机、社交:微信/QQ)登录(自动注册),基于JWT 和 Request URL/Method 动态权限校验☆12Jun 21, 2022Updated 4 years ago