Scrapy and Kafka
☆14Feb 7, 2018Updated 8 years ago
Alternatives and similar repositories for Scrapy-Kafka-Demo
Users that are interested in Scrapy-Kafka-Demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scrapy extension which writes crawled items to Kafka☆31Apr 8, 2026Updated 6 months ago
- 包含一些网站的登陆参数的解密和部分网址的参数解密，并结合Node.JS和Python进行破解。☆18Sep 3, 2021Updated 5 years ago
- 推送/集成Worktile通知到Slack☆12Sep 20, 2015Updated 11 years ago
- A request based package for scraping twitter data. No API Key required. Support for proxies and private twitter accounts☆29Oct 14, 2023Updated 3 years ago
- Kafka-based components for Scrapy☆78Apr 10, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 对抗cloudflare载入页反爬虫防护（已失效）☆38Nov 21, 2019Updated 6 years ago
- 基于 github actions 实现科学爱好者周刊 rss feed 推送☆12May 29, 2026Updated 5 months ago
- Minimal HTTP 1.1 Proxy & Load-balancer☆10Sep 23, 2017Updated 9 years ago
- Message Queue/C++/Lua based game server☆15May 3, 2013Updated 13 years ago
- A key-val store with real-time updates☆14Jun 3, 2014Updated 12 years ago
- A simple project showcasing HLS-based video streaming on JioCinema & Youtube and methods for stream conversion.☆25Jul 18, 2025Updated last year
- 极验滑动验证码研究报告☆68Jul 29, 2021Updated 5 years ago
- HA LDAP based key/value solution for projects configuration storing with multi master replication support☆12Apr 22, 2020Updated 6 years ago
- 國際STEAM Maker Forum(STEAM) 創客論壇☆17Aug 5, 2016Updated 10 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Simple hello world example using qt5, cml, c++, cmake☆10Jan 18, 2017Updated 9 years ago
- scrapy-redis-sentinel 基于 scrapy-redis 的基础上 新增 哨兵（sentinel）连接模式 以及 集群（cluster）连接模式。☆30Mar 31, 2023Updated 3 years ago
- ☆13Feb 20, 2023Updated 3 years ago
- Stateless CSRF (Cross-Site Request Forgery) token service☆15Jul 29, 2018Updated 8 years ago
- ☆14Dec 27, 2013Updated 12 years ago
- 面包多支付Java版SDK☆12Feb 4, 2026Updated 9 months ago
- scrapydweb, dockerfile☆13Feb 1, 2021Updated 5 years ago
- go与python的协程对比,以及python中协程的改进历史,和示例代码☆38Dec 10, 2019Updated 6 years ago
- ☆11Jul 2, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Rate Limiter Implementation in PHP☆17Dec 3, 2015Updated 10 years ago
- Vue.js3+Tornado6 前后端分离异步非阻塞教育平台项目☆10Dec 7, 2022Updated 3 years ago
- Scrapy Redis Bloom Filter☆173Jul 25, 2021Updated 5 years ago
- minitrain for bitcoin arbitrage☆13May 2, 2014Updated 12 years ago
- 轻量级javascript框架☆16May 27, 2017Updated 9 years ago
- An C++ serialization library☆11May 22, 2015Updated 11 years ago
- Small experimental Unity project: DXR + Spline☆14Sep 13, 2023Updated 3 years ago
- crawl facebook public post's information who likes, comments, shares☆42Dec 11, 2018Updated 7 years ago
- Extensions for the TG geometry library☆12Dec 3, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 可以用于scrapydweb的scrapyd节点，使用pyppeteer，在scrapy中异步使用☆12Dec 8, 2022Updated 3 years ago
- 戴西之海 - 先进数字集群：技术作者自留 地☆12Jan 10, 2021Updated 5 years ago
- A Three.js Start Kit with Webpack Hot Module Reload☆10Nov 27, 2017Updated 8 years ago
- Salt Multi-environment gitfs example.☆13Mar 2, 2014Updated 12 years ago
- various template packages☆15Aug 14, 2016Updated 10 years ago
- One-stop write up of PyData London 2014 - tutorials, slides, code, examples☆11Jul 5, 2026Updated 4 months ago
- 架构实战篇（十五）：Spring Boot 解耦之事件驱动☆10Sep 4, 2018Updated 8 years ago