A custom library that integrates Scrapy with Kafka.
☆12Apr 27, 2026Updated 5 months ago
Alternatives and similar repositories for kafka_scrapy_connect
Users that are interested in kafka_scrapy_connect are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16May 11, 2026Updated 4 months ago
- Simple and easy to use python free proxy manager☆16May 22, 2023Updated 3 years ago
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with Amazon Data Firehose and DMS☆18Jul 28, 2026Updated 2 months ago
- ClickHouse Helm Chart☆18Updated this week
- Didactic Web crawler for Web Search Engines (CS 6913) course at NYU☆10Dec 8, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Personal fork of Proxmox 6's QEMU for testing patches☆18May 9, 2025Updated last year
- MacOS का लागी पारम्परिक नेपाली किबोर्ड लेआऊट (Traditional Nepali Keyboard Layout for MacOS)☆10Nov 14, 2024Updated last year
- GitHub Action to automatically generate md documentation from bash script with shdoc☆10Jan 2, 2021Updated 5 years ago
- Openai Compatible Langgraph Server☆24Oct 2, 2026Updated last week
- Prebuilt Terraform CDK (cdktf) provider for docker.☆12Dec 10, 2025Updated 9 months ago
- A cloud data platform product to accelerate time to insights. Our open-source framework is designed for the real world. Stripping away th…☆25Jul 8, 2026Updated 3 months ago
- Kubernetes initContainers examples and good defaults☆14Oct 1, 2024Updated 2 years ago
- This repo contains a full-fledged Python-based script that scrapes a JavaScript-rendered website, cleans the data, and pushes the results…☆13Oct 2, 2022Updated 4 years ago
- Builds and deploys a jekyll page to GitHub pages☆12Jan 23, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Web scraper with proxy rotation, retries, and with Chrome TLS fingerprint emulation. PHP Client☆10Dec 19, 2022Updated 3 years ago
- 抖音扫码登录2023最新接口☆11Oct 2, 2023Updated 3 years ago
- Distributed crawling/scraping, Kafka And Redis based components for Scrapy☆45Nov 13, 2020Updated 5 years ago
- Prebuilt Terraform CDK (cdktf) provider for github.☆16Dec 10, 2025Updated 9 months ago
- ☆32Aug 9, 2025Updated last year
- 使用了lsp魔改全局版+fundex2实现云脱壳原理 测试环境☆22Feb 11, 2024Updated 2 years ago
- Scrapy project template. Use it to quickly spin up a new web scraping project☆16Nov 18, 2024Updated last year
- Repo for quick AST transformation nonsense.☆13Nov 23, 2021Updated 4 years ago
- malenia是一个对代理IP池进行二次组合的工具，用户可以将多个采购的IP资源进行二次组合，使用统一的账户密码，服务器端口等信息进行统一访问。☆14Jan 2, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- generate random user-agent☆13Aug 7, 2026Updated 2 months ago
- ☆12Feb 20, 2025Updated last year
- ☆10Feb 19, 2021Updated 5 years ago
- Integracja dla Home Assistant umożliwiająca śledzenie aktualnych cen energii elektrycznej oraz prognoz z platformy Pstryk.☆36Jul 21, 2026Updated 2 months ago
- ☆60May 15, 2024Updated 2 years ago
- quickly mix LLMs together☆19Jan 5, 2025Updated last year
- A robust, single standalone html file AI interface for Ollama and OpenAI. Features local RAG with vector search, real-time voice/video ca…☆17Jul 4, 2026Updated 3 months ago
- Integration of vpn tunnels for Qubes OS☆29Aug 9, 2024Updated 2 years ago
- Automated reCAPTCHA solving using Tensorflow☆27Jun 12, 2019Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Meta-GitHub repository for all terraform-aws-modules repositories 🇺🇦☆21Aug 31, 2022Updated 4 years ago
- A simple python interface to store and interact with knowledge graphs in your favourite NoSQL DB☆43Oct 23, 2024Updated last year
- Style your django admin changelist rows with ease!☆36Dec 23, 2021Updated 4 years ago
- ☆38Updated this week
- Helm charts☆34Oct 1, 2026Updated last week
- A GitHub Action used to delete workflow runs from a repository.☆14Jan 24, 2024Updated 2 years ago
- ☆17Mar 19, 2020Updated 6 years ago