A custom library that integrates Scrapy with Kafka.
☆12Apr 27, 2026Updated 6 months ago
Alternatives and similar repositories for kafka_scrapy_connect
Users that are interested in kafka_scrapy_connect are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Integrate Replicate.com with Obsidian☆12Oct 14, 2026Updated last month
- ☆16Updated this week
- Package mach provides the low-level darwin Mach system calls for Go☆11Feb 25, 2023Updated 3 years ago
- Simple and easy to use python free proxy manager☆16May 22, 2023Updated 3 years ago
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with Amazon Data Firehose and DMS☆18Jul 28, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Didactic Web crawler for Web Search Engines (CS 6913) course at NYU☆10Dec 8, 2022Updated 3 years ago
- Personal fork of Proxmox 6's QEMU for testing patches☆18May 9, 2025Updated last year
- Run Spock specs in JMeter☆10May 13, 2025Updated last year
- Agent Skills for AceDataCloud AI services — music, image, video generation, web search, and more. Compatible with Claude Code, GitHub Cop…☆17Updated this week
- 将ddddocr通过onnxruntime-web部署在浏览器中运行☆11May 17, 2025Updated last year
- MacOS का लागी पारम्परिक नेपाली किबोर्ड लेआऊट (Traditional Nepali Keyboard Layout for MacOS)☆10Nov 14, 2024Updated 2 years ago
- OpenATP is an open-source Python package providing a common interface for Automated Theorem Proving (ATP)☆30Oct 8, 2026Updated last month
- Openai Compatible Langgraph Server☆25Updated this week
- ☆15Apr 22, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ClickHouse Helm Chart☆18Updated this week
- A cloud data platform product to accelerate time to insights. Our open-source framework is designed for the real world. Stripping away th…☆26Jul 8, 2026Updated 4 months ago
- utilities for loading CSVs☆13Aug 31, 2020Updated 6 years ago
- GitHub Action to automatically generate md documentation from bash script with shdoc☆10Jan 2, 2021Updated 5 years ago
- Kubernetes initContainers examples and good defaults☆14Oct 1, 2024Updated 2 years ago
- KDE liquid glass☆16Jul 31, 2026Updated 3 months ago
- This repo contains a full-fledged Python-based script that scrapes a JavaScript-rendered website, cleans the data, and pushes the results…☆13Oct 2, 2022Updated 4 years ago
- A repository for a presentation on debugging and performances tricks with MXNet Gluon☆24Sep 17, 2018Updated 8 years ago
- Prebuilt Terraform CDK (cdktf) provider for docker.☆12Dec 10, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Builds and deploys a jekyll page to GitHub pages☆12Jan 23, 2023Updated 3 years ago
- Provides tools for downloading, reading and analyzing the PNS, a household survey from Brazilian Institute of Geography and Statistics - …☆15Feb 2, 2024Updated 2 years ago
- Scrapy project template. Use it to quickly spin up a new web scraping project☆16Nov 18, 2024Updated 2 years ago
- Distributed crawling/scraping, Kafka And Redis based components for Scrapy☆45Nov 13, 2020Updated 6 years ago
- Web research automation with hierarchical citation trees. A more deterministic alternative to agent-based systems (like OpenAI Deep Resea…☆12Oct 10, 2025Updated last year
- FastAPI / PonyORM / Python rq boilerplate project☆10May 11, 2022Updated 4 years ago
- A comprehensive collection of scripts to automate the setup of development environments across Windows, macOS, and Linux systems. These s…☆10Mar 16, 2025Updated last year
- Prebuilt Terraform CDK (cdktf) provider for github.☆16Dec 10, 2025Updated 11 months ago
- Design patterns implemented in Java☆11Feb 5, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Collection of scripts and code used as an examples in my articles on blazemeter.com/blog☆12Oct 30, 2020Updated 6 years ago
- Automated reCAPTCHA solving using Tensorflow☆27Jun 12, 2019Updated 7 years ago
- ☆12Feb 20, 2025Updated last year
- ☆14Nov 11, 2024Updated 2 years ago
- Meta-GitHub repository for all terraform-aws-modules repositories 🇺🇦☆21Aug 31, 2022Updated 4 years ago
- A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based componen…☆61May 10, 2026Updated 6 months ago
- ☆32Aug 9, 2025Updated last year
Are these results useful?