Scrapy spider middleware to clean up query parameters in request URLs
☆24Jun 30, 2016Updated 10 years ago
Alternatives and similar repositories for scrapy-querycleaner
Users that are interested in scrapy-querycleaner are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Mar 16, 2022Updated 4 years ago
- A scrapy extension to store requests and responses information in storage service☆27Mar 11, 2022Updated 4 years ago
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆276Feb 26, 2025Updated last year
- A Scrapy pipeline to categorize items using MonkeyLearn☆38Apr 28, 2017Updated 9 years ago
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A project to attempt to automatically login to a website given a single seed☆11Jun 17, 2024Updated 2 years ago
- High Level Kafka Scanner☆19Sep 29, 2017Updated 8 years ago
- Use Python3, Django, Django-rest-framework to achieve alipay payment. 包括支付宝支付，支付宝服务器异步通知，支付宝退款☆12May 26, 2018Updated 8 years ago
- Feature switches in Django☆36Jun 21, 2021Updated 5 years ago
- ☆10Nov 18, 2021Updated 4 years ago
- Paginating the web☆37Feb 11, 2014Updated 12 years ago
- MinHash implementation in Python☆12Aug 24, 2024Updated last year
- Demo of orchestrating Airbyte connections with Prefect☆11Mar 3, 2022Updated 4 years ago
- ☆29Apr 28, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The most advanced debugging and testing tool for Scrapy☆16Apr 19, 2023Updated 3 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆39May 21, 2024Updated 2 years ago
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 11 years ago
- 安卓逆向 不定时分享 抖聘 惠借贷款 平安健康 小红书 搜狐汽车 用药助手 美丽修行 马蜂窝 美图秀秀☆12Mar 24, 2021Updated 5 years ago
- ☆19Oct 12, 2016Updated 9 years ago
- Parsing JavaScript objects into Python data structures☆222May 17, 2026Updated 2 months ago
- BUNT is a Bot UNderstanding Testbed☆35Jan 25, 2017Updated 9 years ago
- Music/Audio player built in HTML5 that can play local files☆16Jun 23, 2012Updated 14 years ago
- ☆50Apr 4, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Composer plugin to automate the most common tasks of applications.☆14Jan 4, 2023Updated 3 years ago
- A complimentary proxy to help to use SPM with headless browsers☆109May 20, 2026Updated 2 months ago
- A CLI tool that leverages AWS Route53 Health Checks to globally test HTTP(S) endpoints up to 300 RPS☆16Oct 3, 2020Updated 5 years ago
- A hierarchical environment manager for bash, written in bash.☆17Apr 18, 2026Updated 3 months ago
- ☆19Jan 15, 2026Updated 6 months ago
- cli for evaluating css and xpath selectors☆29Jul 4, 2023Updated 3 years ago
- The PlainFlow Digested Week is a crowdsourced email newsletter that goes to all the PlainFlow subscribers.☆12May 29, 2017Updated 9 years ago
- Common humanization utilities for Flask applications☆29Jan 20, 2022Updated 4 years ago
- ☆13May 7, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Manage your project with the power of NPM☆10Dec 12, 2016Updated 9 years ago
- Library for annotation-based dependency injection☆24Jul 21, 2026Updated 3 weeks ago
- Airbyte deployment and configuration management tool☆12Feb 5, 2022Updated 4 years ago
- Convert SRT file to Audacity supported Label.☆11Sep 4, 2020Updated 5 years ago
- clone of crontab.guru☆10Jul 3, 2026Updated last month
- PostgreSQL and PostGIS adapters forked from IOPro☆14Jun 25, 2026Updated last month
- A Laravel package to monitor queue jobs☆11Jan 17, 2017Updated 9 years ago