Scrapy spider middleware to clean up query parameters in request URLs
☆24Jun 30, 2016Updated 10 years ago
Alternatives and similar repositories for scrapy-querycleaner
Users that are interested in scrapy-querycleaner are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scrapy spider middleware to split an item into multiple items using a multi-valued key☆21Feb 8, 2017Updated 9 years ago
- A scrapy extension to store requests and responses information in storage service☆27Mar 11, 2022Updated 4 years ago
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆275Feb 26, 2025Updated last year
- A simple algorithm for clustering web pages, suitable for crawlers☆33Mar 6, 2017Updated 9 years ago
- An easy way to manage user alerting, providing a variety of alert options to speed up user alerting☆16Jul 26, 2016Updated 10 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A project to attempt to automatically login to a website given a single seed☆11Jun 17, 2024Updated 2 years ago
- Use Python3, Django, Django-rest-framework to achieve alipay payment. 包括支付宝支付，支付宝服务器异步通知，支付宝退款☆12May 26, 2018Updated 8 years ago
- Feature switches in Django☆36Jun 21, 2021Updated 5 years ago
- A Scrapy pipeline module to persist items to a postgres table automatically.☆21Aug 14, 2017Updated 9 years ago
- Tool to check DKIM-Signature of many emails and report results in a spreadsheet☆13Oct 21, 2016Updated 9 years ago
- 浏览过的精彩逆向文章汇总，值得一看☆10Mar 7, 2022Updated 4 years ago
- ☆29Apr 28, 2021Updated 5 years ago
- DjangoCMS Comments Module☆11Dec 26, 2022Updated 3 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆38May 21, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Allow to specify on which platform to run jest tests☆14Feb 10, 2025Updated last year
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 12 years ago
- Script that converts JSONL output from Doccano to the BIO format☆10Jul 5, 2019Updated 7 years ago
- Lets you transfer files and directories from your computer to your mobile device by scanning a QR code right from the terminal.☆13Dec 11, 2023Updated 2 years ago
- Parsing JavaScript objects into Python data structures☆220May 17, 2026Updated 4 months ago
- Automatic Route53 updates based on EC2 Autoscaling state changes☆10Dec 10, 2017Updated 8 years ago
- Composer plugin to automate the most common tasks of applications.☆14Jan 4, 2023Updated 3 years ago
- A complimentary proxy to help to use SPM with headless browsers☆109Oct 6, 2026Updated last week
- A CLI tool that leverages AWS Route53 Health Checks to globally test HTTP(S) endpoints up to 300 RPS☆16Oct 3, 2020Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Logging, with pretty coloured squares all over the place.☆18Dec 8, 2022Updated 3 years ago
- Code for our NeurIPS 2023 paper Towards Evaluating Transfer-based Attacks Systematically, Practically, and Fairly☆14Jan 22, 2024Updated 2 years ago
- A hierarchical environment manager for bash, written in bash.☆17Apr 18, 2026Updated 5 months ago
- Browse your Facebook messenger data and get fun insights.☆15May 6, 2021Updated 5 years ago
- The PlainFlow Digested Week is a crowdsourced email newsletter that goes to all the PlainFlow subscribers.☆12May 29, 2017Updated 9 years ago
- Common humanization utilities for Flask applications☆29Jan 20, 2022Updated 4 years ago
- Source code of "TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identification", ACL2024 (findings)☆15Nov 20, 2024Updated last year
- ☆10Aug 2, 2019Updated 7 years ago
- A simple command-line web crawler.☆13Feb 2, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Jerem is a golang bot that scrap JIRA project to extract Metrics. Those Metrics can then be send to a Warp 10 Backend.☆14Oct 5, 2020Updated 6 years ago
- Ruby on Rails☆11May 1, 2017Updated 9 years ago
- User friendly API query language☆11Mar 4, 2026Updated 7 months ago
- a starter project that supports social authentication☆17Mar 15, 2016Updated 10 years ago
- Library for annotation-based dependency injection☆24Oct 1, 2026Updated last week
- Airbyte deployment and configuration management tool☆12Feb 5, 2022Updated 4 years ago
- Documentation site for the Community Health Tookit☆15Updated this week