Scrapy middleware to handle javascript pages using selenium
☆20Jul 3, 2021Updated 5 years ago
Alternatives and similar repositories for better-scrapy-selenium
Users that are interested in better-scrapy-selenium are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scrapy project template. Use it to quickly spin up a new web scraping project☆16Nov 18, 2024Updated last year
- A scrapy spider for R18☆16Sep 9, 2026Updated 2 weeks ago
- A collection of pipelines for Scrapy☆16Sep 3, 2026Updated 3 weeks ago
- Enhanment Scrapping API for six hotel booking website from Expedia.com, Booking.com, Bookhotelbeds.com. Hotels.com, Bestday.com, despegar…☆11May 7, 2018Updated 8 years ago
- In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framewor…☆12Feb 2, 2020Updated 6 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Tracking the BitTorrent Infrastructure☆26Aug 31, 2026Updated 3 weeks ago
- A declarative data-migration package☆15Dec 7, 2024Updated last year
- The awful code behind the most beautiful torrent site to ever exist.☆11Jan 28, 2016Updated 10 years ago
- Archiving tool for Google Photos☆16Updated this week
- Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management☆17Sep 2, 2017Updated 9 years ago
- A Scrapy extension to log items coverage when the spider shuts down☆18Apr 11, 2020Updated 6 years ago
- ☆10May 4, 2020Updated 6 years ago
- A python CLI script to 𝗰𝗼𝗺𝗽𝗿𝗲𝘀𝘀 📦 all the 𝗣𝗗𝗙 files 𝗿𝗲𝗰𝘂𝗿𝘀𝗶𝘃𝗲𝗹𝘆 in a directory using the iLovePDF technology 🥰☆15Nov 26, 2021Updated 4 years ago
- Scrapy spider middleware to split an item into multiple items using a multi-valued key☆21Feb 8, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python Telegram notifier with a simple .send() API.☆19May 20, 2026Updated 4 months ago
- Plex import agent using .nfo descriptor files as source.☆19Jan 19, 2023Updated 3 years ago
- A dark mini-platform/RPG/adventure game using Pyxel engine.☆16May 27, 2024Updated 2 years ago
- Crawl your personal favorite images, photo albums, comics from website. Support pixiv, yande.re, x for now.☆25Apr 5, 2026Updated 5 months ago
- JAV site scrapers☆19Jul 6, 2022Updated 4 years ago
- Wikipedia "people" Images Dataset Downloader☆11Dec 3, 2023Updated 2 years ago
- The most advanced debugging and testing tool for Scrapy☆16Apr 19, 2023Updated 3 years ago
- A pytest plugin designed to simplify testing of applications that interact with Minio☆13Aug 6, 2025Updated last year
- 🐇 Typescript-first LLM framework with static type inference, testability, and composability.☆18Dec 1, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [PyPi Package] Convert Excel Sheet into JSON file.☆14Dec 26, 2022Updated 3 years ago
- Generate each Docker constraint label in random nodes in the cluster.☆16Aug 26, 2024Updated 2 years ago
- Scrapy downloader middleware that stores response HTMLs to disk.☆18Apr 14, 2026Updated 5 months ago
- MongoDB Admin - A Cross Platform GUI☆25Feb 11, 2022Updated 4 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆38May 21, 2024Updated 2 years ago
- Script to migrate your "watch" list of media to a new Plex server.☆21Sep 18, 2022Updated 4 years ago
- Handbook of Network Analysis – part of the KONECT project by Jérôme Kunegis☆15May 27, 2026Updated 4 months ago
- Scrapy, a fast high-level screen scraping and web crawling framework for Python.☆26Jan 18, 2016Updated 10 years ago
- Cached migrations on CI (and local) for faster migrations☆35Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Bulk Textbook Download Tool☆16Oct 17, 2023Updated 2 years ago
- Runs flake8 with Reviewdog☆18Mar 19, 2025Updated last year
- 组合多请求，抓取 结构化数据，基于scrapy组件☆29Dec 8, 2022Updated 3 years ago
- Your personal Internet Archive☆50Feb 29, 2024Updated 2 years ago
- A framework that let's you compose websites in Python with ease!☆15Jan 21, 2022Updated 4 years ago
- An app for generating prompts☆28Sep 21, 2026Updated last week
- 📸 Examples for the Uppload file uploading widget☆19Mar 6, 2023Updated 3 years ago