A library to make it easier to load input URLs to start scrapy processes
☆14Feb 21, 2021Updated 5 years ago
Alternatives and similar repositories for spider-feeder
Users that are interested in spider-feeder are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Library to populate items using XPath and CSS with a convenient API☆49Jan 29, 2026Updated 5 months ago
- Zyte Automatic Extraction integration for Scrapy☆58Apr 13, 2026Updated 2 months ago
- Library for annotation-based dependency injection☆24Mar 3, 2026Updated 4 months ago
- Extract price amount and currency symbol from a raw text string☆345Mar 19, 2026Updated 3 months ago
- Scrapinghub Command Line Client☆130Jun 26, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The most advanced debugging and testing tool for Scrapy☆16Apr 19, 2023Updated 3 years ago
- Web scraping Page Objects core library☆107Jun 22, 2026Updated last week
- A linter for Scrapy projects.☆22Feb 25, 2026Updated 4 months ago
- Web application to help categorize and aggregate subscriptions of media channels for easy access. (working only with Youtube channels at …☆16Aug 27, 2020Updated 5 years ago
- Simple Scrapy middleware to process non-well-formed HTML with BeautifulSoup☆22Sep 26, 2016Updated 9 years ago
- Ultra light and minimalist Datepicker with zero dependencies.☆12Sep 27, 2017Updated 8 years ago
- Read JSON lines (jl) files, including gzipped and broken☆36Apr 8, 2026Updated 2 months ago
- A client interface for Scrapinghub's API☆206Jun 24, 2026Updated last week
- Page Object pattern for Scrapy☆127Jun 8, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Internationalization library. Easy and Fast.☆13Nov 10, 2022Updated 3 years ago
- Scrapy downloader middleware that stores response HTMLs to disk.☆18Apr 14, 2026Updated 2 months ago
- A simple command-line web crawler.☆13Feb 2, 2020Updated 6 years ago
- User friendly API query language☆11Mar 4, 2026Updated 4 months ago
- Analyzes target website for anti-scraping protections and performance. Saves screenshots/HTML snapshots.☆11Aug 13, 2025Updated 10 months ago
- The Official Website™☆28Jan 1, 2013Updated 13 years ago
- A JupyterHub authenticator using Kerberos☆12Jun 2, 2026Updated last month
- Performance-focused replacement for Python urllib☆21Apr 13, 2026Updated 2 months ago
- Scrapy middleware which allows to crawl only new content☆80Apr 8, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python module that gives current information about orbital objects of interest☆12Dec 23, 2022Updated 3 years ago
- Cross-platform, graphics API agnostic, "Bring Your Own Engine/Framework" style rendering library.☆11Apr 25, 2021Updated 5 years ago
- Next generation contract testing☆12Jun 22, 2026Updated last week
- SCI1022 - Introduction to scientific coding☆11Mar 7, 2022Updated 4 years ago
- simple python gevent web spider☆23Jun 27, 2011Updated 15 years ago
- The Django Model Path Converter package dynamically creates custom path converters for you models.☆14Feb 15, 2023Updated 3 years ago
- WebSocket library for Python (ws4py)☆13Apr 26, 2012Updated 14 years ago
- Finite Element tools in Julia: Meshing of medical images☆10Apr 18, 2025Updated last year
- TOME is a file extension for the markup language Runic implemented in the hash/array database Indental.☆15May 19, 2018Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Python-based high-performance web tools - see http://chris.improbable.org/2010/01/30/quickly-testing-your-sites-using-webtoolbox/ for an …☆21Oct 24, 2017Updated 8 years ago
- Schedule for talks, workshops, etc. w/ links to past talk slides and videos.☆26Nov 9, 2017Updated 8 years ago
- Abaqus UEL and sample input files for modeling of dielectric elastomers☆16Aug 18, 2016Updated 9 years ago
- A grammar and parser to process natural language directives about duration and frequency of repeated tasks☆13Dec 4, 2017Updated 8 years ago
- Düsseldorf Advanced Material Simulation Kit (DAMASK) "live plotter" for Jupyter☆10May 8, 2019Updated 7 years ago
- High dimensional numbers and reductions recipes for data visualization of scientific machine learning (SciML)☆15Jun 26, 2026Updated last week
- Configure WAL-E S3 backups for Postgres☆14Mar 27, 2018Updated 8 years ago