al-serebrov / scrapinghub-elasticsearch-loaderLinks
Load items from Scrapinghub to ElasticSearch
☆11Updated 3 years ago
Alternatives and similar repositories for scrapinghub-elasticsearch-loader
Users that are interested in scrapinghub-elasticsearch-loader are comparing it to the libraries listed below
Sorting:
- A browser extension to monitor your spiders deployed on Scrapy Cloud.☆16Updated 9 months ago
- Scrapy Training companion code☆173Updated 6 years ago
- Splash + HAProxy + Docker Compose☆197Updated 7 years ago
- Generator of User-Agent header☆347Updated 3 months ago
- Async WebDriver implementation for asyncio and asyncio-compatible frameworks☆356Updated last year
- A Scrapy extension to log items coverage when the spider shuts down☆19Updated 5 years ago
- Extract price amount and currency symbol from a raw text string☆342Updated 2 months ago
- Python module for Yandex.Translate API☆99Updated 5 years ago
- Python DSL for Elasticsearch☆25Updated last month
- A client interface for Scrapinghub's API☆205Updated 2 months ago
- 🎭 Twisted Deferred Thread backend for Requests.☆419Updated 6 years ago
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆276Updated 9 months ago
- HTTP API for Scrapy spiders☆871Updated 2 months ago
- [not actively maintained] A lightweight Python library that uses Webkit to enable easy scraping of dynamic, Javascript-heavy web pages☆532Updated 8 years ago
- Flexible microkit for Flask microframework☆231Updated 7 years ago
- Convert Javascript code to an XML document☆187Updated 3 years ago
- A scalable frontier for web crawlers☆1,324Updated 6 months ago
- Python library of web-related functions☆411Updated this week
- Parsing JavaScript objects into Python data structures☆216Updated 4 months ago
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.☆551Updated 2 years ago
- Random User-Agent middleware based on fake-useragent☆693Updated 2 years ago
- Dockerized Selenium and Python with support for Chrome, Firefox and PhantomJS☆295Updated 3 years ago
- An opinionated list of awesome videos related to Python, with a focus on training and gaining hands-on experience.☆517Updated 3 years ago
- Code for the examples on my article in Medium AsyncIO for the Working Python Developer☆235Updated 3 years ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆110Updated last year
- Scrapy Middleware to set a random User-Agent for every Request.☆202Updated 6 years ago
- Runs things in the background.☆510Updated 3 months ago
- A Python wrapper for working with Scrapyd's API.☆270Updated last year
- A library to make it easier to load input URLs to start scrapy processes☆14Updated 4 years ago
- Execute Scrapy spiders in a Flask web application☆68Updated 3 years ago