MongoDB extensions for Scrapy
☆44Oct 2, 2014Updated 12 years ago
Alternatives and similar repositories for scmongo
Users that are interested in scmongo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast Python Bloom Filter using Mmap☆13Aug 20, 2012Updated 14 years ago
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- A project to attempt to automatically login to a website given a single seed☆11Jun 17, 2024Updated 2 years ago
- A RabbitMQ/Redis tool for Scrapy☆13Oct 7, 2016Updated 10 years ago
- A python library detect and extract listing data from HTML page.☆110May 5, 2017Updated 9 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Small set of utilities to simplify writing Scrapy spiders.☆50Jul 24, 2015Updated 11 years ago
- Automatic Item List Extraction☆85Jun 15, 2016Updated 10 years ago
- Deprecated HubStorage client library - please use python-scrapinghub>=1.9.0 instead☆16Dec 5, 2016Updated 9 years ago
- Useful test spiders for Scrapy☆184Jan 20, 2020Updated 6 years ago
- Convert Javascript code to an XML document☆187Mar 14, 2022Updated 4 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Mar 16, 2022Updated 4 years ago
- Find which links on a web page are pagination links☆29Jan 12, 2017Updated 9 years ago
- ☆223Apr 27, 2015Updated 11 years ago
- Output scrapy statistics to graphite/carbon☆54Mar 9, 2013Updated 13 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Scrapy spider middleware to split an item into multiple items using a multi-valued key☆21Feb 8, 2017Updated 9 years ago
- Esse é o modelo de curso a ser seguido pela Webschool,☆10Aug 26, 2015Updated 11 years ago
- Handy Java concurrency constructs☆13Jul 31, 2013Updated 13 years ago
- Using the elrte rich text editor within Django without creating dependencies☆11Dec 17, 2022Updated 3 years ago
- A client interface for Scrapinghub's API☆204Updated this week
- Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)☆33Feb 22, 2018Updated 8 years ago
- Tool to flatten stream of JSON-like objects, configured via schema☆33Oct 19, 2019Updated 7 years ago
- Exemplo de integração MoIP - Django☆13Sep 6, 2010Updated 16 years ago
- Rust hashmap based on a faster hash function and Python dictionaries☆10Jan 28, 2016Updated 10 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- reCAPTCHA themes based on Bootstrap and Font Awesome!☆13Mar 24, 2015Updated 11 years ago
- Match documents against large sets of saved queries in one Python process. Built for scraping and alerts.☆28Sep 6, 2026Updated last month
- Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…☆54May 21, 2024Updated 2 years ago
- Django project template, integrated GruntJS watch tasks☆22May 25, 2013Updated 13 years ago
- Keywords enrichment by autocompletion (AWS, PM, RDC, CDS, ...), google suggestion scraping Heavy multithreaded semantic corpus crawler S…☆12May 22, 2015Updated 11 years ago
- A CLI for benchmarking Scrapy.☆32Jun 28, 2025Updated last year
- A pure-python HTML screen-scraping library☆1,884Apr 4, 2022Updated 4 years ago
- Blog crawler for the blogforever project.☆23Jan 31, 2014Updated 12 years ago
- Sony PlayStation 2 (PS2)☆11Jul 16, 2026Updated 3 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆11Jun 28, 2026Updated 4 months ago
- Practice spelling Red Words☆12Sep 8, 2026Updated last month
- A generic crawler☆81Apr 8, 2026Updated 6 months ago
- Web based rss reader written in python using tornado☆13Aug 17, 2014Updated 12 years ago
- Crawlera tools☆26Feb 9, 2016Updated 10 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Dec 15, 2012Updated 13 years ago
- ☆10Jan 5, 2018Updated 8 years ago