In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framework.
☆12Feb 2, 2020Updated 6 years ago
Alternatives and similar repositories for scrapy
Users that are interested in scrapy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A collection of pipelines for Scrapy☆16Updated this week
- ☆14Nov 2, 2018Updated 7 years ago
- Repo to keep my dotfiles☆16May 10, 2026Updated 3 months ago
- ☆13Nov 26, 2019Updated 6 years ago
- Templater script for sending Obsidian thoughts to Napkin.one as new ideas☆12May 10, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Fail-proof, cross platform serial data logger with timestamp function☆19Aug 9, 2021Updated 5 years ago
- A scrapy spider for R18☆16Updated this week
- A Scrapy extension to log items coverage when the spider shuts down☆18Apr 11, 2020Updated 6 years ago
- needjs is a module that will help you satisfy your needs and handles their requirement.☆14Oct 29, 2020Updated 5 years ago
- ☆14Oct 25, 2022Updated 3 years ago
- JAV site scrapers☆19Jul 6, 2022Updated 4 years ago
- Spacelapser is a tool for exploring videos as three-dimensional volumes.☆25Feb 4, 2022Updated 4 years ago
- Towards Few-Shot Fact-Checking via Perplexity☆13Jun 11, 2021Updated 5 years ago
- Enhanment Scrapping API for six hotel booking website from Expedia.com, Booking.com, Bookhotelbeds.com. Hotels.com, Bestday.com, despegar…☆11May 7, 2018Updated 8 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Code for ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context☆17Nov 15, 2024Updated last year
- Reverse whois query tool☆11Jul 28, 2016Updated 10 years ago
- ☆15Nov 11, 2023Updated 2 years ago
- ☆19Jun 4, 2018Updated 8 years ago
- convert image-based subtitles to text-based via OCR and language recognition☆26Jul 30, 2026Updated 2 weeks ago
- SpanAlign: Sentence Alignment Method based on Cross-Language Span Prediction and ILP☆15Mar 24, 2021Updated 5 years ago
- ☆13May 30, 2022Updated 4 years ago
- An application made in Electron+Vue for creating game cards☆11Updated this week
- Stream processing engine☆13Apr 7, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Dec 3, 2018Updated 7 years ago
- A library and command line tool utility to organise your media ( Photos and videos ) better☆16Nov 15, 2018Updated 7 years ago
- CSS Code Formatter Engine that implements the Kary Coding Standards☆12Dec 7, 2022Updated 3 years ago
- ☆12Feb 9, 2019Updated 7 years ago
- Simple indentation sensitive parser-combinators for parsec☆20Oct 2, 2023Updated 2 years ago
- The code for HerO: a fact-checking pipeline based on open LLMs (the runner-up in AVeriTeC)☆14Mar 18, 2025Updated last year
- ☆13Jun 21, 2021Updated 5 years ago
- SemEval-2018 Task 1 Affect in Tweets Evaluation Script☆14Dec 28, 2017Updated 8 years ago
- A Persian Word2Vec Model trained by Wikipedia articles☆10Jan 5, 2018Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A chat application with nodejs and socketIO☆11Nov 7, 2018Updated 7 years ago
- Track torrent-trackers☆21Oct 3, 2012Updated 13 years ago
- 🦋 verify http://shaparak.ir gateways and protect users against phishing attacks.☆13Nov 21, 2018Updated 7 years ago
- SharedVault is a small application that allows you to define a secret that will require multiple people to unlock.☆13Apr 29, 2021Updated 5 years ago
- Simple front-end terminal simulator with animation.☆10Nov 6, 2016Updated 9 years ago
- The awful code behind the most beautiful torrent site to ever exist.☆11Jan 28, 2016Updated 10 years ago
- An awesome cheatsheet manager.☆18Mar 28, 2021Updated 5 years ago