A collection of awesome web crawler,spider in different languages
☆7,359Jun 16, 2024Updated 2 years ago
Alternatives and similar repositories for awesome-crawler
Users that are interested in awesome-crawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- List of libraries, tools and APIs for web scraping and data processing.☆8,205Oct 27, 2026Updated last week
- awesome cheatsheet☆8,655Oct 20, 2026Updated 2 weeks ago
- The most awesome list about bots ⭐️🤖☆4,206Jul 3, 2024Updated 2 years ago
- Awesome tooling and resources in the Chrome DevTools & DevTools Protocol ecosystem☆7,190Oct 6, 2026Updated 3 weeks ago
- 🌟 Curated design resources from all over the world.☆17,727Jul 4, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A curated list of awesome Hacking tutorials, tools and resources☆17,388Jun 2, 2024Updated 2 years ago
- Resources for independent developers to make money☆11,946Jun 12, 2024Updated 2 years ago
- A curated list of awesome big data frameworks, ressources and other awesomeness.☆14,713Updated this week
- Scrapy, a fast high-level web crawling & scraping framework for Python.☆65,151Updated this week
- A Powerful Spider(Web Crawler) System in Python.☆16,750Apr 30, 2024Updated 2 years ago
- A collection of APIs☆13,186Feb 29, 2020Updated 6 years ago
- The definitive list of lists (of lists) curated on GitHub and elsewhere☆11,620Updated this week
- A curated list of awesome command-line frameworks, toolkits, guides and gizmos. Inspired by awesome-php.☆37,878Aug 28, 2025Updated last year
- A curated list of Docker resources and projects☆37,148Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A list of history's greatest software engineers and tech pioneers☆2,576May 11, 2021Updated 5 years ago
- 📝 A curated list of awesome Raspberry Pi tools, projects, images and resources☆17,064Oct 27, 2026Updated last week
- Use your terminal shell to do awesome things.☆4,231Mar 4, 2026Updated 7 months ago
- Cool open source projects. Choose your project and get involved in Open Source development now.☆9,970Oct 26, 2026Updated last week
- A list of awesome projects and resources that make Linux even more awesome.☆5,184Feb 4, 2023Updated 3 years ago
- Visual scraping for Scrapy☆9,501Jun 26, 2024Updated 2 years ago
- 🐶 A curated list of Web Security materials and resources.☆13,990Updated this week
- Distributed crawler powered by Headless Chrome☆5,631Apr 29, 2023Updated 3 years ago
- A collection of links for free stock photography, video and Illustration websites☆14,665Feb 11, 2026Updated 8 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A curated list of delightful Bash scripts and resources.☆10,178May 21, 2026Updated 5 months ago
- Programming style, best practices, and coding conventions.☆11,236Sep 28, 2026Updated last month
- A curated list of Microservice Architecture related principles and technologies.☆14,560Aug 20, 2026Updated 2 months ago
- 🖥 📊 🕹 🛠 A curated list of command line apps☆20,586Oct 12, 2026Updated 3 weeks ago
- A collection of awesome web scaper, crawler.☆295Apr 4, 2024Updated 2 years ago
- ₿ A guide (for humans!) to cryto-currencies and their algos.☆4,121Jul 20, 2023Updated 3 years ago
- 🎬 A curated list of movies every hacker & cyberpunk must watch.☆11,990Aug 1, 2024Updated 2 years ago
- A collection of awesome penetration testing resources and tools☆27,615Jul 25, 2026Updated 3 months ago
- an awesome list of honeypot resources☆10,646Jun 1, 2026Updated 5 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A curated list of awesome infosec courses and training resources.☆5,774Aug 28, 2026Updated 2 months ago
- Let's learn a new technology every week. A new technology blog every Sunday in 2016.☆7,331Oct 18, 2022Updated 4 years ago
- Creative Coding: Generative Art, Data visualization, Interaction Design, Resources.☆15,535Jul 21, 2026Updated 3 months ago
- 🎨 A curated list of delightful VS Code packages and resources.☆29,187Jun 21, 2026Updated 4 months ago
- Awesome npm resources and tips☆4,754Apr 20, 2026Updated 6 months ago
- A curated list of awesome resources for Electronic Engineers and hobbyists☆8,318Oct 12, 2026Updated 3 weeks ago
- A curated list of Web Performance Optimization.☆9,159Oct 16, 2026Updated 2 weeks ago