Python-driven web crawler and scraper. Uses BeautifulSoup to gather all URLs from a target page, and initiates a crawl from a start URL, considering Whitelist/Blacklist criteria that are populated in crawl.py
☆20Jul 25, 2011Updated 14 years ago
Alternatives and similar repositories for python_crawler
Users that are interested in python_crawler are comparing it to the libraries listed below
Sorting:
- Collection of useful tools to analyse Google Analytics☆10Dec 11, 2015Updated 10 years ago
- Curated list of free courses & certifications☆11Oct 23, 2023Updated 2 years ago
- ☆12Jan 25, 2018Updated 8 years ago
- GDorks Web is a Flask-based web application that allows users to browse and retrieve random Google Dorks from the GDorks repository on Gi…☆11Jul 24, 2025Updated 7 months ago
- Kali Linux Tools - The Collection of tools.☆10Jun 26, 2020Updated 5 years ago
- Real-time pix2pix implementation with Unity☆10Oct 17, 2018Updated 7 years ago
- A collection of all the Google Data Studio Community Connectors that I've built over time.☆11Jun 17, 2022Updated 3 years ago
- This is a web site scraper. Collects all urls from any site.☆16Apr 28, 2015Updated 10 years ago
- Little repo with my CS2 config and some of things I do to make the game run optimally.☆13Feb 20, 2025Updated last year
- Fork of the official SecLists☆10Jul 9, 2018Updated 7 years ago
- A list of awesome beginners-friendly projects.☆12Oct 5, 2020Updated 5 years ago
- Playground of WebVI experiments for G Web Development Software☆15Oct 8, 2025Updated 4 months ago
- A Simple Web scraper. Using a URL and an HTML tag provided by a user scraps the page and returns the total number of elements fetched and…☆11Feb 12, 2022Updated 4 years ago
- Create QR menus for your restaurant.☆18Feb 1, 2024Updated 2 years ago
- ☆10Feb 16, 2021Updated 5 years ago
- ☆13Oct 12, 2023Updated 2 years ago
- A list of useful payloads and bypass for Web Application Security and Pentest/CTF☆15Apr 22, 2020Updated 5 years ago
- A collection of hacking / penetration testing resources to make you better!☆12Oct 1, 2020Updated 5 years ago
- This practice_gui.cfg file lets you setup a practice server very easy to tweak through console with a GUI for CS2, it comes with addition…☆20Feb 28, 2025Updated last year
- Host your Discord bot for free☆13Mar 17, 2023Updated 2 years ago
- evilginx2 + gophish☆18Oct 5, 2022Updated 3 years ago
- Session hijacking GUI tool☆15Oct 20, 2013Updated 12 years ago
- A chatbot that does tarot spreads.☆18Oct 28, 2025Updated 4 months ago
- Cheatsheet and bash scripts sripts for Synology Nas Stations☆19Apr 1, 2019Updated 6 years ago
- Welcome to the page where you will find each trick/technique/whatever I have learnt in CTFs, real life apps, and reading researches and n…☆16Mar 12, 2023Updated 2 years ago
- XSS-Freak is an xss scanner fully written in python3 from scratch. it is one of its kind since it crawls the website for all possible lin…☆15Nov 25, 2019Updated 6 years ago
- Black-Tool-For-Windows☆15Sep 8, 2021Updated 4 years ago
- Google Fonts Archived☆19May 14, 2025Updated 9 months ago
- Repo of Ducky scripts I have created for the O.MG Cable and FlipperZero☆22Dec 27, 2022Updated 3 years ago
- Generate Malicious QR or similar☆16Jun 7, 2023Updated 2 years ago
- This is try to monitor twitch chat and get some stats, patterns, data.☆13Nov 1, 2016Updated 9 years ago
- Generate your own personal url shortener to deploy to Vercel.☆18Aug 10, 2022Updated 3 years ago
- ☆20Mar 1, 2024Updated 2 years ago
- Exfiltrating "google account password" and "android cookies" made easy with evil browser. Checkout YouTube : https://youtu.be/pvuT0m4QUbU☆14May 11, 2023Updated 2 years ago
- A web service to assist your masturbation life.☆20Oct 14, 2024Updated last year
- A new Connect Message, using the new HUD☆12Feb 25, 2020Updated 6 years ago
- Shuttle is a multi-purpose AI having the capability to generate Text/Images dedicated to enhancing your Discord experience.☆18Dec 19, 2024Updated last year
- Cheatsheet and bash scripts sripts for Synology Nas Stations cheet cheat sheet nas networkdisk☆23Aug 22, 2022Updated 3 years ago
- Swapping files loaded by Source 2☆22Jun 28, 2024Updated last year