Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.
☆87Apr 21, 2026Updated 3 weeks ago
Alternatives and similar repositories for WebScraper
Users that are interested in WebScraper are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Source code for Django for Beginners 4.2☆11Jul 10, 2024Updated last year
- Source code for tutorial on login/logout/signup with a Custom User Model in Django.☆13Dec 21, 2017Updated 8 years ago
- Source code for Django Testing Tutorial☆11Jul 17, 2022Updated 3 years ago
- Source code for DjangoCon US 2019 talk☆10Apr 21, 2023Updated 3 years ago
- Example app for Django Boston talk on DRF + React☆11May 10, 2018Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 🚀 Save Months of Development Time with Om Startup Framework 🔥☆17Mar 5, 2024Updated 2 years ago
- A blog with Django/Django Rest Framework backend and React frontend.☆19Apr 6, 2018Updated 8 years ago
- Source code for Django Slug Tutorial☆13Sep 22, 2021Updated 4 years ago
- A Django-powered contact form☆16Oct 4, 2018Updated 7 years ago
- Real estate web crawler using scrapy.☆12Dec 13, 2015Updated 10 years ago
- Real Estate App☆12Jun 20, 2013Updated 12 years ago
- 446 technical analysis indicators for TradingView's lightweight-charts library☆137May 4, 2026Updated 2 weeks ago
- Source code for 3.1 version of Django for APIs☆17Feb 24, 2022Updated 4 years ago
- A laptop‑friendly toolkit for context‑aware single‑word paraphrasing and lexical‑substitution benchmarking☆46Apr 23, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- In a simple word, it is an "Automatic WP Exploiter".☆17Dec 26, 2016Updated 9 years ago
- Python script i wrote to automatically open a website in Tor Browser and then close it and reopen. By using Tor Browser the IP will chang…☆15Jul 17, 2020Updated 5 years ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆171Dec 19, 2025Updated 5 months ago
- A python script that generates leads by scrapping business data from Google maps, LinkedIn and Yelp .☆17Jan 1, 2020Updated 6 years ago
- Instagram bot that upload images for you which scrape posts from 9gag meme website or other Instagram users , which is 24/7 Automated Run…☆23Aug 31, 2021Updated 4 years ago
- Drag+Drop CMS Template with ⚡ nextjs 👷♀️ builder.io 💅 tailwind 🌐 localization☆13Oct 26, 2023Updated 2 years ago
- This is a demo project to compare two web scrapping frameworks, Playwright and Selenium and using the new Pipelining tool Dagster☆15Sep 9, 2021Updated 4 years ago
- An OpenCV application for measurement of the diameter of rings using a web camera☆10Jun 22, 2018Updated 7 years ago
- Automate monitoring prices on the most popular solution for building online stores and selling products online. Crawl arbitrary Shopify-p…☆15Jun 5, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A free, open-source React Tailwind 3.x admin dashboard with dark mode, built using Next.js and TypeScript. It provides a responsive and c…☆10Nov 11, 2025Updated 6 months ago
- Evaluate JavaScript on a URL through headless Chrome browser.☆25Jun 18, 2021Updated 4 years ago
- Source code for DjangoConUS 2018 talk☆25Dec 8, 2022Updated 3 years ago
- Demonstrate using MCP with Pydantic AI framework☆14Mar 14, 2025Updated last year
- A scheduler to manage a multi tool dual arm robot while avoiding arm-to-arm collisions; considering complex side constraints; and optimiz…☆11Jul 6, 2021Updated 4 years ago
- ☆11Apr 13, 2017Updated 9 years ago
- AI app to generate blog from youtube video url.☆14Nov 1, 2023Updated 2 years ago
- Continuous Time Markov Chains☆11May 3, 2026Updated 2 weeks ago
- T.U.F.F. - Targeted Utility for Fast Forensics is mainly used to recon websites and IP addresses for vulnerabilities for an easier pentes…☆11May 26, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- project trying to replicate http://arxiv.org/pdf/1412.5567v2.pdf☆12Mar 22, 2015Updated 11 years ago
- OnlyFans Automation Tool☆10Jun 24, 2024Updated last year
- A secure cross-platform note-taking application. Features end-to-end encryption for cloud sync and a modern React frontend.☆14Jul 11, 2025Updated 10 months ago
- merges pymatgen, custodian, and FireWorks into a custom workflow for Materials Project☆25Jul 6, 2019Updated 6 years ago
- scriptreplay in the browser. Save your terminal window content and replay it on your website.☆21Apr 27, 2022Updated 4 years ago
- A repository of basic quantitative finance tools to be used on other projects☆11Mar 19, 2020Updated 6 years ago
- A toy compiler made with LLVM☆16Aug 30, 2024Updated last year