Collect/process data via various data sources : website / js website / API. Run scrapping pipeline via Celery, and Travis cron task. Dump the scraped data to slack
☆14Jul 24, 2024Updated last year
Alternatives and similar repositories for web_scraping
Users that are interested in web_scraping are comparing it to the libraries listed below
Sorting:
- This is a demo project to compare two web scrapping frameworks, Playwright and Selenium and using the new Pipelining tool Dagster☆15Sep 9, 2021Updated 4 years ago
- Makes karaoke from any youtube video link. The method is based on machine learning methods. After dowloading video from Youtube, the audi…☆12Aug 6, 2023Updated 2 years ago
- Compass is a suite of tools for students enrolled in the University of London's online BSc in Computer Science program.☆11Feb 22, 2023Updated 3 years ago
- Flight computer software for UCLA's rocket team.☆13Mar 18, 2017Updated 8 years ago
- 📧 Python script to forward emails using Gmail.☆10Apr 4, 2023Updated 2 years ago
- YouTube Downloader is a powerful Python script that allows you to download YouTube videos and playlists effortlessly. Whether you want to…☆16Apr 11, 2025Updated 10 months ago
- Use LLM to generate Obsidian timeline style Cornell notes☆11May 10, 2023Updated 2 years ago
- A music server that streams mp3 files based on YouTube videos and Spotify data☆10Nov 2, 2023Updated 2 years ago
- Scrape and convert Prezi presentations to PDF☆13Mar 24, 2022Updated 3 years ago
- Nano Bots for Obsidian: small, AI-powered bots that can be easily shared as a single file, designed to support multiple providers such as…☆15Jan 13, 2024Updated 2 years ago
- No-Nonsense AI Browser Extension☆12Jan 27, 2026Updated last month
- Using PDFPlumber for PDF data extraction☆12May 31, 2017Updated 8 years ago
- Python Script To Scrape Instagram And Print Number Of FOLLOWERS, FOLLOWING And POSTS Of User-Input Instagram Username☆13Sep 19, 2019Updated 6 years ago
- The ultimate AI detection bypass tool.☆13Jan 22, 2024Updated 2 years ago
- ☆11Mar 29, 2021Updated 4 years ago
- This project helps in monitoring the performance of your LinkedIn posts over a specified amount of time by the user and analyzes their e…☆12Apr 22, 2023Updated 2 years ago
- AI Service that classifies data with given or passed model structure response to use in code☆12Apr 25, 2023Updated 2 years ago
- Humanlike AI Chat is a terminal-based LLM UI designed to study how to bypass AI text detection.☆12Mar 15, 2024Updated last year
- A basic GUI for interacting with the Stability AI API for Stable Diffusion 3☆15Apr 22, 2024Updated last year
- InstaBot is a powerful Instagram bot that offers several advanced features to make your Instagram experience better. With InstaBot, you c…☆13Oct 18, 2023Updated 2 years ago
- OSINT tool allowing the exploration and the scrapping of a user's public data from a Google email address (gmail, googlemail) to find You…☆58Mar 25, 2024Updated last year
- Zenhub On-Premise brings all the benefits of Zenhub.com to your own private cloud.☆14Feb 2, 2026Updated last month
- An automation script written in Node.js, powered by Puppeteer to scrape multiple pages of Justdial (an Indian Yellow Pages website) and e…☆16Jun 17, 2024Updated last year
- Find your perfect co-founder with our AI-powered matching platform! Built on Node.js/Express and React, it's the ultimate tool to launch …☆12Sep 30, 2023Updated 2 years ago
- Svelte app to generate audiobooks using XTTS☆12Feb 13, 2024Updated 2 years ago
- Full Stack AI Mock Interview App with Next.js! 💻 In this tutorial, we'll use React, Drizzle ORM, Gemini AI, and Clerk to create a power…☆27Mar 25, 2025Updated 11 months ago
- Notion class notes/study template automated using a CLI to seamlessly integrate scientifically proven study techniques with minimal frict…☆23Apr 29, 2025Updated 10 months ago
- A small but scalable learning management system built using Django☆13Jun 10, 2021Updated 4 years ago
- A simple Playwright crawler that stores Google Maps Place/Business reviews to a JSON file.☆14Jun 18, 2024Updated last year
- This Node.js app built with MongoDB allows users to compare both scores from Yelp and Google+ for a restaurant at the same time. It uses …☆10Oct 18, 2015Updated 10 years ago
- Paperwise is a systematic and streamlined research workflow for managing AI papers that revolves around three core tools: Zotero, Researc…☆14Apr 11, 2025Updated 10 months ago
- Open Source bro of my conversational agent. https://github.com/mfmezger/conversational-agent-langchain☆14Feb 5, 2024Updated 2 years ago
- watch your screen while doing sales and fill your crm automatically☆17Jun 2, 2024Updated last year
- A carefully curated selection of thought-provoking prompts for ChatGPT!☆17May 5, 2023Updated 2 years ago
- Pull list of leads from a Twitter Ads Lead Generation Card☆12Feb 7, 2017Updated 9 years ago
- Arduino Sketch for eye animatronics☆14May 13, 2019Updated 6 years ago
- ☆14Jul 9, 2020Updated 5 years ago
- Script to automatically transfer todos (or anything) from your Obsidian-files (or any file) to your task system (or any email)☆11Jan 11, 2021Updated 5 years ago
- A tool that automates your way to becoming an Instagram influencer☆14Feb 25, 2023Updated 3 years ago