Collect/process data via various data sources : website / js website / API. Run scrapping pipeline via Celery, and Travis cron task. Dump the scraped data to slack
☆14Jul 24, 2024Updated last year
Alternatives and similar repositories for web_scraping
Users that are interested in web_scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Stream/batch system with Hadoop, Spark on NYC taxi data | #DE☆26Apr 10, 2026Updated 3 weeks ago
- This is a simple Linear Regression implementation machine learning model and deployment of the same using flask. Data-set of Vadodara Hou…☆10Jan 8, 2020Updated 6 years ago
- My solutions to the algorithm questions on leetcode.☆14May 9, 2019Updated 7 years ago
- A project to design a fact and dimension star schema for optimizing queries on a flight booking database using PostgreSQL, a relational d…☆12Aug 15, 2021Updated 4 years ago
- This repository is a directory of all the projects done in the 30-day AI Internship of Pantech Solutions.☆10Nov 3, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Round 1 of 100 days of code in order to learn "Python with Django Framework"☆11Oct 18, 2021Updated 4 years ago
- Makes karaoke from any youtube video link. The method is based on machine learning methods. After dowloading video from Youtube, the audi…☆12Aug 6, 2023Updated 2 years ago
- A basic GUI for interacting with the Stability AI API for Stable Diffusion 3☆15Apr 22, 2024Updated 2 years ago
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆16Jan 22, 2024Updated 2 years ago
- Templates and things from my obsidian vault.☆11Mar 25, 2024Updated 2 years ago
- This is an official repository for the Article Generation app using Llama2, Pexels, and Streamlit.☆13Aug 5, 2023Updated 2 years ago
- ☆16Mar 23, 2023Updated 3 years ago
- Nano Bots for Obsidian: small, AI-powered bots that can be easily shared as a single file, designed to support multiple providers such as…☆15Jan 13, 2024Updated 2 years ago
- 📧 Python script to forward emails using Gmail.☆10Apr 4, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A financial assistant using LLMs and Ntropy transaction enrichment☆10Jul 18, 2023Updated 2 years ago
- ☆15Aug 3, 2022Updated 3 years ago
- ☆16Jan 23, 2025Updated last year
- Create Unlimited Facebook Account with Email and Number☆10Feb 24, 2021Updated 5 years ago
- Flight computer software for UCLA's rocket team.☆13Mar 18, 2017Updated 9 years ago
- Use LLM to generate Obsidian timeline style Cornell notes☆12May 10, 2023Updated 2 years ago
- This node recovers new rows from Google Sheets sheet☆14Oct 13, 2022Updated 3 years ago
- A music server that streams mp3 files based on YouTube videos and Spotify data☆10Nov 2, 2023Updated 2 years ago
- An automation script written in Node.js, powered by Puppeteer to scrape multiple pages of Justdial (an Indian Yellow Pages website) and e…☆16Jun 17, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Open Source bro of my conversational agent. https://github.com/mfmezger/conversational-agent-langchain☆14Feb 5, 2024Updated 2 years ago
- ☆19Jun 22, 2023Updated 2 years ago
- Humanlike AI Chat is a terminal-based LLM UI designed to study how to bypass AI text detection.☆12Mar 15, 2024Updated 2 years ago
- This n8n node lets you easily and efficiently use JSON files as persistent, hierarchical key-value databases/stores.☆15Aug 31, 2023Updated 2 years ago
- Use AI to shorten and re-narrate audiobooks☆16Sep 24, 2024Updated last year
- Proof of concept for a security issue (in my opinion) that I found in accounts.google.com☆22Jun 3, 2014Updated 11 years ago
- Spark example of collecting tweets and loading into HDFS/S3☆42Oct 2, 2013Updated 12 years ago
- YouTube Downloader is a powerful Python script that allows you to download YouTube videos and playlists effortlessly. Whether you want to…☆16Apr 11, 2025Updated last year
- iOS app with AI for an immersive audiobook experience, text-to-speech and background image generation - developed during Apple Foundation…☆17Sep 29, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ::A tool to abbreviate scientific paper contents using ChatGPT::☆13Nov 20, 2023Updated 2 years ago
- AI Service that classifies data with given or passed model structure response to use in code☆12Apr 25, 2023Updated 3 years ago
- Demonstrations and visualizations of sorting algorithms (Python and C++).☆22Oct 21, 2018Updated 7 years ago
- Tweepy Stream Example☆19Apr 23, 2019Updated 7 years ago
- Demo Django (Django Rest Framework) API uploads .csv/.xlsx for bulk data, queries via text for accurate results. Integrated with OpenAI u…☆13Nov 11, 2023Updated 2 years ago
- ☆11Feb 7, 2021Updated 5 years ago
- An automated tool that generates Notion pages from bookmarks or just a list of URLs, using BeautifulSoup for web scraping, OpenAI's GPT m…☆13Mar 26, 2026Updated last month