Awesome list for datapipeline
☆38Feb 6, 2023Updated 3 years ago
Alternatives and similar repositories for awesome-data-pipeline
Users that are interested in awesome-data-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is a Python project that uses BeautifulSoup and requests libraries to scrape real estate data from a website and store it in a datab…☆11Feb 28, 2023Updated 3 years ago
- 🤓 My curated lists of awesome data science books and resources.☆13Apr 22, 2025Updated last year
- This repo contains a Python script that crawls gig information from the "Data Processing" category on Fiverr☆10Oct 29, 2022Updated 4 years ago
- A webscraper to automate Upwork job searches using Playwright. Saves job data to CSV or JSON.☆13Mar 15, 2026Updated 8 months ago
- AI-powered invoice processing system built with Python, GPT-4o and Pandas. Automates data extraction, financial analysis and report gene…☆11Jul 28, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- ☆16Nov 14, 2024Updated 2 years ago
- ☆14Feb 23, 2025Updated last year
- A python script to convert JSON files into Excel, CSV and combine multiple CSV to Single Excel☆23Dec 24, 2019Updated 6 years ago
- This Python web-scraping project retrieves product names, prices, review stars, and review counts for a specific product category.☆16Jul 23, 2023Updated 3 years ago
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆17Mar 14, 2024Updated 2 years ago
- Collection of re-usable Shiny features and components.☆11Jul 13, 2022Updated 4 years ago
- ☆31Apr 18, 2026Updated 7 months ago
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This project aims to build a small language model for few-shot classification tasks. This includes all of the infrastracture needed to tr…☆12Aug 31, 2024Updated 2 years ago
- ETL of newspaper article keywords using Apache Airflow, Newspaper3k, Quilt T4 and AWS S3☆16Aug 4, 2026Updated 3 months ago
- Web scraping and descriptive and predictive modelling of Bogor house pricing☆11Mar 29, 2025Updated last year
- ☆10Dec 2, 2025Updated 11 months ago
- end-to-end information extraction pipeline built by LayoutLMV2, pretrained model from HuggingFace☆11Aug 15, 2023Updated 3 years ago
- Repository contains a web crawler that searches for emails in a webpage, along with a webscraping script that collects leads from various…☆21Jul 19, 2022Updated 4 years ago
- Curated List for 2025 Full Time Job Openings by DataDrooler☆25Aug 25, 2025Updated last year
- A Python script that uses Selenium and BeautifulSoup to scrape data from Amazon websites. This script can be used to extract information …☆28Feb 4, 2023Updated 3 years ago
- R package for agent orchestration☆12Apr 26, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is a repository of Swagger documents representing the HL7 FHIR REST API Implementation.☆11Aug 4, 2017Updated 9 years ago
- Open mHealth Schema mapping to FHIR resources. This site is published at:☆12Dec 9, 2022Updated 3 years ago
- ☆11May 28, 2018Updated 8 years ago
- A demo and tutorial for Council that implements a financial analyst agent.☆11Jun 21, 2024Updated 2 years ago
- RapiDoc UI integration for R☆14Nov 17, 2023Updated 3 years ago
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated 2 years ago
- UIkit API for shiny☆14Jul 22, 2019Updated 7 years ago
- Quora Paraphrasing Dataset Bahasa Indonesia Version☆11Apr 18, 2021Updated 5 years ago
- Terraform module which creates Redis ElastiCache resources on AWS.☆12Dec 9, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- flexible pipelines for scalable secretome prediction, R package☆12Feb 21, 2019Updated 7 years ago
- learning management system written in python/django☆10Feb 9, 2026Updated 9 months ago
- Segmenting text blocks and baselines from documents using deep learning techniques☆13Jul 27, 2021Updated 5 years ago
- detecting the meotions using by analysing the sound of the person unsing python☆11Oct 7, 2019Updated 7 years ago
- CardiacProfileR: An R package for extraction and visualisation of heart rate profiles from wearable fitness trackers☆13Jun 10, 2018Updated 8 years ago
- repo of files pertaining to realtime, offline translations using whisper realtime and argos translate. This repo is marked Creative Commo…☆19May 20, 2025Updated last year
- Learn GNU Assembler (as or gas) this book is great and I'm going to update it to enhance it.☆20Updated this week
Are these results useful?