Awesome list for datapipeline
☆37Feb 6, 2023Updated 3 years ago
Alternatives and similar repositories for awesome-data-pipeline
Users that are interested in awesome-data-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Jul 17, 2026Updated 3 weeks ago
- ☆14Nov 14, 2024Updated last year
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 2 years ago
- The Christmas Project is a festive-themed data engineering initiative designed to integrate and analyze diverse datasets, creating a comp…☆20Jan 11, 2025Updated last year
- A collection of sieve filters for my Proton account.☆15Dec 18, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆22Apr 18, 2026Updated 3 months ago
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆17Mar 14, 2024Updated 2 years ago
- Demo of DuckDB Spark API implements. Same Pyspark code, but DuckDB under the hood☆15Nov 16, 2023Updated 2 years ago
- automated insights for tabular data☆10Feb 10, 2025Updated last year
- Scrape South African news☆13May 22, 2023Updated 3 years ago
- A simple HTTP webserver written in C.☆14Mar 28, 2023Updated 3 years ago
- Keyword extraction using Scake, KeyBERT, Fine-tuning Transformer BERT-like models and ChatGPT.☆12May 22, 2023Updated 3 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆21Aug 12, 2025Updated 11 months ago
- Atviri savivaldybės biudžeto duomenys☆13Apr 7, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 3D Mesh Generation from 2D Images in Python☆13Feb 12, 2024Updated 2 years ago
- ETL of newspaper article keywords using Apache Airflow, Newspaper3k, Quilt T4 and AWS S3☆16Updated this week
- end-to-end information extraction pipeline built by LayoutLMV2, pretrained model from HuggingFace☆11Aug 15, 2023Updated 2 years ago
- ☆10Dec 2, 2025Updated 8 months ago
- A demo and tutorial for Council that implements a financial analyst agent.☆11Jun 21, 2024Updated 2 years ago
- An offline CPU-first low-resource chat application to perform RAG on your corpus of data. Powered by OpenChat and CTranslate2.☆15May 14, 2025Updated last year
- Terraform module which creates Redis ElastiCache resources on AWS.☆12Dec 9, 2022Updated 3 years ago
- Private Wiki plugin for Redmine☆17Aug 14, 2013Updated 12 years ago
- This repo contains the code for the tutorial for using the CrewAI agent framework to generate Sales Reports based on Salesforce data☆13Mar 16, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- repo of files pertaining to realtime, offline translations using whisper realtime and argos translate. This repo is marked Creative Commo…☆19May 20, 2025Updated last year
- DataTalks.Club's Data Engineering Zoomcamp Project☆24Jul 14, 2022Updated 4 years ago
- Ncurses tool to view the internals of a PostgreSQL database☆18Jan 9, 2015Updated 11 years ago
- PrintCSS Examples created over the time. Mostly HTML some Markdown.☆15Apr 15, 2022Updated 4 years ago
- secure your api endpoint by limiting access over period of time.☆10Oct 18, 2019Updated 6 years ago
- JSEngine is a simple wrapper of Javascript engines.☆20Jan 1, 2023Updated 3 years ago
- A simple package of face detection☆14Nov 27, 2020Updated 5 years ago
- The goal of this project is to illustrate Extract Transform Load (ETL) using Python and SQL. ETL is a process commonly done in computing,…☆33Sep 7, 2021Updated 4 years ago
- ☆12Apr 9, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Targeted Aspect-based Sentiment Analysis on SentiHood Dataset (PyTorch)☆11Aug 4, 2020Updated 6 years ago
- Segmenting text blocks and baselines from documents using deep learning techniques☆13Jul 27, 2021Updated 5 years ago
- Highlights the current yank.☆12Jul 13, 2022Updated 4 years ago
- Bagpipes spaCy is a collection of custom spaCy pipeline components designed to enhance text processing capabilities.☆23Aug 15, 2024Updated last year
- A simple hack to extract the Subject-Verb-Object from the phrase structure parse tree generated by stanford parser☆16Nov 8, 2012Updated 13 years ago
- ☆46Jun 10, 2026Updated 2 months ago
- ☆10Feb 3, 2020Updated 6 years ago