This is a public repository to go over all the LLM-driven data engineering concepts.
☆1,155Oct 26, 2024Updated last year
Alternatives and similar repositories for llm-driven-data-engineering
Users that are interested in llm-driven-data-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository helps teach people how to correctly define and create cumulative tables!☆767Oct 29, 2024Updated last year
- ☆32Jun 21, 2024Updated 2 years ago
- This repo has all the resources you need to become an amazing analytics engineer!☆354Feb 17, 2026Updated 4 months ago
- This is a repo with links to everything you'd ever want to learn about data engineering☆42,002Apr 2, 2026Updated 2 months ago
- A curated list of Large Language Model resources, covering model training, serving, fine-tuning, and building LLM applications.☆4,973Aug 18, 2025Updated 10 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This repository goes over how to handle massive variety in data engineering☆324Jan 16, 2023Updated 3 years ago
- ☆1,077Dec 31, 2025Updated 6 months ago
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Jo…☆42,757Jun 10, 2026Updated 3 weeks ago
- AdalFlow: The library to build & auto-optimize LLM applications.☆4,171May 29, 2026Updated last month
- ☆124Jul 24, 2025Updated 11 months ago
- A guide for technical professionals looking to start consulting☆1,542Jan 3, 2025Updated last year
- The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices☆5,137Apr 22, 2026Updated 2 months ago
- This repo is meant to make it really easy to analyze the interplays between health and social media use.☆47Jul 10, 2022Updated 3 years ago
- ☆160Feb 25, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Hey this is the repo that has all the queries and data for my video game training series!☆159Jun 5, 2022Updated 4 years ago
- A comprehensive Python package template to kickstart and standardize your MLOps initiatives and data pipelines.☆1,414Jan 25, 2026Updated 5 months ago
- 🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial …☆3,419Dec 9, 2024Updated last year
- Code for "Efficient Data Processing in Spark" Course☆385Jun 22, 2026Updated last week
- ☆12Jul 8, 2024Updated last year
- [WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)☆16,228Jun 9, 2026Updated 3 weeks ago
- Open Data Stack Platform: a collection of projects and pipelines built with open data stack tools for scalable, observable data platform…☆22May 11, 2026Updated last month
- The best place to learn data engineering. Built and maintained by the data engineering community.☆1,995May 28, 2026Updated last month
- Sample project to demonstrate data engineering best practices☆220Feb 24, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answe…☆6,643Updated this week
- Data Engineering Project with Hadoop HDFS and Kafka☆124Nov 4, 2023Updated 2 years ago
- Engineering Management Leadership handbook☆35Feb 14, 2024Updated 2 years ago
- Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more☆436Nov 28, 2023Updated 2 years ago
- The Data Engineering Cookbook☆15,162Jun 12, 2026Updated 2 weeks ago
- 🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽�…☆4,358Apr 20, 2026Updated 2 months ago
- Free MLOps course from DataTalks.Club☆14,853Jun 10, 2026Updated 3 weeks ago
- A one stop repository for generative AI research updates, interview resources, notebooks and much more!☆28,044Jun 24, 2026Updated last week
- A system for agentic LLM-powered data processing and ETL☆3,847Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.☆22,900Jun 17, 2026Updated last week
- An Awesome List of Open-Source Data Engineering Projects☆3,224Oct 4, 2024Updated last year
- ☆21Apr 2, 2025Updated last year
- Official code repo for the O'Reilly Book - "Hands-On Large Language Models"☆27,269Apr 24, 2026Updated 2 months ago
- A curated list of data engineering tools for software developers☆8,797Jun 22, 2026Updated last week
- Data Engineering Practice Problems☆2,755Jan 8, 2025Updated last year
- Practical Data Engineering: A Hands-On Real-Estate Project Guide☆806Updated this week