This is a public repository to go over all the LLM-driven data engineering concepts.
☆1,159Oct 26, 2024Updated last year
Alternatives and similar repositories for llm-driven-data-engineering
Users that are interested in llm-driven-data-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository helps teach people how to correctly define and create cumulative tables!☆776Oct 29, 2024Updated last year
- This is a repo with links to everything you'd ever want to learn about data engineering☆44,407Aug 3, 2026Updated 2 months ago
- This repo has all the resources you need to become an amazing analytics engineer!☆394Feb 17, 2026Updated 7 months ago
- ☆19Jul 31, 2024Updated 2 years ago
- A curated list of Large Language Model resources, covering model training, serving, fine-tuning, and building LLM applications.☆5,041Aug 18, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This repository goes over how to handle massive variety in data engineering☆332Jan 16, 2023Updated 3 years ago
- ☆1,082Dec 31, 2025Updated 9 months ago
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼☆46,089Sep 15, 2026Updated 3 weeks ago
- AdalFlow: The library to build & auto-optimize LLM applications.☆4,223May 29, 2026Updated 4 months ago
- ☆129Jul 24, 2025Updated last year
- A guide for technical professionals looking to start consulting☆1,562Jan 3, 2025Updated last year
- This repo is meant to make it really easy to analyze the interplays between health and social media use.☆48Jul 10, 2022Updated 4 years ago
- Hey this is the repo that has all the queries and data for my video game training series!☆162Jun 5, 2022Updated 4 years ago
- All the links, books, and creators you need to follow to stay up to date with AI!☆1,242Mar 23, 2026Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices☆5,367Apr 22, 2026Updated 5 months ago
- Production-shaped MLOps Python package and reference implementation of the MLOps Coding Course: MLflow, scikit-learn, Pydantic, Pandera, …☆1,419Updated this week
- Code for "Efficient Data Processing in Spark" Course☆396Jun 29, 2026Updated 3 months ago
- 🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial …☆3,424Dec 9, 2024Updated last year
- LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answe…☆7,438Sep 15, 2026Updated 3 weeks ago
- Open Data Stack Platform: a collection of projects and pipelines built with open data stack tools for scalable, observable data platform…☆23Sep 19, 2026Updated 3 weeks ago
- Data Engineering Project with Hadoop HDFS and Kafka☆131Nov 4, 2023Updated 2 years ago
- The best place to learn data engineering. Built and maintained by the data engineering community.☆2,034Sep 15, 2026Updated 3 weeks ago
- Engineering Management Leadership handbook☆35Feb 14, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Sample project to demonstrate data engineering best practices☆227Feb 24, 2024Updated 2 years ago
- Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more☆445Nov 28, 2023Updated 2 years ago
- ☆161Feb 25, 2026Updated 7 months ago
- The Data Engineering Cookbook☆15,469Jul 23, 2026Updated 2 months ago
- ☆12Jul 8, 2024Updated 2 years ago
- 🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽�…☆4,390Apr 20, 2026Updated 5 months ago
- Free MLOps course from DataTalks.Club. Register here 👇🏼 to get notified about the next cohort☆15,392Sep 15, 2026Updated 3 weeks ago
- ☆21Apr 2, 2025Updated last year
- [WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)☆17,760Jul 3, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A one stop repository for generative AI research updates, interview resources, notebooks and much more!☆29,753Updated this week
- A system for agentic LLM-powered data processing and ETL☆4,124Sep 5, 2026Updated last month
- An Awesome List of Open-Source Data Engineering Projects☆3,300Oct 4, 2024Updated 2 years ago
- ☆116Jan 23, 2025Updated last year
- A curated list of data engineering tools for software developers☆9,157Sep 7, 2026Updated last month
- Data Engineering Practice Problems☆2,908Jan 8, 2025Updated last year
- A course on aligning smol models.☆6,768Updated this week