This is a public repository to go over all the LLM-driven data engineering concepts.
☆1,149Oct 26, 2024Updated last year
Alternatives and similar repositories for llm-driven-data-engineering
Users that are interested in llm-driven-data-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository helps teach people how to correctly define and create cumulative tables!☆765Oct 29, 2024Updated last year
- This repo has all the resources you need to become an amazing analytics engineer!☆358Feb 17, 2026Updated 5 months ago
- This is a repo with links to everything you'd ever want to learn about data engineering☆42,313Apr 2, 2026Updated 3 months ago
- ☆16Jul 31, 2024Updated last year
- A curated list of Large Language Model resources, covering model training, serving, fine-tuning, and building LLM applications.☆4,983Aug 18, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This repository goes over how to handle massive variety in data engineering☆325Jan 16, 2023Updated 3 years ago
- ☆1,077Dec 31, 2025Updated 6 months ago
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Jo…☆43,843Jun 10, 2026Updated last month
- AdalFlow: The library to build & auto-optimize LLM applications.☆4,185May 29, 2026Updated last month
- ☆125Jul 24, 2025Updated 11 months ago
- A guide for technical professionals looking to start consulting☆1,542Jan 3, 2025Updated last year
- This repo is meant to make it really easy to analyze the interplays between health and social media use.☆47Jul 10, 2022Updated 4 years ago
- The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices☆5,236Apr 22, 2026Updated 2 months ago
- Hey this is the repo that has all the queries and data for my video game training series!☆158Jun 5, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- All the links, books, and creators you need to follow to stay up to date with AI!☆1,168Mar 23, 2026Updated 3 months ago
- A comprehensive Python package template to kickstart and standardize your MLOps initiatives and data pipelines.☆1,418Updated this week
- Code for "Efficient Data Processing in Spark" Course☆390Jun 29, 2026Updated 3 weeks ago
- 🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial …☆3,420Dec 9, 2024Updated last year
- LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answe…☆6,854Updated this week
- Open Data Stack Platform: a collection of projects and pipelines built with open data stack tools for scalable, observable data platform…☆22Jun 29, 2026Updated 3 weeks ago
- Data Engineering Project with Hadoop HDFS and Kafka☆125Nov 4, 2023Updated 2 years ago
- The best place to learn data engineering. Built and maintained by the data engineering community.☆2,004May 28, 2026Updated last month
- Engineering Management Leadership handbook☆35Feb 14, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Sample project to demonstrate data engineering best practices☆221Feb 24, 2024Updated 2 years ago
- Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more☆438Nov 28, 2023Updated 2 years ago
- ☆160Feb 25, 2026Updated 4 months ago
- The Data Engineering Cookbook☆15,181Jun 12, 2026Updated last month
- ☆12Jul 8, 2024Updated 2 years ago
- 🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽�…☆4,374Apr 20, 2026Updated 3 months ago
- Free MLOps course from DataTalks.Club☆14,984Jun 10, 2026Updated last month
- ☆21Apr 2, 2025Updated last year
- [WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)☆16,571Jul 3, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A one stop repository for generative AI research updates, interview resources, notebooks and much more!☆28,342Updated this week
- A system for agentic LLM-powered data processing and ETL☆3,895Jun 26, 2026Updated 3 weeks ago
- An Awesome List of Open-Source Data Engineering Projects☆3,247Oct 4, 2024Updated last year
- A curated list of data engineering tools for software developers☆8,876Updated this week
- Data Engineering Practice Problems☆2,791Jan 8, 2025Updated last year
- A course on aligning smol models.☆6,688May 26, 2026Updated last month
- Practical Data Engineering: A Hands-On Real-Estate Project Guide☆815Jun 25, 2026Updated 3 weeks ago