This is a public repository to go over all the LLM-driven data engineering concepts.
☆1,158Oct 26, 2024Updated last year
Alternatives and similar repositories for llm-driven-data-engineering
Users that are interested in llm-driven-data-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository helps teach people how to correctly define and create cumulative tables!☆776Oct 29, 2024Updated last year
- This is a repo with links to everything you'd ever want to learn about data engineering☆44,156Aug 3, 2026Updated last month
- This repo has all the resources you need to become an amazing analytics engineer!☆393Feb 17, 2026Updated 7 months ago
- ☆19Jul 31, 2024Updated 2 years ago
- A curated list of Large Language Model resources, covering model training, serving, fine-tuning, and building LLM applications.☆5,038Aug 18, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository goes over how to handle massive variety in data engineering☆331Jan 16, 2023Updated 3 years ago
- ☆1,081Dec 31, 2025Updated 8 months ago
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼☆45,643Updated this week
- AdalFlow: The library to build & auto-optimize LLM applications.☆4,213May 29, 2026Updated 3 months ago
- ☆128Jul 24, 2025Updated last year
- A guide for technical professionals looking to start consulting☆1,560Jan 3, 2025Updated last year
- This repo is meant to make it really easy to analyze the interplays between health and social media use.☆48Jul 10, 2022Updated 4 years ago
- Hey this is the repo that has all the queries and data for my video game training series!☆162Jun 5, 2022Updated 4 years ago
- All the links, books, and creators you need to follow to stay up to date with AI!☆1,229Mar 23, 2026Updated 5 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices☆5,340Apr 22, 2026Updated 4 months ago
- A comprehensive Python package template to kickstart and standardize your MLOps initiatives and data pipelines.☆1,416Updated this week
- 🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial …☆3,425Dec 9, 2024Updated last year
- LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answe…☆7,312Updated this week
- Open Data Stack Platform: a collection of projects and pipelines built with open data stack tools for scalable, observable data platform…☆23Sep 6, 2026Updated 2 weeks ago
- Data Engineering Project with Hadoop HDFS and Kafka☆127Nov 4, 2023Updated 2 years ago
- The best place to learn data engineering. Built and maintained by the data engineering community.☆2,029Updated this week
- Engineering Management Leadership handbook☆35Feb 14, 2024Updated 2 years ago
- Sample project to demonstrate data engineering best practices☆226Feb 24, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more☆443Nov 28, 2023Updated 2 years ago
- ☆161Feb 25, 2026Updated 6 months ago
- The Data Engineering Cookbook☆15,423Jul 23, 2026Updated last month
- ☆12Jul 8, 2024Updated 2 years ago
- 🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽�…☆4,390Apr 20, 2026Updated 5 months ago
- Free MLOps course from DataTalks.Club. Register here 👇🏼 to get notified about the next cohort☆15,307Updated this week
- ☆21Apr 2, 2025Updated last year
- [WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)☆17,486Jul 3, 2026Updated 2 months ago
- A one stop repository for generative AI research updates, interview resources, notebooks and much more!☆29,470Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A system for agentic LLM-powered data processing and ETL☆4,100Sep 5, 2026Updated 2 weeks ago
- An Awesome List of Open-Source Data Engineering Projects☆3,294Oct 4, 2024Updated last year
- ☆116Jan 23, 2025Updated last year
- A curated list of data engineering tools for software developers☆9,071Sep 7, 2026Updated last week
- Data Engineering Practice Problems☆2,885Jan 8, 2025Updated last year
- A course on aligning smol models.☆6,751Updated this week
- Practical Data Engineering: A Hands-On Real-Estate Project Guide☆825Jun 25, 2026Updated 2 months ago