apache / airflowLinks
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
☆42,942Updated last week
Alternatives and similar repositories for airflow
Users that are interested in airflow are comparing it to the libraries listed below
Sorting:
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,546Updated 5 months ago
 - Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆20,668Updated this week
 - The official home of the Presto distributed SQL query engine for big data☆16,552Updated this week
 - Apache Superset is a Data Visualization and Data Exploration Platform☆68,712Updated this week
 - Apache Spark - A unified analytics engine for large-scale data processing☆42,171Updated last week
 - Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,345Updated this week
 - Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,095Updated this week
 - An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,363Updated this week
 - Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.☆27,917Updated 2 weeks ago
 - An orchestration platform for the development, production, and observation of data assets.☆14,306Updated this week
 - The open source developer platform to build AI/LLM applications and models with confidence. Enhance your AI applications with end-to-end …☆22,703Updated this week
 - Apache Iceberg☆8,121Updated last week
 - Apache Druid: a high performance real-time analytics database.☆13,855Updated this week
 - Build, Manage and Deploy AI/ML Systems☆9,583Updated last week
 - The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆19,901Updated this week
 - Always know what to expect from your data.☆10,884Updated this week
 - The Metadata Platform for your Data and AI Stack☆11,162Updated last week
 - The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Pro…☆70,627Updated this week
 - Python client for Apache Kafka☆5,843Updated 3 weeks ago
 - DuckDB is an analytical in-process SQL database management system☆33,726Updated last week
 - Apache Pinot - A realtime distributed OLAP datastore☆5,937Updated this week
 - Open source SQL Query Assistant service for Databases/Warehouses☆1,356Updated this week
 - Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,574Updated this week
 - CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placemen…☆31,439Updated this week
 - NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB☆15,014Updated this week
 - Developer-first error tracking and performance monitoring☆42,325Updated this week
 - Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆12,103Updated this week
 - Parallel computing with task scheduling☆13,560Updated this week
 - Azkaban workflow manager.☆4,516Updated last year
 - ClickHouse® is a real-time analytics database management system☆43,694Updated this week