apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
☆39,979Updated this week
Alternatives and similar repositories for airflow:
Users that are interested in airflow are comparing it to the libraries listed below
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,259Updated 2 weeks ago
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆19,230Updated this week
- ClickHouse® is a real-time analytics database management system☆40,523Updated this week
- The official home of the Presto distributed SQL query engine for big data☆16,325Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆15,385Updated this week
- Apache Druid: a high performance real-time analytics database.☆13,698Updated this week
- Apache Superset is a Data Visualization and Data Exploration Platform☆66,094Updated this week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,091Updated this week
- Parallel computing with task scheduling☆13,177Updated this week
- The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lak…☆18,048Updated this week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆11,257Updated this week
- An orchestration platform for the development, production, and observation of data assets.☆13,089Updated this week
- Workflow Engine for Kubernetes☆15,615Updated this week
- The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data☆41,863Updated this week
- Docker Apache Airflow☆3,803Updated 2 years ago
- Distributed Task Queue (development branch)☆26,283Updated this week
- 💫 Industrial-strength Natural Language Processing (NLP) in Python☆31,526Updated 3 weeks ago
- Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.☆27,292Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,480Updated last week
- Apache Spark - A unified analytics engine for large-scale data processing☆41,075Updated this week
- Apache Pinot - A realtime distributed OLAP datastore☆5,764Updated this week
- Data Apps & Dashboards for Python. No JavaScript Required.☆22,418Updated this week
- Curated list of resources about Apache Airflow☆3,778Updated 8 months ago
- Scalable datastore for metrics, events, and real-time analytics☆29,983Updated this week
- TiDB - the open-source, cloud-native, distributed SQL database designed for modern applications.☆38,379Updated this week
- The Prometheus monitoring system and time series database.☆58,436Updated this week
- CNCF Jaeger, a Distributed Tracing Platform☆21,291Updated this week
- Streamlit — A faster way to build and share data apps.☆39,245Updated this week
- Python Stream Processing☆6,788Updated 9 months ago
- Alluxio, data orchestration for analytics and machine learning in the cloud☆6,982Updated last week