basin-etl / basinLinks
Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser
☆35Updated 2 years ago
Alternatives and similar repositories for basin
Users that are interested in basin are comparing it to the libraries listed below
Sorting:
- Beneath is a serverless real-time data platform ⚡️☆84Updated 3 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆100Updated 2 years ago
- Use SQL to build ELT pipelines on a data lakehouse.☆288Updated 3 years ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆96Updated 3 weeks ago
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated 3 weeks ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆76Updated last week
- A visual data pipeline builder with various backends☆103Updated this week
- Demos of Materialize, the operational data warehouse.☆51Updated 7 months ago
- Apache Hive Metastore as a Standalone server in Docker☆80Updated last year
- Data Lineage Tracing Library☆23Updated 3 years ago
- Generate and Visualize Data Lineage from query history☆327Updated 2 years ago
- Easily sync your Postgres database to a Snowflake, ClickHouse, or DuckDB warehouse.☆84Updated 10 months ago
- ☆70Updated 9 months ago
- DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.☆267Updated 6 months ago
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- A JupyterLab extension providing, SQL formatter, auto-completion, syntax highlighting, Spark SQL and Trino☆90Updated this week
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆159Updated 2 years ago
- The metrics layer for your data. Join us at https://metriql.com/slack☆316Updated 2 years ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 4 years ago
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆80Updated 2 weeks ago
- Multiple node presto cluster on docker container☆126Updated 3 years ago
- ODD Specification is a universal open standard for collecting metadata.☆143Updated 11 months ago
- ☆25Updated 4 years ago
- Unity Catalog UI☆43Updated last year
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆167Updated last month
- Sparglim✨ makes PySpark App Configurable and Deploy Spark Connect Server Easier!☆38Updated 2 weeks ago
- Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg☆330Updated 2 years ago
- dbt's adapter for dremio☆48Updated 2 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Updated 4 years ago
- Tool to automate data quality checks on data pipelines☆254Updated 3 years ago