basin-etl / basin
Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser
☆35Updated last year
Related projects ⓘ
Alternatives and complementary repositories for basin
- Beneath is a serverless real-time data platform ⚡️☆83Updated 2 years ago
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 3 years ago
- Plugin for Apache Airflow to execute serverless tasks using Lithops☆10Updated last year
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆92Updated 3 weeks ago
- Demos of Materialize, the operational data warehouse.☆50Updated 2 months ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆122Updated 3 years ago
- Ibis analytics, with Ibis (and more!)☆19Updated last month
- ☆24Updated 3 years ago
- Apache Hive Metastore as a Standalone server in Docker☆67Updated 3 months ago
- dbt's adapter for dremio☆48Updated 2 years ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆72Updated this week
- ☆22Updated 2 years ago
- Delta reader for the Ray open-source toolkit for building ML applications☆43Updated 9 months ago
- Data Lineage Tracing Library☆22Updated 2 years ago
- Wrangler Transform: A DMD system for transforming Big Data☆89Updated this week
- ☆30Updated 3 years ago
- Airbyte connectors (sources & destinations) + Airbyte CDK for JavaScript/TypeScript☆109Updated this week
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Updated 3 years ago
- Open-source metadata collector based on ODD Specification☆42Updated last year
- Minimal example to run Trino, Minio, and Hive standalone metastore on docker☆47Updated 2 years ago
- ThirdEye is an integrated tool for realtime monitoring of time series and interactive root-cause analysis. It enables anyone inside an or…☆92Updated 2 years ago
- A JupyterLab extension providing, SQL formatter, auto-completion, syntax highlighting, Spark SQL and Trino☆85Updated this week
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆158Updated last year
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- GraphQL service for arrow tables and parquet data sets.☆86Updated this week
- DuckDB for streaming data☆70Updated 7 months ago
- dbt (data build tool) adapter for the Dremio☆44Updated this week
- A Delta Lake reader for Dask☆47Updated last month
- Unity Catalog UI☆39Updated 2 months ago