qwshen / spark-flight-connectorView external linksLinks
A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
☆46Dec 14, 2025Updated 2 months ago
Alternatives and similar repositories for spark-flight-connector
Users that are interested in spark-flight-connector are comparing it to the libraries listed below
Sorting:
- ☆108Jul 5, 2023Updated 2 years ago
- A leightweight UI for Lakekeeper☆16Updated this week
- ☆14Dec 8, 2022Updated 3 years ago
- Fybrik platform - Arrow/Flight module☆15Aug 10, 2024Updated last year
- Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).☆20Feb 10, 2025Updated last year
- DB API 2 interface for Flight SQL with SQLAlchemy extras.☆43Sep 30, 2025Updated 4 months ago
- A Table format agnostic data sharing framework☆42Feb 4, 2024Updated 2 years ago
- My custom Python project scaffolding repository.☆12Aug 5, 2025Updated 6 months ago
- SQLAlchemy for Dremio via the ODBC and Flight interface.☆30Jan 8, 2026Updated last month
- Spark-Radiant is Apache Spark Performance and Cost Optimizer☆25Dec 31, 2024Updated last year
- ☆31Mar 14, 2022Updated 3 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆30Feb 1, 2026Updated 2 weeks ago
- ☆16Nov 27, 2025Updated 2 months ago
- ☆14Feb 6, 2026Updated last week
- A generic ETL framework with Spark_SQL for transforming data by constructing pipelines with Yaml/Json/Xml☆18Feb 3, 2026Updated last week
- ☆17Updated this week
- ☆21Aug 26, 2025Updated 5 months ago
- ETL processing toolset with SQL-like language and GIS capabilities, built on core Spark. Extensible and modular. REPL included☆16Jan 26, 2026Updated 3 weeks ago
- dbt's adapter for dremio☆48Oct 15, 2022Updated 3 years ago
- ☆22Jun 6, 2022Updated 3 years ago
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Jun 12, 2024Updated last year
- Open, Multi-modal Catalog for Data & AI, written in Rust☆86Sep 30, 2024Updated last year
- ☆96Feb 3, 2026Updated 2 weeks ago
- ☆56Updated this week
- Visualize column-level data lineage in Spark SQL☆92May 13, 2022Updated 3 years ago
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆233Feb 10, 2026Updated last week
- FederatedCatalog☆11Updated this week
- TSG Client is a Python library for interacting with the TNO Security Gateway (TSG) Core Container☆18Mar 28, 2025Updated 10 months ago
- spark-sight: Spark performance at a glance☆10Apr 6, 2023Updated 2 years ago
- Query and transform data with PRQL☆137Sep 23, 2023Updated 2 years ago
- This is an attempt to start documenting the rust sdk for temporal and how to use it following some of the examples in typescript.☆39Jun 16, 2023Updated 2 years ago
- ☆36Aug 13, 2024Updated last year
- Better, container friendly big-data images for Docker☆39Nov 12, 2016Updated 9 years ago
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆136Oct 25, 2023Updated 2 years ago
- DataFusion TableProviders for reading data from other systems☆168Updated this week
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆84Feb 8, 2026Updated last week
- Apache DataFusion Comet Spark Accelerator☆1,134Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,413Feb 10, 2026Updated last week
- a curated list of awesome lakehouse frameworks, applications, etc☆40Feb 9, 2026Updated last week