A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
☆49Jun 7, 2026Updated 3 months ago
Alternatives and similar repositories for spark-flight-connector
Users that are interested in spark-flight-connector are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆109Jul 5, 2023Updated 3 years ago
- Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).☆19Feb 10, 2025Updated last year
- A leightweight UI for Lakekeeper☆20Updated this week
- ☆17Nov 27, 2025Updated 9 months ago
- ☆14Dec 8, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Helm chart for Lakekeeper - a Rust Native Iceberg REST Catalog☆25Updated this week
- ☆31Mar 14, 2022Updated 4 years ago
- DuckLake took Flight. Welcome to SwanLake.☆156Aug 30, 2026Updated last week
- A generic ETL framework with Spark_SQL for transforming data by constructing pipelines with Yaml/Json/Xml☆22Aug 15, 2026Updated 3 weeks ago
- SQLAlchemy for Dremio via the ODBC and Flight interface.☆30Mar 12, 2026Updated 5 months ago
- dbt's adapter for dremio☆48Oct 15, 2022Updated 3 years ago
- DB API 2 interface for Flight SQL with SQLAlchemy extras.☆44Sep 30, 2025Updated 11 months ago
- ☆22Jun 6, 2022Updated 4 years ago
- A Table format agnostic data sharing framework☆42Feb 4, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This repo demonstrates an Apache Arrow Flight server implementation in Kubernetes.☆12Oct 25, 2024Updated last year
- ☆102Updated this week
- DuckDB API Server with Arrow Flight SQL Airport support and concurrent writes/reads (quackpipe)☆124Mar 5, 2025Updated last year
- ☆15Jun 1, 2026Updated 3 months ago
- Ibis Basics: An Introduction to the Portable Python Dataframe Library.☆10Jun 6, 2024Updated 2 years ago
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆247Updated this week
- Jobcenter, a client-server application and framework for job management and distributed job execution☆11Aug 19, 2019Updated 7 years ago
- Apache DataFusion Comet Spark Accelerator☆1,267Updated this week
- Glue JupyterLab Extension☆20Aug 3, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Kubernetes Operator for Lakekeeper (WIP)☆17Apr 30, 2026Updated 4 months ago
- Better, container friendly big-data images for Docker☆38Nov 12, 2016Updated 9 years ago
- Spark-Radiant is Apache Spark Performance and Cost Optimizer☆25Dec 31, 2024Updated last year
- This is a demo project to compare two web scrapping frameworks, Playwright and Selenium and using the new Pipelining tool Dagster☆15Sep 9, 2021Updated 4 years ago
- ☆12Mar 14, 2024Updated 2 years ago
- JDBC driver for DuckDB's Quack remote protocol (quack:// URI scheme). Lets any JVM tool query a remote DuckDB server over HTTP.☆19Jul 29, 2026Updated last month
- Set of extensions for kafka connect hdfs☆11May 12, 2021Updated 5 years ago
- Simple and convenient API for File System access☆22Aug 21, 2026Updated 2 weeks ago
- Powerful data exploration UI through SQL☆17Sep 27, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Visualize column-level data lineage in Spark SQL☆92May 13, 2022Updated 4 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆32Updated this week
- A DuckDB ADBC Scanner Extension - adds support for using ADBC drivers with DuckDB as a client.☆19Updated this week
- ☆20Updated this week
- Arrow Flight SQL Server for DuckDB☆150Updated this week
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Nov 29, 2016Updated 9 years ago
- Temporal Rust SDK worker example☆18Apr 8, 2025Updated last year