kaaveland / pyarrowfs-adlgen2Links
Use pyarrow with Azure Data Lake gen2
☆26Updated last year
Alternatives and similar repositories for pyarrowfs-adlgen2
Users that are interested in pyarrowfs-adlgen2 are comparing it to the libraries listed below
Sorting:
- Write your dbt models using Ibis☆67Updated 3 months ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆25Updated last year
- ☆26Updated last year
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated 2 years ago
- Utility functions for dbt projects running on Spark☆34Updated 4 months ago
- Parse dbt artifacts and search dbt models with Algolia☆52Updated 4 years ago
- Pandas helper functions☆31Updated 2 years ago
- PySpark schema generator☆43Updated 2 years ago
- Dask integration for Snowflake☆30Updated 7 months ago
- A DataOps framework for building a lakehouse.☆50Updated this week
- ☆49Updated 11 months ago
- The DAMN (Data Assets Metric Navigation) tool extracts and reports metrics about your data assets☆11Updated 6 months ago
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆43Updated this week
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 3 years ago
- Read Delta tables without any Spark☆47Updated last year
- Delta Lake helper methods. No Spark dependency.☆23Updated 9 months ago
- Library to convert DBT manifest metadata to Airflow tasks☆48Updated last year
- Pytest plugin for dbt core☆60Updated 5 months ago
- High-level wrapper around BCP for high performance data transfers between pandas and SQL Server. No knowledge of BCP required!!☆132Updated this week
- A Singer.io target for DuckDB☆17Updated 4 months ago
- 🏁 A sweet and speedy code generator for dbt 🏎️✨☆27Updated last year
- Dagster SQLMesh Adapter☆59Updated 2 weeks ago
- ☆74Updated 4 months ago
- This library can convert a pydantic class to a avro schema or generate python code from a avro schema.☆76Updated last month
- pytest plugin to run the tests with support of pyspark☆86Updated last month
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated last year
- Black for Databricks notebooks☆45Updated 2 weeks ago
- dbt-utils for the dbt-msft family of packages☆28Updated 9 months ago
- a pytest plugin for dbt adapter test suites☆19Updated last year
- Run, mock and test fake Snowflake databases locally.☆143Updated this week