A flake8 plugin that detects of usage withColumn in a loop or inside reduce
☆29Jun 20, 2025Updated last year
Alternatives and similar repositories for flake8-pyspark-with-column
Users that are interested in flake8-pyspark-with-column are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PySpark schema generator☆44Feb 23, 2023Updated 3 years ago
- Full-stack OpenTelemetry observability for Apache Spark☆20Oct 12, 2026Updated 3 weeks ago
- ScaleDP is an Open-Source extension of Apache Spark for Document Processing☆19Sep 27, 2026Updated last month
- A web application for creating and managing Databricks cluster policies with an interactive UI, allowing users to configure policy attrib…☆17May 7, 2025Updated last year
- Make-like task executor for Unix OS☆18Jul 28, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆27Mar 25, 2024Updated 2 years ago
- ☆29Jan 18, 2023Updated 3 years ago
- A Rust library for analyzing data lake table health — checking the pulse — across multiple formats (Delta Lake, Apache Iceberg, Apache Hu…☆28Updated this week
- PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it☆83Apr 27, 2025Updated last year
- Delta Lake helper methods in PySpark☆329Jan 19, 2026Updated 9 months ago
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated 2 years ago
- Docker envinroment to stream data from Kafka to Iceberg tables☆30Feb 27, 2024Updated 2 years ago
- Spark library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs☆15Jul 31, 2025Updated last year
- CLI for querying Databricks SQL☆45Oct 30, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆23Oct 28, 2026Updated last week
- Repo that will help you explore how to build a hybrid workflow using Apache Airflow and Amazon ECS Anywhere☆11Jul 12, 2022Updated 4 years ago
- Inline code review annotations for AI-assisted development workflows in Neovim☆12Updated this week
- ☆16Apr 26, 2024Updated 2 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆63Sep 4, 2023Updated 3 years ago
- A fully simulated business demo built on Databricks — streaming data, AI agents, and apps you can deploy, explore, and extend.☆71Sep 29, 2026Updated last month
- Clusterless is a tool for scheduling decentralized, scalable, and secure data pipelines for continuously arriving data, across clouds.☆15Sep 27, 2026Updated last month
- csv and flat-file sniffer built in Rust.☆45Jan 26, 2024Updated 2 years ago
- Performance Hikes for Apache Spark☆31Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The Security Reference Architecture (SRA) with Terraform enables deployment of Databricks workspaces and cloud infrastructure configured …☆223Updated this week
- deck.gl-raster, but without deck.gl☆13Oct 1, 2026Updated last month
- DuckDB extension for reading Raquet format (raster data in Parquet with QUADBIN spatial indexing)☆16Oct 26, 2026Updated last week
- Airflow-pet for DAG quality☆11Nov 22, 2025Updated 11 months ago
- Disaster recovery solution for Amazon Managed Workflows for Apache Airflow (MWAA)☆13Apr 27, 2026Updated 6 months ago
- Python wrapper for lsm1 extension for sqlite4☆15Feb 27, 2025Updated last year
- A collection search-only STAC API for searching collections across multiple STAC APIs☆11Updated this week
- A Norwegian Language Understanding and Generation Evaluation Benchmark☆13Updated this week
- Loading and analyzing GTFS Schedule data with DuckDB☆12Aug 25, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆19Jul 8, 2024Updated 2 years ago
- A write-audit-publish implementation on a data lake without the JVM☆45Aug 12, 2024Updated 2 years ago
- Drop-in replacement for Apache Spark UI☆498Oct 19, 2026Updated 2 weeks ago
- duckdb-etl-framework☆14Dec 20, 2024Updated last year
- In this repository, we show how to get started with data lineage on AWS using OpenLineage. This is an AWS Cloud Development Kit project (…☆13Jul 25, 2024Updated 2 years ago
- SparkConnect Server plugin and protobuf messages for the Amazon Deequ Data Quality Engine.☆26Feb 22, 2025Updated last year
- Repo to hold code Artifacts for WAF☆10Sep 14, 2022Updated 4 years ago