Custom PySpark Connectors
☆106Aug 21, 2026Updated last month
Alternatives and similar repositories for pyspark-data-sources
Users that are interested in pyspark-data-sources are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Feb 22, 2024Updated 2 years ago
- PySpark custom data source for Hugging Face Datasets☆27Updated this week
- An example of SparkConnect extension.☆15Mar 5, 2024Updated 2 years ago
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated 2 years ago
- ☆19Jul 8, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Databricks framework to validate Data Quality of pySpark DataFrames and Tables☆462Updated this week
- End-to-end Azure Databricks Workspace automation with Azure Pipelines☆24Sep 10, 2023Updated 3 years ago
- An example showing how to apply software engineering best practices to Databricks notebooks.☆157Jul 24, 2024Updated 2 years ago
- CLI for querying Databricks SQL☆45Nov 24, 2023Updated 2 years ago
- Databricks SDK for Go☆83Updated this week
- A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT …☆50Dec 7, 2022Updated 3 years ago
- Databricks Implementation of the TPC-DI Specification using Traditional Notebooks and/or Delta Live Tables☆103Updated this week
- Delta Lake helper methods in PySpark☆328Jan 19, 2026Updated 8 months ago
- ☆22Oct 21, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Delta Lake Documentation☆54Jun 19, 2024Updated 2 years ago
- Examples of Prompt Engineering, Zero Shot Learning, Few Shot Learning and Retrieval Augmented Generation (RAG) using Hugging Face, Databr…☆17Sep 21, 2023Updated 3 years ago
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆154Aug 14, 2024Updated 2 years ago
- ☆304Updated this week
- PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it☆82Apr 27, 2025Updated last year
- SQL Queries & Alerts for Databricks System Tables access.audit Logs☆50Jun 29, 2026Updated 2 months ago
- Lightweight SQL execution wrapper only on top of Databricks SDK☆39Aug 3, 2026Updated last month
- ☆106Updated this week
- Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines☆288Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Databricks SDK for Python (Beta)☆570Updated this week
- Security Analysis Tool (SAT) analyzes customer's Databricks account and workspace security configurations and provides recommendations th…☆185Updated this week
- ☆68Jul 15, 2024Updated 2 years ago
- R user guide to Databricks☆69Mar 8, 2024Updated 2 years ago
- ☆26Mar 4, 2024Updated 2 years ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆227Aug 12, 2026Updated last month
- Baseline for Databricks Labs projects written in Python☆71Jul 31, 2026Updated last month
- A multi-modal Python library for benchmarking lakehouse engines and ELT scenarios, supporting both industry-standard and novel benchmarks…☆54Updated this week
- Azure Deployments using Terraform☆30Jan 26, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Ready-to-use code snippets for building interactive Databricks Apps.☆181May 13, 2026Updated 4 months ago
- ☆411Sep 15, 2025Updated last year
- Don't Panic. This guide will help you when it feels like the end of the world.☆32Feb 7, 2026Updated 7 months ago
- Column-wise type annotations for pyspark DataFrames☆109Updated this week
- ☆70Sep 2, 2026Updated 3 weeks ago
- Template repo for kickstarting recipes for classification use case☆27Jun 21, 2023Updated 3 years ago
- Example files used in the DuckDB - Unity Catalog blog☆10Dec 6, 2024Updated last year