pytest plugin to run the tests with support of pyspark
☆87May 21, 2025Updated last year
Alternatives and similar repositories for pytest-spark
Users that are interested in pytest-spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆64Sep 30, 2026Updated last month
- Playing with different packages of the Apache Spark☆29Feb 8, 2026Updated 9 months ago
- Example unit tests for Apache Spark Python scripts using the py.test framework☆84Mar 22, 2016Updated 10 years ago
- Geohex v3.2 python implementation.☆16Apr 29, 2021Updated 5 years ago
- PySpark test helper methods with beautiful error messages☆778Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Demonstration of using Files in Repos with Databricks Delta Live Tables☆36Jul 9, 2024Updated 2 years ago
- Apache (Py)Spark type annotations (stub files).☆118Aug 17, 2022Updated 4 years ago
- ☆21Aug 26, 2025Updated last year
- DBAPI and SQLAlchemy dialect for Databricks Workspace and SQL Analytics clusters☆22Jan 6, 2022Updated 4 years ago
- pyspark methods to enhance developer productivity 📣 👯 🎉☆691Oct 25, 2026Updated 3 weeks ago
- Helpers & syntactic sugar for PySpark.☆61Sep 11, 2026Updated 2 months ago
- Udacity Data Pipeline Exercises☆15Jun 6, 2020Updated 6 years ago
- A solution accelerator for multimodal document parsing and search on Databricks☆10Feb 12, 2026Updated 9 months ago
- Base classes to use when writing tests with Spark☆1,555Oct 31, 2026Updated 2 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A collection of “cookbook-style” scripts for simplifying data engineering and machine learning in Apache Spark.☆13Oct 27, 2021Updated 5 years ago
- Unit and integration testing with PySpark can be tough to figure out, let's make that easier.☆23Nov 3, 2015Updated 11 years ago
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆456Apr 2, 2026Updated 7 months ago
- Point Cloud Registration from Multiple Intel Realsense Frames☆13Dec 19, 2019Updated 6 years ago
- A pyspark lib to validate data quality☆19Nov 11, 2022Updated 4 years ago
- PySpark testing example project☆13May 28, 2024Updated 2 years ago
- ☆13Nov 3, 2021Updated 5 years ago
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Jun 12, 2024Updated 2 years ago
- An Python object protocol for projects to interchange data frame-like data without forcing pandas.DataFrame as the intermediary☆15Apr 9, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A simple introduction to using spark ml pipelines☆25Apr 5, 2018Updated 8 years ago
- 🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.☆467Mar 27, 2026Updated 7 months ago
- Tracing security events in container with BPF☆15Dec 15, 2023Updated 2 years ago
- Example of how to import python native modules into a Databricks Notebook☆15Jul 18, 2019Updated 7 years ago
- on-chain LLMs for the Internet Computer☆17Oct 30, 2026Updated 2 weeks ago
- Basic machine learning algorithm implementation☆18Mar 7, 2024Updated 2 years ago
- ☆13Jul 16, 2026Updated 4 months ago
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆155Aug 14, 2024Updated 2 years ago
- MCP for AWS Cost Explorer and CloudWatch logs☆14May 28, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python package for using bokeh in Apache Zeppelin Notebook☆10Jul 31, 2019Updated 7 years ago
- Usage examples for byte-genie API☆12Apr 27, 2024Updated 2 years ago
- Building a Q&A app (powered by a LLM model) using AWS Bedrock, AWS Kendra, AWS S3 and Streamlit in just a couple of hours☆17Dec 7, 2023Updated 2 years ago
- ☆13Jul 23, 2025Updated last year
- rb_status_plugin : Data confidence tool for Airflow☆12Jan 7, 2023Updated 3 years ago
- auto set cookie domain like google analytics☆11Sep 9, 2023Updated 3 years ago
- A dbt adapter for Databricks.☆391Updated this week
Are these results useful?