kawadia / pyspark.testView external linksLinks
Example unit tests for Apache Spark Python scripts using the py.test framework
☆84Mar 22, 2016Updated 9 years ago
Alternatives and similar repositories for pyspark.test
Users that are interested in pyspark.test are comparing it to the libraries listed below
Sorting:
- Unit and integration testing with PySpark can be tough to figure out, let's make that easier.☆23Nov 3, 2015Updated 10 years ago
- pytest plugin to run the tests with support of pyspark☆88May 21, 2025Updated 8 months ago
- Speech to text using ZeroMQ☆12Dec 26, 2022Updated 3 years ago
- Spark-cloud is a set of scripts for starting spark clusters on ec2☆12Dec 21, 2015Updated 10 years ago
- Reinforcement Learning Algorithms☆14May 28, 2018Updated 7 years ago
- A pytest powered framework for multi-host integration and system testing☆16Jun 15, 2018Updated 7 years ago
- Python implementation of Joel Greenblatt's 'magic formula' for the ASX.☆13Jul 25, 2016Updated 9 years ago
- Materials For System Development with Python☆13Aug 10, 2018Updated 7 years ago
- ner using crf++☆10Mar 24, 2015Updated 10 years ago
- pytest plugin for visual regression testing https://pytest-needle.readthedocs.io☆17Dec 2, 2024Updated last year
- Deployment tool for Amazon ECS☆19Nov 24, 2025Updated 2 months ago
- py.test plugin that activates the fault handler module during testing☆26Jul 11, 2020Updated 5 years ago
- Single-click deployment, serverless data pipeline that moves Google Analytics raw data to S3 and ETL's it into BigQuery schema☆21Jun 2, 2021Updated 4 years ago
- Vagrant for Docker swarm mode introduced from 1.12☆21Jul 31, 2016Updated 9 years ago
- Terraform code to create a Kafka message queue in AWS.☆18Jan 17, 2019Updated 7 years ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Feb 13, 2020Updated 6 years ago
- A toolset to streamline running spark python on EMR☆20Nov 16, 2016Updated 9 years ago
- UW Software Engineering for Data Science Website☆22Jan 15, 2026Updated 3 weeks ago
- CLI for Amazon Athena, powered by JRuby☆24Oct 8, 2018Updated 7 years ago
- A Personalized 'Shop-by-Style' Experience via PyTorch on Amazon SageMaker and Amazon Neptune☆24May 7, 2021Updated 4 years ago
- A boilerplate for writing PySpark Jobs☆395Jan 21, 2024Updated 2 years ago
- Marshmallow Schema generator for Pandas DataFrames☆24Aug 11, 2020Updated 5 years ago
- ☆12Sep 25, 2019Updated 6 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Oct 18, 2023Updated 2 years ago
- An example pipeline that runs Python tests inside a Docker container using uv for dependency management.☆33Nov 13, 2025Updated 3 months ago
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆696Jan 13, 2026Updated last month
- ☆525Jan 1, 2026Updated last month
- Simple example on how to use AWS Step Functions, to integrate multiple AWS Lambda functions.☆35Oct 18, 2018Updated 7 years ago
- Sample code for the AWS Big Data Blog Post Building a scalable streaming data processor with Amazon Kinesis Data Streams on AWS Fargate☆39Nov 17, 2025Updated 2 months ago
- Python SDK for vishwa.ai☆21Jan 29, 2024Updated 2 years ago
- Using Word2Vec on lists and sets☆34Jun 2, 2025Updated 8 months ago
- Quick start reference deployment of an Amazon Aurora DB Cluster with AWS recommended best practices for security and high availability us…☆89Aug 2, 2022Updated 3 years ago
- An MCP server that provides AI assistants with screenshot capabilities — both web page capture via Puppeteer and cross-platform system sc…☆15Feb 7, 2026Updated last week
- A simple elasticsearch frontend for serving astrophysical simulation catalog data☆10Aug 29, 2025Updated 5 months ago
- A lightweight repository for exploring and experimenting with AI agents☆14Jul 22, 2025Updated 6 months ago
- Python framework for generating streams of labeled data.☆15Oct 20, 2025Updated 3 months ago
- fastapi template for oauth, db, prisma orm support☆10Apr 20, 2024Updated last year
- This repository is the project page for "Point Anywhere: Directed Object Estimation from Omnidirectional Images", including source code …☆12Aug 25, 2023Updated 2 years ago
- A Beginner's Guide to Machine Learning with Scikit-Learn☆31Feb 15, 2014Updated 11 years ago