Joblib Apache Spark Backend
☆249Mar 24, 2026Updated 4 months ago
Alternatives and similar repositories for joblib-spark
Users that are interested in joblib-spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Spark implementation of computing Shapley Values using monte-carlo approximation☆80Mar 20, 2023Updated 3 years ago
- Koalas: pandas API on Apache Spark☆3,372Mar 20, 2024Updated 2 years ago
- Distributed scikit-learn meta-estimators in PySpark☆288Apr 26, 2025Updated last year
- (Deprecated) Scikit-learn integration package for Apache Spark☆1,071Dec 3, 2019Updated 6 years ago
- Toolkit for Apache Spark ML for Feature clean-up, feature Importance calculation suite, Information Gain selection, Distributed SMOTE, Mo…☆191Jun 1, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PyTorch Flexible Hash Embeddings☆29Feb 4, 2020Updated 6 years ago
- pyspark methods to enhance developer productivity 📣 👯 🎉☆687Jun 9, 2026Updated 2 months ago
- ☆24Jan 8, 2019Updated 7 years ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,890Jan 2, 2026Updated 7 months ago
- Deep Learning Pipelines for Apache Spark☆1,989Mar 30, 2023Updated 3 years ago
- Simple and Distributed Machine Learning☆5,236Updated this week
- Personal AI Implementations☆16Jul 29, 2020Updated 6 years ago
- Accelerate the use of Databricks for customers [public repo]☆15Dec 4, 2019Updated 6 years ago
- An open source python library for automated feature engineering☆7,665Jul 27, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A tool to get better debug info on spark's memory usage☆42Aug 21, 2019Updated 6 years ago
- Machine learning enhancements to Spark MlLib☆20Mar 19, 2015Updated 11 years ago
- A pure Python implementation of Apache Spark's RDD and DStream interfaces.☆270Sep 3, 2024Updated last year
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆73Nov 9, 2023Updated 2 years ago
- Benchmarks of artificial neural network library for Spark MLlib☆11Dec 3, 2015Updated 10 years ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Nov 10, 2025Updated 9 months ago
- DEPRECATED: Integrating Jupyter with Databricks via SSH☆70Jun 28, 2022Updated 4 years ago
- GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs☆1,199Updated this week
- Repository for SEPAL: Scalable Feature Learning on Huge Knowledge Graphs for Downstream Machine Learning☆26Mar 17, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Create HTML profiling reports from Apache Spark DataFrames☆197Feb 2, 2020Updated 6 years ago
- This repository highlights the workflow and ease of use of training machine learning or deep learning models using Azure Databricks. Then…☆32Feb 1, 2024Updated 2 years ago
- ☆27Jan 23, 2026Updated 6 months ago
- Taxi fare prediction using tensorflow probability☆15Jul 23, 2019Updated 7 years ago
- 🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.☆462Mar 27, 2026Updated 4 months ago
- Collection of Tools for PD Rating Model Development and Validation☆17Dec 9, 2025Updated 8 months ago
- VSCode extension to work with Databricks☆135Updated this week
- PySpark test helper methods with beautiful error messages☆774Jul 28, 2026Updated last week
- Please note that this was for the *alpha* version of GitHub Actions for Python.☆15Jan 29, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Filling in the Spark function gaps across APIs☆50Apr 14, 2021Updated 5 years ago
- A package full of linear algebra operators for Apache Spark MLlib's linalg package☆10Sep 9, 2015Updated 10 years ago
- Import Databricks notebooks as libraries/modules☆15Jun 9, 2022Updated 4 years ago
- Modin: Scale your Pandas workflows by changing a single line of code☆10,391Feb 10, 2026Updated 5 months ago
- A library that provides useful extensions to Apache Spark and PySpark.☆240Updated this week
- This is the implementation of the Recursive Nearest (Neighbor) Agglomeration☆11Oct 9, 2020Updated 5 years ago
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆27,432Updated this week