Joblib Apache Spark Backend
☆249Mar 24, 2026Updated 5 months ago
Alternatives and similar repositories for joblib-spark
Users that are interested in joblib-spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Spark implementation of computing Shapley Values using monte-carlo approximation☆80Mar 20, 2023Updated 3 years ago
- Koalas: pandas API on Apache Spark☆3,373Mar 20, 2024Updated 2 years ago
- Distributed scikit-learn meta-estimators in PySpark☆287Apr 26, 2025Updated last year
- (Deprecated) Scikit-learn integration package for Apache Spark☆1,071Dec 3, 2019Updated 6 years ago
- Toolkit for Apache Spark ML for Feature clean-up, feature Importance calculation suite, Information Gain selection, Distributed SMOTE, Mo…☆191Jun 1, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- PyTorch Flexible Hash Embeddings☆29Feb 4, 2020Updated 6 years ago
- pyspark methods to enhance developer productivity 📣 👯 🎉☆689Jun 9, 2026Updated 2 months ago
- ☆24Jan 8, 2019Updated 7 years ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,892Jan 2, 2026Updated 7 months ago
- Deep Learning Pipelines for Apache Spark☆1,987Mar 30, 2023Updated 3 years ago
- Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark☆5,242Updated this week
- Personal AI Implementations☆16Jul 29, 2020Updated 6 years ago
- Accelerate the use of Databricks for customers [public repo]☆15Dec 4, 2019Updated 6 years ago
- An open source python library for automated feature engineering☆7,672Jul 27, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- JVM integration for Weld☆16Sep 24, 2018Updated 7 years ago
- A tool to get better debug info on spark's memory usage☆42Aug 21, 2019Updated 7 years ago
- Sample base images for Databricks Container Services☆223Jul 21, 2026Updated last month
- A pure Python implementation of Apache Spark's RDD and DStream interfaces.☆270Sep 3, 2024Updated last year
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆73Nov 9, 2023Updated 2 years ago
- A simplified version of featuretools for Spark☆31Jun 14, 2019Updated 7 years ago
- Benchmarks of artificial neural network library for Spark MLlib☆11Dec 3, 2015Updated 10 years ago
- Extra blocks for scikit-learn pipelines.☆1,407Aug 9, 2026Updated 3 weeks ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Nov 10, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- DEPRECATED: Integrating Jupyter with Databricks via SSH☆70Jun 28, 2022Updated 4 years ago
- GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs☆1,201Updated this week
- Create HTML profiling reports from Apache Spark DataFrames☆197Feb 2, 2020Updated 6 years ago
- This repository highlights the workflow and ease of use of training machine learning or deep learning models using Azure Databricks. Then…☆32Feb 1, 2024Updated 2 years ago
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆829May 19, 2026Updated 3 months ago
- ☆27Jan 23, 2026Updated 7 months ago
- Taxi fare prediction using tensorflow probability☆15Jul 23, 2019Updated 7 years ago
- 🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.☆463Mar 27, 2026Updated 5 months ago
- VSCode extension to work with Databricks☆135Aug 20, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Filling in the Spark function gaps across APIs☆50Apr 14, 2021Updated 5 years ago
- A package full of linear algebra operators for Apache Spark MLlib's linalg package☆10Sep 9, 2015Updated 10 years ago
- Modin: Scale your Pandas workflows by changing a single line of code☆10,391Feb 10, 2026Updated 6 months ago
- A library that provides useful extensions to Apache Spark and PySpark.☆240Aug 6, 2026Updated 3 weeks ago
- This is the implementation of the Recursive Nearest (Neighbor) Agglomeration☆11Oct 9, 2020Updated 5 years ago
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆27,737Updated this week
- Demonstration of alternatives to lme4☆13Aug 12, 2019Updated 7 years ago