Distributed scikit-learn meta-estimators in PySpark
☆286Apr 26, 2025Updated last year
Alternatives and similar repositories for sk-dist
Users that are interested in sk-dist are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Joblib Apache Spark Backend☆248Mar 24, 2026Updated 6 months ago
- Easy hyperparameter optimization and automatic result saving across machine learning algorithms and libraries☆704Jan 20, 2021Updated 5 years ago
- Toolkit for Apache Spark ML for Feature clean-up, feature Importance calculation suite, Information Gain selection, Distributed SMOTE, Mo…☆191Jun 1, 2021Updated 5 years ago
- An open source python library for automated feature engineering☆7,690Sep 11, 2026Updated last month
- Modin: Scale your Pandas workflows by changing a single line of code☆10,391Feb 10, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Visual analysis and diagnostic tools to facilitate machine learning model selection.☆4,406Feb 19, 2025Updated last year
- Python implementations of the Boruta all-relevant feature selection method.☆1,630Nov 13, 2025Updated 11 months ago
- Fit interpretable models. Explain blackbox machine learning.☆6,958Updated this week
- TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows…☆2,277Jun 2, 2026Updated 4 months ago
- Koalas: pandas API on Apache Spark☆3,372Mar 20, 2024Updated 2 years ago
- A library for debugging/inspecting machine learning classifiers and explaining their predictions☆2,851Apr 8, 2026Updated 6 months ago
- MLeap: Deploy ML Pipelines to Production☆1,546Oct 5, 2026Updated last week
- Automated Machine Learning with scikit-learn☆8,143Sep 15, 2026Updated 3 weeks ago
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,518Apr 1, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- (Deprecated) Scikit-learn integration package for Apache Spark☆1,072Dec 3, 2019Updated 6 years ago
- A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures,…☆855Jun 19, 2021Updated 5 years ago
- Code for "Zero-Shot Out-of-Distribution Detection with Feature Correlations"☆13Jan 19, 2020Updated 6 years ago
- A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.☆10,056Sep 11, 2025Updated last year
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,698Jun 12, 2026Updated 4 months ago
- [UNMAINTAINED] Automated machine learning for analytics & production☆1,651Feb 10, 2021Updated 5 years ago
- AutoML library for deep learning☆9,335Nov 25, 2025Updated 10 months ago
- A library of sklearn compatible categorical variable encoders☆2,510Oct 7, 2026Updated last week
- Feature exploration for supervised learning☆758Feb 4, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark☆5,245Updated this week
- Shows how to create basic image adversaries, and train adversarially robust image classifiers (to some extent).☆13Oct 14, 2020Updated 6 years ago
- Using Spatial Transformer Layer with keras (theano backend).☆12Jun 7, 2016Updated 10 years ago
- Deep Learning Pipelines for Apache Spark☆1,987Mar 30, 2023Updated 3 years ago
- cuDF - GPU DataFrame Library☆9,776Updated this week
- A scikit-learn compatible neural network library that wraps PyTorch☆6,183Sep 22, 2026Updated 3 weeks ago
- ☆14Oct 3, 2026Updated last week
- A simplified version of featuretools for Spark☆31Jun 14, 2019Updated 7 years ago
- Distributed Deep learning with Keras & Spark☆1,574May 1, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14Nov 27, 2025Updated 10 months ago
- Fast and flexible AutoML with learning guarantees.☆3,451Nov 30, 2023Updated 2 years ago
- Feature selector is a tool for dimensionality reduction of machine learning datasets☆2,228Jun 17, 2024Updated 2 years ago
- Hyper-parameter optimization for sklearn☆1,647Apr 15, 2025Updated last year
- machine learning with logical rules in Python☆664Jan 31, 2024Updated 2 years ago
- A feature engineering kit for each issue, to give you a deeper and deeper understanding of the work of feature engineering!☆667Dec 6, 2020Updated 5 years ago
- Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.☆2,745Jan 2, 2024Updated 2 years ago