Deep Learning Pipelines for Apache Spark
☆1,988Mar 30, 2023Updated 3 years ago
Alternatives and similar repositories for spark-deep-learning
Users that are interested in spark-deep-learning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,844Jul 10, 2023Updated 3 years ago
- [DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark☆743Jul 30, 2024Updated 2 years ago
- (Deprecated) Scikit-learn integration package for Apache Spark☆1,071Dec 3, 2019Updated 6 years ago
- Distributed Deep learning with Keras & Spark☆1,574May 1, 2023Updated 3 years ago
- Koalas: pandas API on Apache Spark☆3,375Mar 20, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆8,853Jan 28, 2026Updated 7 months ago
- Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.☆622Jul 25, 2018Updated 8 years ago
- MLeap: Deploy ML Pipelines to Production☆1,543Updated this week
- Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark☆5,247Updated this week
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,682Updated this week
- Interactive and Reactive Data Science using Scala and Spark.☆3,140May 16, 2023Updated 3 years ago
- Apache Spark - A unified analytics engine for large-scale data processing☆44,010Updated this week
- State of the Art Natural Language Processing☆4,159Updated this week
- Databricks Scala Coding Style Guide☆2,807Apr 5, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- REST job server for Apache Spark☆2,836Mar 3, 2026Updated 6 months ago
- Example code from Learning Spark book☆3,897Jun 30, 2026Updated 2 months ago
- Sparkling Water provides H2O functionality inside Spark cluster☆980Nov 5, 2025Updated 10 months ago
- A library for time series analysis on Apache Spark☆1,194Oct 13, 2020Updated 5 years ago
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆28,020Updated this week
- PySpark + Scikit-learn = Sparkit-learn☆1,150Dec 31, 2020Updated 5 years ago
- Jupyter magics and kernels for working with remote Spark clusters☆1,366Sep 9, 2025Updated last year
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single…☆28,777Updated this week
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,698Jun 12, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The Internals of Apache Spark☆1,550Jul 18, 2026Updated 2 months ago
- GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs☆1,207Updated this week
- ☆11Feb 2, 2019Updated 7 years ago
- Distributed deep learning on Hadoop and Spark clusters.☆1,261Nov 15, 2019Updated 6 years ago
- Spark: The Definitive Guide's Code Repository☆3,152Aug 26, 2020Updated 6 years ago
- Integration of TensorFlow with other open-source frameworks☆1,377Sep 25, 2024Updated last year
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,790Updated this week
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,892Jan 2, 2026Updated 8 months ago
- Distributed Neural Networks for Spark☆609Jul 23, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Machine Learning Toolkit for Kubernetes☆15,870Aug 21, 2026Updated 3 weeks ago
- Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning☆1,782Aug 16, 2021Updated 5 years ago
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆9,000Updated this week
- A low-latency prediction-serving system☆1,420Apr 26, 2021Updated 5 years ago
- TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows…☆2,276Jun 2, 2026Updated 3 months ago
- Breeze is/was a numerical processing library for Scala.☆3,453Oct 4, 2025Updated 11 months ago
- CSV Data Source for Apache Spark 1.x☆1,057Dec 13, 2018Updated 7 years ago