Deep Learning Pipelines for Apache Spark
☆1,987Mar 30, 2023Updated 3 years ago
Alternatives and similar repositories for spark-deep-learning
Users that are interested in spark-deep-learning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,850Jul 10, 2023Updated 3 years ago
- [DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark☆743Jul 30, 2024Updated 2 years ago
- (Deprecated) Scikit-learn integration package for Apache Spark☆1,072Dec 3, 2019Updated 6 years ago
- Distributed Deep learning with Keras & Spark☆1,573May 1, 2023Updated 3 years ago
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆8,840Jan 28, 2026Updated 9 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- MLeap: Deploy ML Pipelines to Production☆1,545Nov 9, 2026Updated last week
- Koalas: pandas API on Apache Spark☆3,371Mar 20, 2024Updated 2 years ago
- Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.☆622Jul 25, 2018Updated 8 years ago
- Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark☆5,257Updated this week
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,674Sep 17, 2026Updated 2 months ago
- State of the Art Natural Language Processing☆4,163Updated this week
- Interactive and Reactive Data Science using Scala and Spark.☆3,136May 16, 2023Updated 3 years ago
- Sparkling Water provides H2O functionality inside Spark cluster☆982Updated this week
- Example code from Learning Spark book☆3,896Jun 30, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Apache Spark - A unified analytics engine for large-scale data processing☆44,551Updated this week
- Databricks Scala Coding Style Guide☆2,808Apr 5, 2024Updated 2 years ago
- REST job server for Apache Spark☆2,833Mar 3, 2026Updated 8 months ago
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,698Jun 12, 2026Updated 5 months ago
- A library for time series analysis on Apache Spark☆1,194Oct 13, 2020Updated 6 years ago
- The Internals of Apache Spark☆1,553Oct 10, 2026Updated last month
- Jupyter magics and kernels for working with remote Spark clusters☆1,370Sep 9, 2025Updated last year
- Integration of TensorFlow with other open-source frameworks☆1,377Sep 25, 2024Updated 2 years ago
- Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning☆1,778Aug 16, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- PySpark + Scikit-learn = Sparkit-learn☆1,150Dec 31, 2020Updated 5 years ago
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single…☆28,979Updated this week
- Distributed Neural Networks for Spark☆609Jul 23, 2020Updated 6 years ago
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆28,855Updated this week
- GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs☆1,213Updated this week
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,895Jan 2, 2026Updated 10 months ago
- Distributed deep learning on Hadoop and Spark clusters.☆1,263Nov 15, 2019Updated 7 years ago
- TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows…☆2,281Jun 2, 2026Updated 5 months ago
- Spark: The Definitive Guide's Code Repository☆3,150Aug 26, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,796Updated this week
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,007Oct 5, 2022Updated 4 years ago
- The Cloud Native AI Platform☆15,968Sep 30, 2026Updated last month
- Breeze is/was a numerical processing library for Scala.☆3,460Oct 4, 2025Updated last year
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆9,084Updated this week
- CSV Data Source for Apache Spark 1.x☆1,055Dec 13, 2018Updated 7 years ago
- A low-latency prediction-serving system☆1,418Apr 26, 2021Updated 5 years ago
Are these results useful?