BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray
☆2,697Jun 12, 2026Updated 4 months ago
Alternatives and similar repositories for BigDL
Users that are interested in BigDL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆8,844Jan 28, 2026Updated 8 months ago
- Deep Learning on Flink aims to integrate Flink and deep learning frameworks (e.g. TensorFlow, PyTorch, etc) to enable distributed deep le…☆694Nov 12, 2024Updated last year
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,848Jul 10, 2023Updated 3 years ago
- Deep Learning Pipelines for Apache Spark☆1,987Mar 30, 2023Updated 3 years ago
- Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark☆5,249Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Alink is the Machine Learning algorithm platform based on Flink, developed by the PAI team of Alibaba computing platform.☆3,613Jun 7, 2024Updated 2 years ago
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆379Sep 11, 2026Updated last month
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,675Sep 17, 2026Updated last month
- Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL☆210Jan 3, 2023Updated 3 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,795Updated this week
- Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.☆1,834May 29, 2024Updated 2 years ago
- TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows…☆2,279Jun 2, 2026Updated 4 months ago
- Koalas: pandas API on Apache Spark☆3,371Mar 20, 2024Updated 2 years ago
- MLeap: Deploy ML Pipelines to Production☆1,545Oct 5, 2026Updated 3 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆44,130Updated this week
- Brings SQL and AI together.☆5,188Apr 18, 2024Updated 2 years ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,895Jan 2, 2026Updated 9 months ago
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,254Sep 1, 2026Updated last month
- State of the Art Natural Language Processing☆4,159Updated this week
- The Cloud Native AI Platform☆15,924Sep 30, 2026Updated 3 weeks ago
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆9,058Updated this week
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆28,542Updated this week
- A high performance and generic framework for distributed DNN training☆3,719Oct 3, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model c…☆14,367Jul 3, 2024Updated 2 years ago
- Upserts, Deletes And Incremental Processing on Big Data.☆6,343Updated this week
- Apache Flink☆26,430Updated this week
- AI on Hadoop☆1,729Jul 1, 2025Updated last year
- Distributed Deep learning with Keras & Spark☆1,574May 1, 2023Updated 3 years ago
- Apache Spark - A unified analytics engine for large-scale data processing☆44,339Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,371Updated this week
- Resource scheduling and cluster management for AI☆2,698Oct 19, 2026Updated last week
- REST job server for Apache Spark☆2,833Mar 3, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Submarine is Cloud Native Machine Learning Platform.☆704Apr 3, 2024Updated 2 years ago
- An open source python library for automated feature engineering☆7,688Sep 11, 2026Updated last month
- Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.☆2,746Jan 2, 2024Updated 2 years ago
- Read and write Tensorflow TFRecord data from Apache Spark.☆300Apr 22, 2024Updated 2 years ago
- Train and run Pytorch models on Apache Spark.☆338May 11, 2023Updated 3 years ago
- 基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法☆2,045Feb 21, 2024Updated 2 years ago
- AutoML library for deep learning☆9,338Nov 25, 2025Updated 11 months ago