Train and run Pytorch models on Apache Spark.
☆339May 11, 2023Updated 2 years ago
Alternatives and similar repositories for sparktorch
Users that are interested in sparktorch are comparing it to the libraries listed below
Sorting:
- Easy to use library to bring Tensorflow on Apache Spark☆297Oct 11, 2023Updated 2 years ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,880Jan 2, 2026Updated 2 months ago
- PyTorch elastic training☆729Jun 15, 2022Updated 3 years ago
- Multi-label classifier based on BERT by Pytorch☆15Oct 23, 2019Updated 6 years ago
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,692Updated this week
- ☆26Feb 15, 2023Updated 3 years ago
- Distributed Deep learning with Keras & Spark☆1,578May 1, 2023Updated 2 years ago
- This is project for korean auto spacing☆12Aug 3, 2020Updated 5 years ago
- Introduction to MLflow and Using MLflow with an Anaconda Environment☆11Sep 17, 2020Updated 5 years ago
- baikal.ai's pre-trained BERT models: descriptions and sample codes☆12Jun 24, 2021Updated 4 years ago
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,858Jul 10, 2023Updated 2 years ago
- Simple and Distributed Machine Learning☆5,213Mar 12, 2026Updated last week
- Serve, optimize and scale PyTorch models in production☆4,362Aug 6, 2025Updated 7 months ago
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,679Dec 1, 2025Updated 3 months ago
- A library for Spark DataFrame using MinIO Select API☆101Sep 27, 2019Updated 6 years ago
- A scikit-learn compatible neural network library that wraps PyTorch☆6,150Feb 25, 2026Updated 3 weeks ago
- Python stream processing for humans☆189Jan 20, 2026Updated 2 months ago
- A simple middleware to improving GPU utilization then speedup online inference.☆19Feb 22, 2021Updated 5 years ago
- State of the Art Natural Language Processing☆4,115Mar 13, 2026Updated last week
- Official repository for Automated Learning Rate Scheduler for Large-Batch Training (8th ICML Workshop on AutoML)☆40Dec 3, 2021Updated 4 years ago
- Basic Utilities for PyTorch Natural Language Processing (NLP)☆2,228Jul 4, 2023Updated 2 years ago
- 🦛 파이썬 한글 처리 라이브러리. Python Korean Morphological Analyzer☆19Feb 4, 2025Updated last year
- A public repository for corrupt0 datathon's court data☆11Jul 6, 2019Updated 6 years ago
- MLeap: Deploy ML Pipelines to Production☆1,535Mar 10, 2026Updated last week
- Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟☆53Jan 8, 2022Updated 4 years ago
- ☆25Apr 13, 2021Updated 4 years ago
- MeCab model trained with OpenKorPos.☆23Jun 19, 2022Updated 3 years ago
- Spark Shuffle Optimization with RDMA+AEP☆30May 23, 2023Updated 2 years ago
- PyTorch extensions for high performance and large scale training.☆3,403Apr 26, 2025Updated 10 months ago
- Read and write Tensorflow TFRecord data from Apache Spark.☆298Apr 22, 2024Updated last year
- Fast Data Science, AKA fds, is a CLI for Data Scientists to version control data and code at once, by conveniently wrapping git and dvc☆391Jun 30, 2024Updated last year
- Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.☆623Jul 25, 2018Updated 7 years ago
- Amazon Recommendation System build on BPR TensorFlow implementation☆16Jun 10, 2017Updated 8 years ago
- ☆11Oct 3, 2021Updated 4 years ago
- ☆11Dec 11, 2022Updated 3 years ago
- Spark On Angel, arming Spark with a powerful Parameter Server, which enable Spark to train very big models☆83Jan 2, 2023Updated 3 years ago
- A utility for storing and reading files for Korean LM training 💾☆35Oct 15, 2025Updated 5 months ago
- The Python implementation of JavaScript Library RoughViz to create interactive sketchy charts☆100Apr 11, 2024Updated last year
- TBEEF, a doubly ensemble framework for recommendation and prediction problems.☆20Apr 16, 2016Updated 9 years ago