Train and run Pytorch models on Apache Spark.
☆338May 11, 2023Updated 3 years ago
Alternatives and similar repositories for sparktorch
Users that are interested in sparktorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Easy to use library to bring Tensorflow on Apache Spark☆295Oct 11, 2023Updated 3 years ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,895Jan 2, 2026Updated 10 months ago
- Deep Learning Pipelines for Apache Spark☆1,987Mar 30, 2023Updated 3 years ago
- PyTorch elastic training☆725Jun 15, 2022Updated 4 years ago
- 한국어 문서에 노이즈를 추가합니다.☆27Nov 9, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Distributed Deep learning with Keras & Spark☆1,574May 1, 2023Updated 3 years ago
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,698Jun 12, 2026Updated 4 months ago
- ☆26Feb 15, 2023Updated 3 years ago
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,848Jul 10, 2023Updated 3 years ago
- Codebase for "C2M3: Cycle-Consistent Multi-Model Merging".☆13Aug 20, 2025Updated last year
- Python library to run ML/data pipelines on stateless compute infrastructure (that may be ephemeral or serverless). Please see the documen…☆18May 23, 2023Updated 3 years ago
- baikal.ai's pre-trained BERT models: descriptions and sample codes☆12Jun 24, 2021Updated 5 years ago
- This is project for korean auto spacing☆12Aug 3, 2020Updated 6 years ago
- Coupling PySpark with PyTorch Models☆15Jan 22, 2020Updated 6 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A scikit-learn compatible neural network library that wraps PyTorch☆6,185Updated this week
- Python stream processing for humans☆188Apr 28, 2026Updated 6 months ago
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,674Sep 17, 2026Updated last month
- Serve, optimize and scale PyTorch models in production☆4,343Aug 6, 2025Updated last year
- Randomized SVD of large sparse matrices on Spark☆78Jul 21, 2022Updated 4 years ago
- A simple middleware to improving GPU utilization then speedup online inference.☆19Feb 22, 2021Updated 5 years ago
- Data exchange and persistence based on human-readable files☆22Dec 10, 2024Updated last year
- State of the Art Natural Language Processing☆4,160Updated this week
- PyTorch examples powered by Lightning☆11Dec 28, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A library for Spark DataFrame using MinIO Select API☆104Sep 27, 2019Updated 7 years ago
- A Neural network implementation with Scala☆20Jul 17, 2016Updated 10 years ago
- Field-aware factorization machine (FFM) with FTRL☆46Sep 17, 2023Updated 3 years ago
- Describe the format of image/text datasets☆12Apr 26, 2022Updated 4 years ago
- MLeap: Deploy ML Pipelines to Production☆1,545Oct 5, 2026Updated last month
- Basic Utilities for PyTorch Natural Language Processing (NLP)☆2,220Jul 4, 2023Updated 3 years ago
- Koalas: pandas API on Apache Spark☆3,371Mar 20, 2024Updated 2 years ago
- Integration of TensorFlow with other open-source frameworks☆1,376Sep 25, 2024Updated 2 years ago
- ☆14Nov 13, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆39Apr 11, 2024Updated 2 years ago
- Automatic architecture search and hyperparameter optimization for PyTorch☆2,541Apr 9, 2024Updated 2 years ago
- Read and write Tensorflow TFRecord data from Apache Spark.☆300Apr 22, 2024Updated 2 years ago
- Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟☆52Jan 8, 2022Updated 4 years ago
- ☆25Apr 13, 2021Updated 5 years ago
- Distributed scikit-learn meta-estimators in PySpark☆286Apr 26, 2025Updated last year
- TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows…☆2,280Jun 2, 2026Updated 5 months ago