Alternatives and similar repositories for sparktorch

Users that are interested in sparktorch are comparing it to the libraries listed below

• lifeomic / sparkflow

  View on GitHub
  Easy to use library to bring Tensorflow on Apache Spark
  ☆296Oct 11, 2023Updated 2 years ago
• hkjeon13 / noising-korean

  View on GitHub
  한국어 문서에 노이즈를 추가합니다.
  ☆27Nov 9, 2022Updated 3 years ago
• uber / petastorm

  View on GitHub
  Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…
  ☆1,876Jan 2, 2026Updated last month
• pytorch / elastic

  View on GitHub
  PyTorch elastic training
  ☆728Jun 15, 2022Updated 3 years ago
• JoungheeKim / kor-spacing

  View on GitHub
  This is project for korean auto spacing
  ☆12Aug 3, 2020Updated 5 years ago
• NinaTian98369 / Bert-Multi-label-Classifier

  View on GitHub
  Multi-label classifier based on BERT by Pytorch
  ☆15Oct 23, 2019Updated 6 years ago
• intel / BigDL

  View on GitHub
  BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray
  ☆2,692Feb 5, 2026Updated last week
• baikalai / baikal-bert

  View on GitHub
  baikal.ai's pre-trained BERT models: descriptions and sample codes
  ☆12Jun 24, 2021Updated 4 years ago
• Lightning-Universe / lightning-diffusion_component

  View on GitHub
  ☆26Feb 15, 2023Updated 3 years ago
• kakaobrain / autowu

  View on GitHub
  Official repository for Automated Learning Rate Scheduler for Large-Batch Training (8th ICML Workshop on AutoML)
  ☆40Dec 3, 2021Updated 4 years ago
• maxpumperla / elephas

  View on GitHub
  Distributed Deep learning with Keras & Spark
  ☆1,578May 1, 2023Updated 2 years ago
• pytorch / serve

  View on GitHub
  Serve, optimize and scale PyTorch models in production
  ☆4,358Aug 6, 2025Updated 6 months ago
• emartinezs44 / SparkGCN

  View on GitHub
  GCN implementation on top of Apache Spark
  ☆16Oct 30, 2022Updated 3 years ago
• pyrustic / shared

  View on GitHub
  Data exchange and persistence based on human-readable files
  ☆22Dec 10, 2024Updated last year
• omegaml / minibatch

  View on GitHub
  Python stream processing for humans
  ☆189Jan 20, 2026Updated 3 weeks ago
• skorch-dev / skorch

  View on GitHub
  A scikit-learn compatible neural network library that wraps PyTorch
  ☆6,149Dec 22, 2025Updated last month
• hamanlp / hama-py

  View on GitHub
  🦛 파이썬 한글 처리 라이브러리. Python Korean Morphological Analyzer
  ☆19Feb 4, 2025Updated last year
• markwwen / ServingAgent

  View on GitHub
  A simple middleware to improving GPU utilization then speedup online inference.
  ☆19Feb 22, 2021Updated 4 years ago
• microsoft / SynapseML

  View on GitHub
  Simple and Distributed Machine Learning
  ☆5,198Updated this week
• horovod / horovod

  View on GitHub
  Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
  ☆14,668Dec 1, 2025Updated 2 months ago
• minio / spark-select

  View on GitHub
  A library for Spark DataFrame using MinIO Select API
  ☆99Sep 27, 2019Updated 6 years ago
• yahoo / TensorFlowOnSpark

  View on GitHub
  TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
  ☆3,859Jul 10, 2023Updated 2 years ago
• composable-logs / composable-logs

  View on GitHub
  Python library to run ML/data pipelines on stateless compute infrastructure (that may be ephemeral or serverless). Please see the documen…
  ☆18May 23, 2023Updated 2 years ago
• hamelsmu / ft-drift

  View on GitHub
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆39Apr 11, 2024Updated last year
• JohnSnowLabs / spark-nlp

  View on GitHub
  State of the Art Natural Language Processing
  ☆4,107Updated this week
• monologg / ko_lm_dataformat

  View on GitHub
  A utility for storing and reading files for Korean LM training 💾
  ☆35Oct 15, 2025Updated 4 months ago
• DukeEnglish / knlp

  View on GitHub
  非常好用的工具包，可以直接安装并使用
  ☆21Mar 18, 2022Updated 3 years ago
• openkorpos / model-mecab

  View on GitHub
  MeCab model trained with OpenKorPos.
  ☆23Jun 19, 2022Updated 3 years ago
• combust / mleap

  View on GitHub
  MLeap: Deploy ML Pipelines to Production
  ☆1,533Jan 12, 2026Updated last month
• PetrochukM / PyTorch-NLP

  View on GitHub
  Basic Utilities for PyTorch Natural Language Processing (NLP)
  ☆2,226Jul 4, 2023Updated 2 years ago
• Noodle-ai / mlflow_part1_condaEnv

  View on GitHub
  Introduction to MLflow and Using MLflow with an Anaconda Environment
  ☆11Sep 17, 2020Updated 5 years ago
• nayohan / SimKoR

  View on GitHub
  [HCLT 2022] Korean sentence text similarity dataset using naver shopping review
  ☆25Oct 20, 2022Updated 3 years ago
• japila-books / pyspark-internals

  View on GitHub
  The Internals of PySpark
  ☆27Dec 29, 2024Updated last year
• charlesdong1991 / py-roughviz

  View on GitHub
  The Python implementation of JavaScript Library RoughViz to create interactive sketchy charts
  ☆100Apr 11, 2024Updated last year
• DagsHub / fds

  View on GitHub
  Fast Data Science, AKA fds, is a CLI for Data Scientists to version control data and code at once, by conveniently wrapping git and dvc
  ☆391Jun 30, 2024Updated last year
• mottJohn / AERMOD

  View on GitHub
  A python library to prepare data for AERMOD model inputs (Hong Kong).
  ☆11Dec 2, 2021Updated 4 years ago
• dudwns511 / MvFS_CIKM23

  View on GitHub
  ☆12Oct 3, 2023Updated 2 years ago
• cxsmarkchan / RaFM

  View on GitHub
  An implementation of RaFM. Xiaoshuang Chen, Yin Zheng, Jiaxiang Wang, et al. "RaFM: Rank-Aware Factorization Machines"
  ☆12May 11, 2019Updated 6 years ago
• tomMoral / Dicod

  View on GitHub
  Experiments for ICML paper DICOD: Distributed Convolutional Coordinate Descent for Convolutional Sparse Coding, ICML 2018, T. Moreau, L. …
  ☆12Jan 24, 2019Updated 7 years ago