Alternatives and similar repositories for mrjob

Users that are interested in mrjob are comparing it to the libraries listed below

• klbostee / dumbo

  View on GitHub
  Python module that allows one to easily write and run Hadoop programs.
  ☆1,032Jan 9, 2018Updated 8 years ago
• crs4 / pydoop

  View on GitHub
  A Python MapReduce and HDFS API for Hadoop
  ☆242Jan 19, 2026Updated 3 weeks ago
• spotify / luigi

  View on GitHub
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,662Updated this week
• dask / dask

  View on GitHub
  Parallel computing with task scheduling
  ☆13,738Feb 5, 2026Updated last week
• discoproject / disco

  View on GitHub
  a Map/Reduce framework for distributed computing
  ☆1,629Jan 30, 2018Updated 8 years ago
• blaze / blaze

  View on GitHub
  NumPy and Pandas interface to Big Data
  ☆3,198Sep 29, 2023Updated 2 years ago
• apache / airflow

  View on GitHub
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  ☆44,274Updated this week
• bwhite / hadoopy

  View on GitHub
  Python MapReduce library written in Cython. Visit us in #hadoopy on freenode. See the link below for documentation and tutorials.
  ☆241Jan 8, 2016Updated 10 years ago
• Miserlou / Zappa

  View on GitHub
  Serverless Python
  ☆11,853Mar 23, 2023Updated 2 years ago
• wrobstory / vincent

  View on GitHub
  A Python to Vega translator
  ☆2,027Oct 25, 2016Updated 9 years ago
• pinterest / pinball

  View on GitHub
  Pinball is a scalable workflow manager
  ☆1,042Dec 10, 2019Updated 6 years ago
• myusuf3 / delorean

  View on GitHub
  Delorean: Time Travel Made Easy
  ☆1,832Feb 3, 2023Updated 3 years ago
• MagicStack / uvloop

  View on GitHub
  Ultra fast asyncio event loop.
  ☆11,641Jan 30, 2026Updated 2 weeks ago
• pystorm / streamparse

  View on GitHub
  Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
  ☆1,506Jul 22, 2025Updated 6 months ago
• Yelp / paasta

  View on GitHub
  An open, distributed platform as a service
  ☆1,721Updated this week
• dropbox / PyHive

  View on GitHub
  Python interface to Hive and Presto. 🐝
  ☆1,696Aug 7, 2024Updated last year
• mahmoud / boltons

  View on GitHub
  🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library.…
  ☆6,851Jan 28, 2026Updated 2 weeks ago
• robinhood / faust

  View on GitHub
  Python Stream Processing
  ☆6,836Jul 27, 2024Updated last year
• yhat / rodeo

  View on GitHub
  A data science IDE for Python
  ☆3,903Apr 16, 2018Updated 7 years ago
• rq / rq

  View on GitHub
  Simple job queues for Python
  ☆10,575Jan 31, 2026Updated 2 weeks ago
• boto / boto

  View on GitHub
  For the latest version of boto, see https://github.com/boto/boto3 -- Python interface to Amazon Web Services
  ☆6,445Jan 12, 2024Updated 2 years ago
• stitchfix / pyxley

  View on GitHub
  Python helpers for building dashboards using Flask and React
  ☆2,270Jun 2, 2025Updated 8 months ago
• gevent / gevent

  View on GitHub
  Coroutine-based concurrency library for Python
  ☆6,436Jan 1, 2026Updated last month
• tensorflow / skflow

  View on GitHub
  Simplified interface for TensorFlow (mimicking Scikit Learn) for Deep Learning
  ☆3,169Aug 30, 2021Updated 4 years ago
• clips / pattern

  View on GitHub
  Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
  ☆8,854Jun 10, 2024Updated last year
• apache / superset

  View on GitHub
  Apache Superset is a Data Visualization and Data Exploration Platform
  ☆70,505Updated this week
• facebookresearch / fastText

  View on GitHub
  Library for fast text representation and classification.
  ☆26,481Mar 22, 2024Updated last year
• tflearn / tflearn

  View on GitHub
  Deep learning library featuring a higher-level API for TensorFlow.
  ☆9,609May 6, 2024Updated last year
• dpkp / kafka-python

  View on GitHub
  Python client for Apache Kafka
  ☆5,888Jan 3, 2026Updated last month
• dmlc / xgboost

  View on GitHub
  Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…
  ☆28,006Updated this week
• google / yapf

  View on GitHub
  A formatter for Python files
  ☆13,985Jan 26, 2026Updated 2 weeks ago
• piskvorky / gensim

  View on GitHub
  Topic Modelling for Humans
  ☆16,355Nov 1, 2025Updated 3 months ago
• Yelp / Tron

  View on GitHub
  Next generation batch process scheduling and management
  ☆352Updated this week
• explosion / spaCy

  View on GitHub
  💫 Industrial-strength Natural Language Processing (NLP) in Python
  ☆33,201Nov 27, 2025Updated 2 months ago
• keras-team / keras

  View on GitHub
  Deep Learning for humans
  ☆63,764Updated this week
• falconry / falcon

  View on GitHub
  The no-magic web API and microservices framework for Python developers, with a focus on reliability and performance at scale.
  ☆9,801Jan 25, 2026Updated 3 weeks ago
• spotify / snakebite

  View on GitHub
  A pure python HDFS client
  ☆860Apr 19, 2022Updated 3 years ago
• airbnb / aerosolve

  View on GitHub
  A machine learning package built for humans.
  ☆4,799Nov 6, 2025Updated 3 months ago
• sanic-org / sanic

  View on GitHub
  Accelerate your web app development | Build fast. Run fast.
  ☆18,637Jan 7, 2026Updated last month