Run MapReduce jobs on Hadoop or Amazon Web Services
☆2,617Mar 24, 2023Updated 2 years ago
Alternatives and similar repositories for mrjob
Users that are interested in mrjob are comparing it to the libraries listed below
Sorting:
- Python module that allows one to easily write and run Hadoop programs.☆1,032Jan 9, 2018Updated 8 years ago
- A Python MapReduce and HDFS API for Hadoop☆242Jan 19, 2026Updated last month
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,683Feb 28, 2026Updated last week
- Parallel computing with task scheduling☆13,754Mar 2, 2026Updated last week
- a Map/Reduce framework for distributed computing☆1,629Jan 30, 2018Updated 8 years ago
- NumPy and Pandas interface to Big Data☆3,196Sep 29, 2023Updated 2 years ago
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆44,510Updated this week
- Python MapReduce library written in Cython. Visit us in #hadoopy on freenode. See the link below for documentation and tutorials.☆242Jan 8, 2016Updated 10 years ago
- Serverless Python☆11,852Mar 23, 2023Updated 2 years ago
- A Python to Vega translator☆2,026Oct 25, 2016Updated 9 years ago
- Pinball is a scalable workflow manager☆1,045Dec 10, 2019Updated 6 years ago
- Delorean: Time Travel Made Easy☆1,830Feb 3, 2023Updated 3 years ago
- Ultra fast asyncio event loop.☆11,674Jan 30, 2026Updated last month
- Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.☆1,506Jul 22, 2025Updated 7 months ago
- An open, distributed platform as a service☆1,722Updated this week
- Python interface to Hive and Presto. 🐝☆1,695Aug 7, 2024Updated last year
- 🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library.…☆6,854Jan 28, 2026Updated last month
- Python Stream Processing☆6,828Jul 27, 2024Updated last year
- A data science IDE for Python☆3,901Apr 16, 2018Updated 7 years ago
- Simple job queues for Python☆10,594Updated this week
- For the latest version of boto, see https://github.com/boto/boto3 -- Python interface to Amazon Web Services☆6,442Jan 12, 2024Updated 2 years ago
- Python helpers for building dashboards using Flask and React☆2,270Jun 2, 2025Updated 9 months ago
- Coroutine-based concurrency library for Python☆6,439Mar 1, 2026Updated last week
- Simplified interface for TensorFlow (mimicking Scikit Learn) for Deep Learning☆3,169Aug 30, 2021Updated 4 years ago
- Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.☆8,859Jun 10, 2024Updated last year
- Apache Superset is a Data Visualization and Data Exploration Platform☆70,755Mar 2, 2026Updated last week
- Library for fast text representation and classification.☆26,501Mar 22, 2024Updated last year
- Deep learning library featuring a higher-level API for TensorFlow.☆9,601May 6, 2024Updated last year
- Python client for Apache Kafka☆5,890Feb 25, 2026Updated last week
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…☆28,066Updated this week
- A formatter for Python files☆13,988Feb 20, 2026Updated 2 weeks ago
- Topic Modelling for Humans☆16,371Nov 1, 2025Updated 4 months ago
- Next generation batch process scheduling and management☆352Feb 26, 2026Updated last week
- 💫 Industrial-strength Natural Language Processing (NLP) in Python☆33,283Updated this week
- Deep Learning for humans☆63,869Updated this week
- The no-magic web API and microservices framework for Python developers, with a focus on reliability and performance at scale.☆9,803Updated this week
- A pure python HDFS client☆859Apr 19, 2022Updated 3 years ago
- A machine learning package built for humans.☆4,800Nov 6, 2025Updated 4 months ago
- Accelerate your web app development | Build fast. Run fast.☆18,641Jan 7, 2026Updated 2 months ago