Koalas: pandas API on Apache Spark
☆3,375Mar 20, 2024Updated 2 years ago
Alternatives and similar repositories for koalas
Users that are interested in koalas are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆9,000Updated this week
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆28,020Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,391Feb 10, 2026Updated 7 months ago
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,508Apr 1, 2026Updated 5 months ago
- Deep Learning Pipelines for Apache Spark☆1,988Mar 30, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Parallel computing with task scheduling☆13,921Aug 24, 2026Updated 3 weeks ago
- Always know what to expect from your data.☆11,797Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,646Updated this week
- Jupyter magics and kernels for working with remote Spark clusters☆1,366Sep 9, 2025Updated last year
- An open source python library for automated feature engineering☆7,680Sep 11, 2026Updated last week
- Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark☆5,247Updated this week
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,892Jan 2, 2026Updated 8 months ago
- 📚 Parameterize, execute, and analyze notebooks☆6,485Jul 6, 2026Updated 2 months ago
- Build, Manage and Deploy AI/ML Systems☆10,273Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Apache Spark - A unified analytics engine for large-scale data processing☆44,010Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,783Sep 10, 2026Updated last week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆43,864Updated this week
- The Open Source Feature Store for AI/ML☆7,276Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆17,137Updated this week
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,536Dec 2, 2024Updated last year
- MLeap: Deploy ML Pipelines to Production☆1,543Updated this week
- 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.☆13,700Sep 11, 2026Updated last week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆11,005Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner☆2,633Mar 20, 2024Updated 2 years ago
- A game theoretic approach to explain the output of any machine learning model.☆25,760Updated this week
- the portable Python dataframe library☆6,661Updated this week
- A better notebook for Scala (and more)☆4,597Jan 27, 2026Updated 7 months ago
- 🦉 Data Versioning and ML Experiments☆15,877Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆46,886Updated this week
- cuDF - GPU DataFrame Library☆9,754Updated this week
- State of the Art Natural Language Processing☆4,159Updated this week
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,682Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- (Legacy) Command Line Interface for Databricks☆396Oct 5, 2023Updated 2 years ago
- Voilà turns Jupyter notebooks into standalone web applications☆5,943Sep 7, 2026Updated last week
- A Python package for manipulating 2-dimensional tabular data structures☆1,875Sep 1, 2026Updated 2 weeks ago
- Fit interpretable models. Explain blackbox machine learning.☆6,944Updated this week
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,844Jul 10, 2023Updated 3 years ago
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆23,861Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,169May 19, 2026Updated 3 months ago