Koalas: pandas API on Apache Spark
☆3,372Mar 20, 2024Updated 2 years ago
Alternatives and similar repositories for koalas
Users that are interested in koalas are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,930Updated this week
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆27,419Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,391Feb 10, 2026Updated 5 months ago
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,510Apr 1, 2026Updated 4 months ago
- Deep Learning Pipelines for Apache Spark☆1,989Mar 30, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Parallel computing with task scheduling☆13,882Updated this week
- Always know what to expect from your data.☆11,699Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,639Jul 21, 2026Updated 2 weeks ago
- Jupyter magics and kernels for working with remote Spark clusters☆1,365Sep 9, 2025Updated 10 months ago
- An open source python library for automated feature engineering☆7,663Jul 27, 2026Updated last week
- Simple and Distributed Machine Learning☆5,237Updated this week
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,890Jan 2, 2026Updated 7 months ago
- 📚 Parameterize, execute, and analyze notebooks☆6,465Jul 6, 2026Updated last month
- Build, Manage and Deploy AI/ML Systems☆10,208Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Apache Spark - A unified analytics engine for large-scale data processing☆43,823Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,782Aug 1, 2026Updated last week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆43,473Updated this week
- The Open Source Feature Store for AI/ML☆7,201Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,993Updated this week
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,536Dec 2, 2024Updated last year
- MLeap: Deploy ML Pipelines to Production☆1,540Jul 21, 2026Updated 2 weeks ago
- 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.☆13,660Apr 22, 2026Updated 3 months ago
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,950Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner☆2,638Mar 20, 2024Updated 2 years ago
- A game theoretic approach to explain the output of any machine learning model.☆25,678Updated this week
- the portable Python dataframe library☆6,622Updated this week
- A better notebook for Scala (and more)☆4,597Jan 27, 2026Updated 6 months ago
- 🦉 Data Versioning and ML Experiments☆15,803Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆46,414Updated this week
- cuDF - GPU DataFrame Library☆9,725Updated this week
- State of the Art Natural Language Processing☆4,154Updated this week
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,694Jul 29, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- (Legacy) Command Line Interface for Databricks☆397Oct 5, 2023Updated 2 years ago
- Voilà turns Jupyter notebooks into standalone web applications☆5,941Updated this week
- A Python package for manipulating 2-dimensional tabular data structures☆1,876Jul 27, 2026Updated last week
- Fit interpretable models. Explain blackbox machine learning.☆6,909Updated this week
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,846Jul 10, 2023Updated 3 years ago
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆23,579Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,170May 19, 2026Updated 2 months ago