Koalas: pandas API on Apache Spark
☆3,373Mar 20, 2024Updated 2 years ago
Alternatives and similar repositories for koalas
Users that are interested in koalas are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,961Updated this week
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆27,726Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,392Feb 10, 2026Updated 6 months ago
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,509Apr 1, 2026Updated 4 months ago
- Deep Learning Pipelines for Apache Spark☆1,987Mar 30, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Parallel computing with task scheduling☆13,903Updated this week
- Always know what to expect from your data.☆11,746Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,642Jul 21, 2026Updated last month
- Jupyter magics and kernels for working with remote Spark clusters☆1,366Sep 9, 2025Updated 11 months ago
- An open source python library for automated feature engineering☆7,671Jul 27, 2026Updated last month
- Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark☆5,241Updated this week
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,892Jan 2, 2026Updated 7 months ago
- 📚 Parameterize, execute, and analyze notebooks☆6,476Jul 6, 2026Updated last month
- Build, Manage and Deploy AI/ML Systems☆10,250Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Apache Spark - A unified analytics engine for large-scale data processing☆43,900Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,783Aug 20, 2026Updated last week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆43,643Updated this week
- The Open Source Feature Store for AI/ML☆7,239Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆17,072Updated this week
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,536Dec 2, 2024Updated last year
- MLeap: Deploy ML Pipelines to Production☆1,543Jul 21, 2026Updated last month
- 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.☆13,684Apr 22, 2026Updated 4 months ago
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,975Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner☆2,635Mar 20, 2024Updated 2 years ago
- A game theoretic approach to explain the output of any machine learning model.☆25,710Updated this week
- the portable Python dataframe library☆6,649Updated this week
- A better notebook for Scala (and more)☆4,598Jan 27, 2026Updated 7 months ago
- 🦉 Data Versioning and ML Experiments☆15,850Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆46,632Updated this week
- cuDF - GPU DataFrame Library☆9,739Updated this week
- State of the Art Natural Language Processing☆4,159Updated this week
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,688Jul 29, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- (Legacy) Command Line Interface for Databricks☆396Oct 5, 2023Updated 2 years ago
- Voilà turns Jupyter notebooks into standalone web applications☆5,939Aug 3, 2026Updated 3 weeks ago
- A Python package for manipulating 2-dimensional tabular data structures☆1,876Jul 27, 2026Updated last month
- Fit interpretable models. Explain blackbox machine learning.☆6,929Updated this week
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,845Jul 10, 2023Updated 3 years ago
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆23,714Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,169May 19, 2026Updated 3 months ago