Koalas: pandas API on Apache Spark
☆3,372Mar 20, 2024Updated 2 years ago
Alternatives and similar repositories for koalas
Users that are interested in koalas are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,917Updated this week
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆27,100Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,394Feb 10, 2026Updated 5 months ago
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,509Apr 1, 2026Updated 3 months ago
- Deep Learning Pipelines for Apache Spark☆1,989Mar 30, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Parallel computing with task scheduling☆13,862Updated this week
- Always know what to expect from your data.☆11,654Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,635Updated this week
- Jupyter magics and kernels for working with remote Spark clusters☆1,364Sep 9, 2025Updated 10 months ago
- An open source python library for automated feature engineering☆7,665Updated this week
- Simple and Distributed Machine Learning☆5,231Jul 6, 2026Updated last week
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,888Jan 2, 2026Updated 6 months ago
- 📚 Parameterize, execute, and analyze notebooks☆6,459Jul 6, 2026Updated last week
- Build, Manage and Deploy AI/ML Systems☆10,186Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Apache Spark - A unified analytics engine for large-scale data processing☆43,658Updated this week
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,782Jul 1, 2026Updated 2 weeks ago
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆43,283Updated this week
- The Open Source Feature Store for AI/ML☆7,142Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,941Updated this week
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,536Dec 2, 2024Updated last year
- MLeap: Deploy ML Pipelines to Production☆1,539Jul 10, 2026Updated last week
- 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.☆13,646Apr 22, 2026Updated 2 months ago
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,924Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner☆2,640Mar 20, 2024Updated 2 years ago
- the portable Python dataframe library☆6,601Updated this week
- A better notebook for Scala (and more)☆4,596Jan 27, 2026Updated 5 months ago
- 🦉 Data Versioning and ML Experiments☆15,762Updated this week
- A game theoretic approach to explain the output of any machine learning model.☆25,620Updated this week
- cuDF - GPU DataFrame Library☆9,704Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆46,173Updated this week
- State of the Art Natural Language Processing☆4,144Updated this week
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,695Jun 20, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- (Legacy) Command Line Interface for Databricks☆397Oct 5, 2023Updated 2 years ago
- Voilà turns Jupyter notebooks into standalone web applications☆5,933Jul 6, 2026Updated last week
- A Python package for manipulating 2-dimensional tabular data structures☆1,876Mar 17, 2025Updated last year
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,170May 19, 2026Updated 2 months ago
- Fit interpretable models. Explain blackbox machine learning.☆6,896Updated this week
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆23,431Updated this week
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,846Jul 10, 2023Updated 3 years ago