eto-ai / rikaiLinks
Parquet-based ML data format optimized for working with unstructured data
☆141Updated 2 years ago
Alternatives and similar repositories for rikai
Users that are interested in rikai are comparing it to the libraries listed below
Sorting:
- Distributed SQL Query Engine in Python using Ray☆246Updated last year
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆353Updated this week
- ☆107Updated 2 years ago
- A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…☆249Updated last month
- Lightweight and Fast Feature Store Powered by Go (and Rust).☆93Updated 3 years ago
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆100Updated last year
- ☆94Updated this week
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆45Updated last year
- General Metadata Architecture☆134Updated last week
- Friendly ML feature store☆45Updated 3 years ago
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Updated 2 years ago
- Instant access to the Spark cluster from anywhere☆16Updated 5 years ago
- Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.☆301Updated last year
- Point-in-Time optimizations for Apache Spark☆30Updated last year
- Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients☆37Updated 4 years ago
- Distributed SQL Engine in Python using Dask☆408Updated last year
- Liga: Let Data Dance with ML Models☆13Updated 2 years ago
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆63Updated this week
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆130Updated 10 months ago
- Ray-based Apache Beam runner☆41Updated 2 years ago
- Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful …☆145Updated last year
- Apache Calcite Adapter for Apache Kudu☆28Updated last month
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆302Updated 2 weeks ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆94Updated 6 months ago
- A simple Spark-powered ETL framework that just works 🍺☆182Updated last month
- A library that provides useful extensions to Apache Spark and PySpark.☆230Updated 2 weeks ago
- Java binding to Apache DataFusion☆83Updated 7 months ago
- Visualize column-level data lineage in Spark SQL☆92Updated 3 years ago
- Ibis Substrait Compiler☆105Updated this week
- A library on top of either pex or conda-pack to make your Python code easily available on a cluster☆45Updated last month