eto-ai / rikai
Parquet-based ML data format optimized for working with unstructured data
☆138Updated last year
Related projects: ⓘ
- A portable Pythonic Data Catalog API powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture t…☆147Updated this week
- Distributed SQL Query Engine in Python using Ray☆230Updated 10 months ago
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆304Updated last month
- ☆53Updated this week
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆88Updated 3 months ago
- ☆38Updated this week
- Lightweight and Fast Feature Store Powered by Go (and Rust).☆86Updated 2 years ago
- Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…☆20Updated 6 months ago
- Python - Java/Scala API for the Hopsworks feature store☆53Updated last week
- Point-in-Time optimizations for Apache Spark☆29Updated 8 months ago
- ☆54Updated 8 months ago
- Clink is a library that provides APIs and infrastructure to facilitate the development of parallelizable feature engineering operators th…☆28Updated 2 years ago
- ☆104Updated last year
- Ray-based Apache Beam runner☆41Updated last year
- Unified storage framework for the entire machine learning lifecycle☆146Updated 6 months ago
- Apache datasketches☆85Updated last year
- cuVS - a library for vector search and clustering on the GPU☆170Updated this week
- The Internals of PySpark☆24Updated this week
- General Metadata Architecture☆121Updated this week
- A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.☆118Updated this week
- Friendly ML feature store☆44Updated 2 years ago
- LST-Bench is a framework that allows users to run benchmarks specifically designed for evaluating Log-Structured Tables (LSTs) such as De…☆64Updated last week
- User tools for Spark RAPIDS☆49Updated this week
- Distributed SQL Engine in Python using Dask☆385Updated 3 weeks ago
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆256Updated last year
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Updated last year
- ☆75Updated 2 weeks ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆37Updated last year
- An Extensible Data Skipping Framework☆42Updated last year
- Instant access to the Spark cluster from anywhere☆16Updated 3 years ago