Alternatives and similar repositories for dagster-ray

Users that are interested in dagster-ray are comparing it to the libraries listed below

• kolonialno / patito
  A data modelling layer built on top of polars and pydantic
  ☆198Updated 2 years ago
• pola-rs / dask-polars
  Coming soon
  ☆62Updated 2 years ago
• ray-project / deltacat
  A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…
  ☆247Updated 3 weeks ago
• datafusion-contrib / datafusion-python
  Python binding for DataFusion
  ☆59Updated 3 years ago
• jorgecarleitao / arrowdantic
  Arrow, pydantic style
  ☆85Updated 2 years ago
• apache / datafusion-python
  Apache DataFusion Python Bindings
  ☆516Updated last week
• danielgafni / dagster-polars
  [Project moved] Polars integration for Dagster
  ☆35Updated 6 months ago
• opensource-observer / dagster-sqlmesh
  Dagster SQLMesh Adapter
  ☆76Updated this week
• simw / pydantic-to-pyarrow
  A library to convert a pydantic model to a pyarrow schema
  ☆44Updated 5 months ago
• adriangb / pgpq
  Stream Arrow data into Postgres
  ☆273Updated 3 months ago
• ibis-project / ibis-ml
  IbisML is a library for building scalable ML pipelines using Ibis.
  ☆117Updated 3 months ago
• definite-app / duck-takes-flight
  A high-performance data streaming system using DuckDB and Apache Arrow Flight.
  ☆88Updated 8 months ago
• xorq-labs / xorq
  multi-engine batch transformation framework
  ☆452Updated this week
• flyteorg / flytekit
  Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
  ☆296Updated this week
• delta-incubator / delta-sharing-rs
  A Minimalistic Rust Implementation of Delta Sharing Server.
  ☆95Updated 7 months ago
• roeap / object-store-python
  Python bindings and arrow integration for the rust object_store crate.
  ☆64Updated last year
• binste / dbt-ibis
  Write your dbt models using Ibis
  ☆72Updated 7 months ago
• aai-institute / lakefs-spec
  An fsspec implementation for the lakeFS project
  ☆58Updated 3 weeks ago
• BauplanLabs / quack-reduce
  A playground for running duckdb as a stateless query engine over a data lake
  ☆212Updated last year
• wseaton / sqloxide
  Python bindings for sqlparser-rs
  ☆198Updated 5 months ago
• influxdata / flightsql-dbapi
  DB API 2 interface for Flight SQL with SQLAlchemy extras.
  ☆40Updated last month
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated last year
• voltrondata / superset-sqlalchemy-adbc-flight-sql-poc
  A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.
  ☆25Updated 2 years ago
• godatadriven / pydantic-avro
  This library can convert a pydantic class to a avro schema or generate python code from a avro schema.
  ☆79Updated 3 weeks ago
• mabel-dev / opteryx
  🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.
  ☆109Updated this week
• mongodb-labs / mongo-arrow
  MongoDB integrations for Apache Arrow. Export MongoDB documents to numpy array, parquet files, and pandas dataframes in one line of code.
  ☆111Updated last week
• ion-elgreco / polars-hash
  Polars plugin for stable hashing functionality
  ☆83Updated 2 months ago
• gabledata / recap
  Work with your web service, database, and streaming schemas in a single format.
  ☆343Updated 2 months ago
• PRQL / dbt-prql
  dbt-prql allows writing PRQL in dbt models
  ☆107Updated last week
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆105Updated last week