robhowley / s3-streamingLinks
stream and (de)serialize s3 streams
☆15Updated 3 years ago
Alternatives and similar repositories for s3-streaming
Users that are interested in s3-streaming are comparing it to the libraries listed below
Sorting:
- ☆36Updated 2 weeks ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- ☆27Updated last week
- Convert JSON files to Parquet using PyArrow☆97Updated last year
- Lightweight configuration and access to multiple databases in a single project☆38Updated last year
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Goblet is an easy-to-use framework that enables developers to quickly spin up fully featured REST APIs with python on GCP☆125Updated 2 months ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- persist a sqlite database in s3, for use with aws lambda☆19Updated 4 years ago
- Fast, resilient and reproducible data analysis with cached SQL queries☆30Updated 2 years ago
- Tracing and logging tools, emphasizing data pipeline use cases with Dagster.☆15Updated last year
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, …☆83Updated 2 years ago
- Feature engineering library that helps you keep track of feature dependencies, documentation and schema☆28Updated 3 years ago
- AWS integration for python logging handlers(S3, Kinesis)☆71Updated 3 years ago
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆79Updated this week
- Python agent for AWS Lambda metrics, tracing, profiling & analytics☆79Updated 2 years ago
- Stackable cache classes for sharing, encryption, statistics and more on top of cachetools, redis and memcached☆31Updated 4 months ago
- Deprecated. A maintained fork is available at https://github.com/vemel/mypy_boto3☆112Updated 5 years ago
- Dask integration for Snowflake☆30Updated last week
- T4 is now in production as Quilt 3☆64Updated 6 years ago
- A SQLite driver for S3 and Amazon Athena 😳☆97Updated 5 years ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- Pytest plugin for local AWS integration tests☆78Updated last year
- 🗄️ A simple Python wrapper to AWS Dynamodb.☆109Updated last month
- Parse ARNs using Python☆36Updated 5 years ago
- WSGI adapter for AWS API Gateway/Lambda Proxy Integration. Mirrored from GitLab.☆19Updated 6 years ago
- Amazon Redshift SQLAlchemy Dialect☆223Updated last year
- A module for getting data into python from large data sources☆175Updated last year
- Serverless PyPI backed by S3☆59Updated last week
- A luigi powered analytics / warehouse stack☆88Updated 8 years ago