Hadoop output committers for S3
☆114Jul 9, 2020Updated 6 years ago
Alternatives and similar repositories for s3committer
Users that are interested in s3committer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Spark cloud integration: tests, cloud committers and more☆20Jan 30, 2025Updated last year
- Iceberg is a table format for large, slow-moving tabular data☆494Apr 10, 2023Updated 3 years ago
- Provide functionality to build statistical models to repair dirty tabular data in Spark☆11Apr 21, 2023Updated 3 years ago
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Oct 11, 2021Updated 5 years ago
- Base classes to use when writing tests with Spark☆1,554Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- DynamoDB data source for Apache Spark☆94Sep 2, 2021Updated 5 years ago
- Sbt plugin for Spark packages☆152Jan 10, 2018Updated 8 years ago
- Avro Schema Shredder is a REST API that enables storage of Avro Schemas in Apache Atlas. This API enables an organization to use Apache A…☆13Jan 11, 2017Updated 9 years ago
- Scala backend + TypeScript frontend Example for Idealingua API Language☆10May 5, 2021Updated 5 years ago
- Impatient fork of Ammonite☆63Jul 30, 2018Updated 8 years ago
- Big Data Toolkit for the JVM☆147Nov 4, 2020Updated 5 years ago
- The goal of this library is to provide a compatibility layer that makes it easier to adopt Spark Connect. The library is designed to be s…☆19Nov 25, 2024Updated last year
- Schema Registry integration for Apache Spark☆40Nov 16, 2022Updated 3 years ago
- SBT plugins for publishing to Maven Central, shading and managing dependencies, reporting to Coveralls from TravisCI, and more☆14Nov 13, 2020Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Mar 31, 2021Updated 5 years ago
- Hadoop utility jar for troubleshooting integration with cloud object stores☆38Jun 29, 2026Updated 4 months ago
- Speak Slack notifications and process Slack slash commands☆15Dec 20, 2018Updated 7 years ago
- Kinesis Connector for Structured Streaming☆139Jul 2, 2024Updated 2 years ago
- Configure an LDAPS Endpoint for Simple AD☆14Aug 29, 2017Updated 9 years ago
- UPenn Talk about Julia and ML☆14Nov 14, 2014Updated 11 years ago
- A knowledge base of Dotty internals and all things related☆19Jul 25, 2019Updated 7 years ago
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,006Oct 5, 2022Updated 4 years ago
- Running TPC-H on Apache Hive☆41Jul 15, 2019Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- type-class based data cleansing library for Apache Spark SQL☆78Jun 23, 2019Updated 7 years ago
- ☆16Dec 4, 2017Updated 8 years ago
- Spark Streaming Checkpoint File Manager for MinIO☆12Apr 25, 2023Updated 3 years ago
- Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol☆34Sep 8, 2022Updated 4 years ago
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,370Aug 22, 2023Updated 3 years ago
- An example of using Avro and Parquet in Spark SQL☆60Nov 16, 2015Updated 10 years ago
- Dask integration for Snowflake☆32Aug 4, 2025Updated last year
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 3 years ago
- Qubole Sparklens tool for performance tuning Apache Spark☆593Jun 26, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Apache Parquet reader in Scala without Apache Spark - developed at Purdue University☆12Feb 17, 2017Updated 9 years ago
- Scripts for parsing / making sense of yarn logs☆51Aug 22, 2016Updated 10 years ago
- Expressive types for Spark.☆898Updated this week
- A library on top of either pex or conda-pack to make your Python code easily available on a cluster☆47Sep 8, 2026Updated last month
- Dask and Spark interactions☆21Mar 13, 2017Updated 9 years ago
- Paper: A Zero-rename committer for object stores☆20Nov 7, 2025Updated 11 months ago
- Immutable/persistent functional data-structures which can transparently spill to disk.☆13Sep 13, 2012Updated 14 years ago