Hadoop output committers for S3
☆114Jul 9, 2020Updated 6 years ago
Alternatives and similar repositories for s3committer
Users that are interested in s3committer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Parquet Command-line Tools☆19Oct 26, 2016Updated 9 years ago
- Spark cloud integration: tests, cloud committers and more☆20Jan 30, 2025Updated last year
- Iceberg is a table format for large, slow-moving tabular data☆494Apr 10, 2023Updated 3 years ago
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Oct 11, 2021Updated 4 years ago
- Provide functionality to build statistical models to repair dirty tabular data in Spark☆11Apr 21, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- DynamoDB data source for Apache Spark☆94Sep 2, 2021Updated 5 years ago
- Base classes to use when writing tests with Spark☆1,555Aug 31, 2026Updated 3 weeks ago
- A command-line tool for launching Apache Spark clusters.☆649Dec 13, 2024Updated last year
- Sbt plugin for Spark packages☆152Jan 10, 2018Updated 8 years ago
- Impatient fork of Ammonite☆63Jul 30, 2018Updated 8 years ago
- Avro Schema Shredder is a REST API that enables storage of Avro Schemas in Apache Atlas. This API enables an organization to use Apache A…☆13Jan 11, 2017Updated 9 years ago
- Schema Registry integration for Apache Spark☆40Nov 16, 2022Updated 3 years ago
- Big Data Toolkit for the JVM☆147Nov 4, 2020Updated 5 years ago
- SBT plugins for publishing to Maven Central, shading and managing dependencies, reporting to Coveralls from TravisCI, and more☆14Nov 13, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆12Mar 31, 2021Updated 5 years ago
- Hadoop utility jar for troubleshooting integration with cloud object stores☆38Jun 29, 2026Updated 2 months ago
- Kinesis Connector for Structured Streaming☆139Jul 2, 2024Updated 2 years ago
- Java backend/toolchain for WebAssembly☆16Nov 16, 2022Updated 3 years ago
- A knowledge base of Dotty internals and all things related☆19Jul 25, 2019Updated 7 years ago
- type-class based data cleansing library for Apache Spark SQL☆78Jun 23, 2019Updated 7 years ago
- IdeaLingua RPC for Scala, TypeScript, C#☆22Jun 16, 2026Updated 3 months ago
- Spark Streaming Checkpoint File Manager for MinIO☆12Apr 25, 2023Updated 3 years ago
- Running TPC-H on Apache Hive☆41Jul 15, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆16Dec 4, 2017Updated 8 years ago
- Code sign iOS applications, without proprietary Apple software or hardware☆17Jun 21, 2017Updated 9 years ago
- Qubole Sparklens tool for performance tuning Apache Spark☆593Jun 26, 2024Updated 2 years ago
- A library on top of either pex or conda-pack to make your Python code easily available on a cluster☆47Sep 8, 2026Updated 2 weeks ago
- Real-time distributed messaging and document synchronization.☆15May 8, 2013Updated 13 years ago
- An example of using Avro and Parquet in Spark SQL☆60Nov 16, 2015Updated 10 years ago
- Apache Parquet reader in Scala without Apache Spark - developed at Purdue University☆12Feb 17, 2017Updated 9 years ago
- API for converting JVM objects to representations by MIME type, for the Jupyter ecosystem.☆26Jan 16, 2020Updated 6 years ago
- Scripts for parsing / making sense of yarn logs☆51Aug 22, 2016Updated 10 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,370Aug 22, 2023Updated 3 years ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆192Oct 15, 2025Updated 11 months ago
- Paper: A Zero-rename committer for object stores☆20Nov 7, 2025Updated 10 months ago
- An AWS SDK-backed FileSystem driver for Hadoop☆63Oct 13, 2020Updated 5 years ago
- Spark MLlib code optimized to efficiently support sparse data☆50Dec 22, 2016Updated 9 years ago
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,006Oct 5, 2022Updated 3 years ago
- Redshift data source for Apache Spark☆608Aug 10, 2023Updated 3 years ago