Avro2TF is designed to fill the gap of making users' training data ready to be consumed by deep learning training frameworks.
☆128May 9, 2020Updated 5 years ago
Alternatives and similar repositories for Avro2TF
Users that are interested in Avro2TF are comparing it to the libraries listed below
Sorting:
- A scalable machine learning library on Apache Spark☆796Aug 30, 2021Updated 4 years ago
- TonY is a framework to natively run deep learning frameworks on Apache Hadoop.☆713Oct 14, 2023Updated 2 years ago
- Hadoop Yarn aggregated log parser utility☆23Feb 1, 2020Updated 6 years ago
- Oh no! Yet another Kafka operator for Kubernetes☆16Updated this week
- A sink to save Spark Structured Streaming DataFrame into Hive table☆23May 7, 2018Updated 7 years ago
- Helps make it easier to utilize flyte from vs-code☆11Aug 15, 2023Updated 2 years ago
- Using the Parquet file format (with Avro) to process data with Apache Flink☆14Aug 17, 2015Updated 10 years ago
- Combination of Dockerized Hortonworks projects and other Hadoop ecosystem components☆10Oct 11, 2019Updated 6 years ago
- Big Data Processing Framework - Unified Data API or SQL on Any Storage☆251Jul 10, 2025Updated 7 months ago
- Prometheus collector and exporter for Slurm cluster metrics. A Slinky project.☆16Nov 7, 2025Updated 3 months ago
- Package to extend Airflow functionality with CWL v1.0 support☆12Jun 12, 2019Updated 6 years ago
- Short Text Similarity as described in https://dl.acm.org/citation.cfm?id=2806475☆17Feb 7, 2019Updated 7 years ago
- Grok Expression Transform for Kafka Connect.☆16Feb 8, 2021Updated 5 years ago
- Ultra-high-performance local IPC framework with Zipkin tracing to conduct a beautiful symphony of (brotherhood) build tooling.☆10Jan 8, 2021Updated 5 years ago
- A tool for scale and performance testing of HDFS with a specific focus on the NameNode.☆134Jan 11, 2024Updated 2 years ago
- Dependency and data pipeline management framework for Spark and Scala☆15Apr 8, 2017Updated 8 years ago
- Akka plugin to collect various data about actors☆17Aug 19, 2024Updated last year
- Cray Lustre is HPE's curated Lustre distro for HPE ClusterStor, Cray EX, and other HPE/Cray clients☆17Feb 21, 2026Updated last week
- ☆17Feb 16, 2020Updated 6 years ago
- Implementation of the ideas in the Build Systems a la Carte paper☆15Jan 5, 2019Updated 7 years ago
- Real-time Relevant Recommendation Suggestion☆16Jul 31, 2022Updated 3 years ago
- Documentation and resources for deploying JupyterHub on Hadoop☆19Jul 16, 2019Updated 6 years ago
- MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.☆14Apr 12, 2022Updated 3 years ago
- Set up tools for running a few DL libraries on CDH and CDSW☆17Jul 23, 2020Updated 5 years ago
- Harvester load balancing controller☆20Feb 13, 2026Updated 2 weeks ago
- Apache Spark - A unified analytics engine for large-scale data processing☆16Jul 24, 2023Updated 2 years ago
- Data quality tools for Big Data☆19Oct 10, 2019Updated 6 years ago
- Integration of TensorFlow with other open-source frameworks☆1,374Sep 25, 2024Updated last year
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆303Oct 30, 2025Updated 4 months ago
- Big Data Toolkit for the JVM☆146Nov 4, 2020Updated 5 years ago
- Fast non-cryptographic hash functions for Scala☆73Aug 26, 2019Updated 6 years ago
- ☆21Sep 10, 2025Updated 5 months ago
- API for converting JVM objects to representations by MIME type, for the Jupyter ecosystem.☆25Jan 16, 2020Updated 6 years ago
- An extensible distributed system for reliable nearline data streaming at scale☆956Updated this week
- Deriving Spark DataFrame schemas from case classes☆44Jun 24, 2024Updated last year
- Scala Aggregators used for ML Model metrics monitoring☆91Sep 13, 2023Updated 2 years ago
- Miscellaneous functionality for manipulating Apache Spark RDDs.☆22Dec 29, 2018Updated 7 years ago
- DEPRECATED! Use https://github.com/h2oai/sparkling-water repository! H2O and Spark interoperability based on Tachyon.☆44Nov 25, 2014Updated 11 years ago
- type-class based data cleansing library for Apache Spark SQL☆78Jun 23, 2019Updated 6 years ago