Java implementation of a mini Spark-like framework named MiniSpark that can run on top of a HDFS cluster. MiniSpark supports operators including Map, FlatMap, MapPair, Reduce, ReduceByKey, Collect, Count, Parallelize, Join and Filter.
☆36Jul 28, 2017Updated 9 years ago
Alternatives and similar repositories for MiniSpark
Users that are interested in MiniSpark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL 2019/AACL 2020] Second-Order Syntactic/Semantic Dependency Parsing With Mean Field Variational Inference (PyTorch)☆14Oct 22, 2020Updated 6 years ago
- Source code of ACL2022 "Headed-Span-Based Projective Dependency Parsing" and "Combining (second-order) graph-based and headed-span-based …☆16Jan 12, 2023Updated 3 years ago
- Implementation of a Big Data (batch and stream) distributed processing engine in Java using Akka actors.☆12Feb 20, 2023Updated 3 years ago
- 一个基于内存的分布式计算框架。☆10Apr 13, 2016Updated 10 years ago
- Spark's rpc module☆12Mar 6, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Jan 5, 2022Updated 4 years ago
- Alerting and monitoring tool for Apache Spark☆23May 20, 2022Updated 4 years ago
- Code and dataset for the paper ``Challenges to Open-Domain Constituency Parsing''☆11Sep 22, 2022Updated 4 years ago
- A MVP implementation of distributed query engine cut from datafusion-ballista codebase for learning purpose.☆12Jan 10, 2025Updated last year
- How Query Engines Work 中文版☆11Jul 7, 2024Updated 2 years ago
- KLEE Symbolic Execution Engine☆10Jan 31, 2026Updated 8 months ago
- Distributed KV Storage System based on Raft and RocksDB, can be use to store small files, like images.☆59Mar 12, 2020Updated 6 years ago
- BusTub web shell☆19Nov 13, 2023Updated 2 years ago
- 基于valuecell框架自研国内可用金融投资工具☆21Dec 16, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆198Nov 12, 2021Updated 4 years ago
- a simple java virtual machine implemented by pure Java☆15Apr 14, 2018Updated 8 years ago
- This project compose of two parts: 1) write, spark job to write to hbase using bulk load to; 2)read, rest api reading from hbase base on …☆20Oct 25, 2017Updated 9 years ago
- Kafka as a Datalog Engine☆27Mar 31, 2025Updated last year
- Distribute Network Calculate Framework☆14Aug 15, 2017Updated 9 years ago
- Struggleliu's Blog☆11Jan 9, 2015Updated 11 years ago
- VM framework using LLVM by Nicolas Geoffray, including a functional JVM. 'master' tracks official SVN, other branches are my own develop…☆10Feb 5, 2012Updated 14 years ago
- 基于Java的多线程爬虫框架☆11Jun 14, 2024Updated 2 years ago
- Eurosys22' - Rolis: a software approach to efficiently replicating multi-core transactions☆17Feb 28, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆14Apr 27, 2020Updated 6 years ago
- ☆17Mar 19, 2024Updated 2 years ago
- [ECCV2020] Motion-excited Sampler: Video Adversarial Attack with Sparked Prior☆11Nov 7, 2020Updated 5 years ago
- Fast, reliable, and scalable channels implementation based on Redis streams.☆11Jun 25, 2024Updated 2 years ago
- 基于spring boot构建，使用akka actor按照table并发消费从canal获取的数据库同步数据，根据顺序对要在目标库执行的sql batch化☆10Apr 21, 2018Updated 8 years ago
- Distributed Lisp interpreter in Erlang.☆11Dec 14, 2016Updated 9 years ago
- My solutions to labs in MIT 6.824: Distributed Systems (2013 Spring) [http://pdos.csail.mit.edu/6.824-2013/]☆10Aug 18, 2013Updated 13 years ago
- This is the course taught by Prof.John Shen and Prof. Onur Mutlu from CMU☆12May 13, 2016Updated 10 years ago
- distributed rate limiter for traffic control☆12Feb 2, 2018Updated 8 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Deprecated☆11Oct 10, 2020Updated 6 years ago
- 基于C语言实现的JVM☆17Oct 31, 2020Updated 6 years ago
- Lock-free message passing over shared memory for a single producer and consumer☆11Nov 18, 2010Updated 15 years ago
- MIT 6.824 Lab 2012(C++)☆29Mar 13, 2013Updated 13 years ago
- A lite fast object pool☆50Sep 18, 2026Updated last month
- zk + netty 实现集群节点文件同步服务☆31Jun 1, 2016Updated 10 years ago
- 一款基于MyBatis的轻量级插件，旨在如诗般优雅地呈现完整SQL☆15Jun 7, 2025Updated last year