Alternatives and similar repositories for spark

Users that are interested in spark are comparing it to the libraries listed below

• google / cluster-scheduler-simulator
  Automatically exported from code.google.com/p/cluster-scheduler-simulator
  ☆169Updated 3 years ago
• SWIMProjectUCB / SWIM
  Statistical Workload Injector for MapReduce - Project at UC Berkeley AMP Lab
  ☆129Updated 11 years ago
• strymon-system / snailtrail
  SnailTrail implementation
  ☆39Updated 6 years ago
• strymon-system / ds2
  DS2 is an auto-scaling controller for distributed streaming dataflows
  ☆89Updated 2 years ago
• scalog / scalog
  reimplementing scalog from scratch
  ☆30Updated 4 years ago
• SymbioticLab / Tiresias
  Tiresias is a GPU cluster manager for distributed deep learning training.
  ☆154Updated 5 years ago
• yncxcw / big-c
  ☆18Updated 7 years ago
• stanford-mast / pocket
  Elastic ephemeral storage
  ☆119Updated 3 years ago
• efficient / microservices_microbenchmarks
  Code for the benchmarks presented in https://www.usenix.org/conference/atc18/presentation/boucher
  ☆12Updated 6 years ago
• ds2-lab / FaaSNet
  FaaSNet: Scalable and Fast Provisioning of Custom Serverless Container Runtimes at Alibaba Cloud Function Compute (USENIX ATC'21)
  ☆55Updated 3 years ago
• streaming-research / Tutorial-SIGMOD-2020
  ☆20Updated 4 years ago
• zrlio / crail-spark-io
  Fast I/O plugins for Spark
  ☆41Updated 4 years ago
• zrlio / crail
  [Archived] A Fast Multi-tiered Distributed Storage System based on User-Level I/O
  ☆73Updated 7 years ago
• alibaba / GPU-scheduler-for-deep-learning
  GPU-scheduler-for-deep-learning
  ☆207Updated 4 years ago
• msr-fiddle / philly-traces
  ☆191Updated 5 years ago
• JLockerman / FuzzyLog
  Experiments in partially ordered SMR.
  ☆48Updated 4 years ago
• openucx / sparkucx
  A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
  ☆50Updated last year
• Jeffwan / serverless-research
  Serverless Paper Reading and Discussion
  ☆37Updated 2 years ago
• uclasystem / Semeru
  A Memory-Disaggregated Managed Runtime.
  ☆66Updated 3 years ago
• All-less / trace-generator
  A CLI tool generating traces of batch jobs in a cluster.
  ☆24Updated last year
• hku-systems / apus
  An RDMA-powered, fast, and scalable Paxos protocol
  ☆25Updated 6 years ago
• NYU-NEWS / janus
  ☆51Updated last year
• CASP-Systems-BU / Gadget
  A Benchmark Harness for Systematic and Robust Evaluation of Streaming State Stores
  ☆17Updated last year
• radlab / sparrow
  Sparrow scheduling platform (U.C. Berkeley).
  ☆324Updated 4 years ago
• coflow / varys
  Varys: Efficient Clairvoyant Coflow Scheduler
  ☆34Updated 9 years ago
• stanford-futuredata / gavel
  Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020
  ☆128Updated 11 months ago
• NetSys / spark-monotasks
  Fast, predictable data analytics based on (and API-compatible with) Apache Spark
  ☆25Updated 7 years ago
• apache / incubator-crail
  Mirror of Apache crail (Incubating)
  ☆150Updated 2 years ago
• WukLab / LITE
  LITE Kernel RDMA Support for Datacenter Applications. SOSP 2017.
  ☆110Updated 4 years ago
• efficient / fasst
  Source code for our OSDI 2016 paper
  ☆110Updated 6 years ago