Alternatives and similar repositories for modyn

Users that are interested in modyn are comparing it to the libraries listed below

• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆78Updated 3 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆70Updated 2 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• eth-easl / cachew
  ML Input Data Processing as a Service. This repository contains the source code for Cachew (built on top of TensorFlow).
  ☆38Updated 8 months ago
• HuaizhengZhang / MIGProfiler
  Multi-Instance-GPU profiling tool
  ☆58Updated 2 years ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆88Updated last year
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆86Updated 2 years ago
• hao-ai-lab / MuxServe
  ☆62Updated 11 months ago
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆34Updated 2 years ago
• facebookresearch / dlrm_datasets
  Set of datasets for the deep learning recommendation model (DLRM).
  ☆47Updated 2 years ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆158Updated 8 months ago
• ucbrise / hypersched
  Deadline-based hyperparameter tuning on RayTune.
  ☆31Updated 5 years ago
• YuhanLiu11 / AutoFreeze
  ☆22Updated 4 years ago
• llm-db / FineInfer
  Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)
  ☆16Updated last year
• casys-kaist / EnvPipe
  ☆25Updated last year
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆121Updated last year
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆81Updated last year
• stanford-mast / cedar
  ☆12Updated 7 months ago
• feature-store / ralf
  ☆30Updated 2 years ago
• msr-fiddle / DS-Analyzer
  ☆36Updated 4 years ago
• msr-fiddle / CoorDL
  ☆24Updated last year
• ml-energy / leaderboard
  How much energy do GenAI models consume?
  ☆42Updated 3 weeks ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆174Updated 7 months ago
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆24Updated 6 months ago
• NetX-lab / Ayo
  [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo
  ☆24Updated 3 weeks ago
• kungfu-team / tenplex
  Dynamic resources changes for multi-dimensional parallelism training
  ☆25Updated 6 months ago
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆28Updated last year
• vqpy / vqpy
  VQPy: An object-oriented approach to modern video analytics
  ☆41Updated 7 months ago
• uclasystem / bamboo
  Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.
  ☆50Updated 2 years ago
• thu-pacman / FasterMoE
  ☆84Updated 3 years ago