Alternatives and similar repositories for modyn:

Users that are interested in modyn are comparing it to the libraries listed below

• feature-store / ralf
  ☆31Updated 2 years ago
• WukLab / preble
  Stateful LLM Serving
  ☆48Updated last week
• eth-easl / cachew
  ML Input Data Processing as a Service. This repository contains the source code for Cachew (built on top of TensorFlow).
  ☆37Updated 6 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆89Updated 11 months ago
• hao-ai-lab / MuxServe
  ☆53Updated 9 months ago
• HuaizhengZhang / MIGProfiler
  Multi-Instance-GPU profiling tool
  ☆57Updated last year
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆70Updated 3 weeks ago
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆34Updated 2 years ago
• facebookresearch / dlrm_datasets
  Set of datasets for the deep learning recommendation model (DLRM).
  ☆42Updated 2 years ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆85Updated last year
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆85Updated last year
• ml-energy / leaderboard
  How much energy do GenAI models consume?
  ☆41Updated 5 months ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆112Updated last year
• tyler-griggs / melange-release
  ☆45Updated 8 months ago
• ucbrise / hypersched
  Deadline-based hyperparameter tuning on RayTune.
  ☆31Updated 5 years ago
• casys-kaist / EnvPipe
  ☆24Updated last year
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆82Updated last year
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆149Updated 5 months ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆153Updated 5 months ago
• zhuohan123 / terapipe
  ☆72Updated 3 years ago
• msr-fiddle / CheckFreq
  ☆53Updated 4 years ago
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆28Updated last year
• RulinShao / FastCkpt
  Python package for rematerialization-aware gradient checkpointing
  ☆24Updated last year
• uccl-project / uccl
  Ultra | Ultimate | Unified CCL
  ☆50Updated last month
• anyscale / llm-continuous-batching-benchmarks
  ☆116Updated last year
• DS3Lab / LambdaML
  Machine learning on serverless platform
  ☆8Updated 2 years ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆189Updated this week
• msr-fiddle / CoorDL
  ☆23Updated last year
• thu-pacman / FasterMoE
  ☆80Updated 2 years ago