Alternatives and similar repositories for modyn

Users that are interested in modyn are comparing it to the libraries listed below

• vqpy / vqpy
  VQPy: An object-oriented approach to modern video analytics
  ☆41Updated last year
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆82Updated 9 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆89Updated 9 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆96Updated last year
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆200Updated last year
• eth-easl / cachew
  ML Input Data Processing as a Service. This repository contains the source code for Cachew (built on top of TensorFlow).
  ☆40Updated last year
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆92Updated 2 years ago
• feature-store / ralf
  ☆31Updated 3 years ago
• tyler-griggs / melange-release
  ☆48Updated last year
• HuaizhengZhang / MIGProfiler
  Multi-Instance-GPU profiling tool
  ☆58Updated 2 years ago
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆161Updated 2 months ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆133Updated last year
• abcdabcd987 / libfabric-efa-demo
  ☆73Updated 11 months ago
• hao-ai-lab / MuxServe
  ☆79Updated last month
• kvcache-ai / TrEnv-X
  ☆69Updated 2 months ago
• alibaba / ServeGen
  A framework for generating realistic LLM serving workloads
  ☆88Updated 2 months ago
• MaoZiming / papers
  Paper-reading notes for Berkeley OS prelim exam.
  ☆14Updated last year
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆62Updated last year
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated last year
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆27Updated 2 years ago
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆256Updated this week
• ml-energy / zeus
  Measure and optimize the energy consumption of your AI applications!
  ☆318Updated 2 weeks ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated last year
• linkedin / fmchisel
  fmchisel: Efficient Compression and Training Algorithms for Foundation Models
  ☆76Updated last month
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆66Updated last year
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆94Updated 2 years ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆443Updated 3 weeks ago
• ucbrise / hypersched
  Deadline-based hyperparameter tuning on RayTune.
  ☆31Updated 5 years ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆43Updated 3 years ago
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆246Updated last year