Alternatives and similar repositories for viva-vldb23-artifact

Users that are interested in viva-vldb23-artifact are comparing it to the libraries listed below

• tyler-griggs / melange-release
  ☆47Updated last year
• eth-easl / cachew
  ML Input Data Processing as a Service. This repository contains the source code for Cachew (built on top of TensorFlow).
  ☆39Updated last year
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆129Updated last year
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 7 months ago
• CGCL-codes / streambox
  ☆14Updated last year
• Ying1123 / llm-caching-multiplexing
  ☆20Updated 2 years ago
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 10 months ago
• ds2-lab / SFS
  SFS: A Smart OS Scheduler for Serverless Function Workloads (SC'22)
  ☆13Updated 2 years ago
• DataStates / datastates-llm
  LLM checkpointing for DeepSpeed/Megatron
  ☆21Updated this week
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆79Updated 9 months ago
• suquark / hoplite
  ☆44Updated 4 years ago
• spcl / rFaaS
  rFaaS: a high-performance FaaS platform with RDMA acceleration for low-latency invocations.
  ☆55Updated 3 months ago
• eth-easl / deltazip
  Compression for Foundation Models
  ☆35Updated 2 months ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated last year
• casys-kaist / EnvPipe
  ☆25Updated 2 years ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• All-less / faas-scheduling-benchmark
  A benchmark suite for evaluating FaaS scheduler.
  ☆23Updated 2 years ago
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆153Updated this week
• danyangz / lightning
  Lightning In-Memory Object Store
  ☆47Updated 3 years ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆92Updated last year
• ucbrise / hypersched
  Deadline-based hyperparameter tuning on RayTune.
  ☆31Updated 5 years ago
• WukLab / preble
  Stateful LLM Serving
  ☆86Updated 7 months ago
• ml-energy / leaderboard
  How much energy do GenAI models consume?
  ☆47Updated this week
• TankLabTJU / INFless
  The source code of INFless，a native serverless platform for AI inference.
  ☆41Updated 3 years ago
• msr-fiddle / DS-Analyzer
  ☆38Updated 4 years ago
• eth-easl / dirigent
  Dirigent: Lightweight Serverless Orchestration
  ☆39Updated last month
• hao-ai-lab / MuxServe
  ☆72Updated last year
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated 10 months ago
• jasperzhong / swift
  ☆15Updated 3 years ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 3 weeks ago