Alternatives and similar repositories for viva-vldb23-artifact

Users that are interested in viva-vldb23-artifact are comparing it to the libraries listed below

• tyler-griggs / melange-release
  ☆48Updated last year
• eth-easl / cachew
  ML Input Data Processing as a Service. This repository contains the source code for Cachew (built on top of TensorFlow).
  ☆40Updated last year
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• CGCL-codes / streambox
  ☆16Updated last year
• Ying1123 / llm-caching-multiplexing
  ☆20Updated 2 years ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆82Updated 10 months ago
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated last year
• eth-easl / deltazip
  Compression for Foundation Models
  ☆34Updated 5 months ago
• suquark / hoplite
  ☆44Updated 4 years ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆133Updated last year
• ucbrise / hypersched
  Deadline-based hyperparameter tuning on RayTune.
  ☆31Updated 5 years ago
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆79Updated 11 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆90Updated 9 months ago
• All-less / faas-scheduling-benchmark
  A benchmark suite for evaluating FaaS scheduler.
  ☆23Updated 3 years ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆92Updated 2 years ago
• casys-kaist / EnvPipe
  ☆25Updated 2 years ago
• TankLabTJU / INFless
  The source code of INFless，a native serverless platform for AI inference.
  ☆44Updated 3 years ago
• MincYu / pheromone
  ☆45Updated 3 years ago
• DataStates / datastates-llm
  LLM checkpointing for DeepSpeed/Megatron
  ☆22Updated 3 weeks ago
• favyen / miris
  MIRIS: Fast Object Track Queries in Video
  ☆17Updated 2 years ago
• microsoft / SuperScaler
  An experimental parallel training platform
  ☆56Updated last year
• SJTU-IPADS / Bamboo
  Bamboo-7B Large Language Model
  ☆93Updated last year
• jasperzhong / swift
  ☆15Updated 3 years ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆203Updated last year
• msr-fiddle / DS-Analyzer
  ☆38Updated 4 years ago
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆27Updated 2 years ago
• Berkeley-Large-RAG / RAG-DS-Serve
  DS SERVE: The Largest Open Vector Store over Pretain Data; A Framework for Efficient and Scalable Neural Retrieval
  ☆29Updated last week
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆96Updated last year
• liu445126256 / FuncPipe
  ☆11Updated 2 years ago
• perplexityai / pplx-garden
  Perplexity open source garden for inference technology
  ☆306Updated 2 weeks ago