CyanStarNight / CloudNativeSim

Related projects ⓘ

Alternatives and complementary repositories for CloudNativeSim

• IntelligentDDS / NN-eBPF
  Real-Time Intrusion Detection and Prevention with Neural Network in Kernel using eBPF
  ☆12Updated 7 months ago
• UChi-JCL / CacheGen
  ☆63Updated last month
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆20Updated last week
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆99Updated 8 months ago
• tyler-griggs / melange-release
  ☆36Updated 4 months ago
• micchie / paste
  Latest PASTE (NSDI'18) repository
  ☆13Updated 2 years ago
• EricssonResearch / cloud-native-app-simulator
  HydraGen: A Microservice Benchmark Generator
  ☆17Updated last year
• xinjin / course-net-seminar
  Selected Topics in Computer Networks @ Johns Hopkins University
  ☆19Updated 3 years ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆55Updated 2 months ago
• Sachin-A / TraceWeaver
  TraceWeaver is a research prototype for transparently tracing requests through a microservice without application instrumentation.
  ☆18Updated 2 months ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆96Updated this week
• LoongServe / LoongServe
  ☆43Updated last month
• intel / cpu-control-plane-plugin-for-kubernetes
  ☆19Updated 10 months ago
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆123Updated this week
• IBM / LLM-performance-prediction
  Predict the performance of LLM inference services
  ☆11Updated 4 months ago
• YaoJiayi / CacheBlend
  ☆51Updated last month
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆16Updated 2 weeks ago
• eniac / tpprof
  ☆9Updated 3 years ago
• Be-FaaS / BeFaaS-framework
  Main repository of the BeFaaS project
  ☆14Updated last year
• WukLab / preble
  Stateful LLM Serving
  ☆37Updated 3 months ago
• TankLabTJU / INFless
  The source code of INFless，a native serverless platform for AI inference.
  ☆34Updated 2 years ago
• Infini-AI-Lab / MagicPIG
  MagicPIG: LSH Sampling for Efficient LLM Generation
  ☆45Updated 2 weeks ago
• SophiaLi06 / BytePS_THC
  THC: Accelerating Distributed Deep Learning Using Tensor Homomorphic Compression
  ☆14Updated 3 months ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆126Updated 3 weeks ago
• hao-ai-lab / MuxServe
  ☆42Updated 5 months ago
• HYIUYOU / UELLM
  ☆14Updated 3 months ago
• microsoft / autothrottle
  Codebase for Autothrottle (NSDI 2024)
  ☆31Updated 10 months ago
• intel / intent-driven-orchestration
  Intent Driven Orchestration enables management of applications through their Service Level Objectives, while minimizing developer and adm…
  ☆34Updated 2 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆98Updated 4 months ago