Alternatives and similar repositories for MLCarbon

Users that are interested in MLCarbon are comparing it to the libraries listed below

• ml-energy / leaderboard
  How much energy do GenAI models consume?
  ☆46Updated 2 months ago
• ml-energy / zeus
  Measure and optimize the energy consumption of your AI applications!
  ☆276Updated last week
• facebookresearch / ACT
  ACT An Architectural Carbon Modeling Tool for Designing Sustainable Computer Systems
  ☆40Updated 2 weeks ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 5 months ago
• tyler-griggs / melange-release
  ☆47Updated last year
• facebookresearch / CarbonExplorer
  Carbon Explorer helps evaluating solutions make datacenters operate on renewable energy.
  ☆81Updated 9 months ago
• samuelrince / awesome-green-ai
  A curated list of awesome Green AI resources and tools to assess and reduce the environmental impacts of using and deploying AI.
  ☆82Updated 4 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆94Updated last year
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆126Updated last year
• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆30Updated 8 months ago
• timlee0212 / SiDA-MoE
  Code for MLSys 2024 Paper "SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models"
  ☆20Updated last year
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 8 months ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆90Updated 2 years ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆172Updated 10 months ago
• hao-ai-lab / MuxServe
  ☆67Updated last year
• UChi-JCL / CacheGen
  ☆116Updated 10 months ago
• NetX-lab / Ayo
  [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo
  ☆30Updated 3 weeks ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆51Updated 9 months ago
• casys-kaist / EnvPipe
  ☆25Updated last year
• WukLab / preble
  Stateful LLM Serving
  ☆79Updated 4 months ago
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆28Updated 2 years ago
• tonyzhao-jt / LLM-PQ
  Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"
  ☆34Updated last month
• Ying1123 / llm-caching-multiplexing
  ☆20Updated 2 years ago
• Infini-AI-Lab / MagicPIG
  [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation
  ☆229Updated 7 months ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆123Updated 8 months ago
• amazon-science / piperag
  PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)
  ☆22Updated last year
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆98Updated 8 months ago
• InternLM / AcmeTrace
  ☆155Updated last year
• YJHMITWEB / ExFlow
  Explore Inter-layer Expert Affinity in MoE Model Inference
  ☆12Updated last year
• ServerlessLLM / ServerlessLLM
  Serverless LLM Serving for Everyone.
  ☆515Updated last week