Alternatives and similar repositories for MLCarbon

Users that are interested in MLCarbon are comparing it to the libraries listed below

• ml-energy / leaderboard
  How much energy do GenAI models consume?
  ☆47Updated 4 months ago
• ml-energy / zeus
  Measure and optimize the energy consumption of your AI applications!
  ☆291Updated last month
• facebookresearch / ACT
  ACT An Architectural Carbon Modeling Tool for Designing Sustainable Computer Systems
  ☆42Updated last month
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 6 months ago
• tyler-griggs / melange-release
  ☆47Updated last year
• facebookresearch / CarbonExplorer
  Carbon Explorer helps evaluating solutions make datacenters operate on renewable energy.
  ☆82Updated 10 months ago
• Infini-AI-Lab / APE
  ☆33Updated 7 months ago
• samuelrince / awesome-green-ai
  A curated list of awesome Green AI resources and tools to assess and reduce the environmental impacts of using and deploying AI.
  ☆86Updated 2 weeks ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆140Updated last year
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆126Updated 9 months ago
• pan-x-c / EE-LLM
  EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).
  ☆67Updated last year
• thu-pacman / FasterMoE
  ☆86Updated 3 years ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆90Updated 2 years ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆189Updated 3 months ago
• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆30Updated 10 months ago
• snowflakedb / ArcticInference
  ArcticInference: vLLM plugin for high-throughput, low-latency inference
  ☆239Updated this week
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆176Updated last year
• Infini-AI-Lab / MagicPIG
  [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation
  ☆235Updated 9 months ago
• Ying1123 / llm-caching-multiplexing
  ☆20Updated 2 years ago
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆100Updated 10 months ago
• amazon-science / piperag
  PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)
  ☆24Updated last year
• 66RING / CritiPrefill
  Code repo for "CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs".
  ☆16Updated last year
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• hao-ai-lab / MuxServe
  ☆71Updated last year
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".
  ☆75Updated 6 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆84Updated 6 months ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆42Updated 4 months ago
• timlee0212 / SiDA-MoE
  Code for MLSys 2024 Paper "SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models"
  ☆21Updated last year
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆181Updated 11 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆116Updated last year