SotaroKaneda / MLCarbonLinks
End-to-end carbon footprint mod- eling tool
☆51Updated 7 months ago
Alternatives and similar repositories for MLCarbon
Users that are interested in MLCarbon are comparing it to the libraries listed below
Sorting:
- A canonical source of GenAI energy benchmark and meausrements☆50Updated last month
- Measure and optimize the energy consumption of your AI applications!☆326Updated last month
- ACT An Architectural Carbon Modeling Tool for Designing Sustainable Computer Systems☆44Updated 5 months ago
- Carbon Explorer helps evaluating solutions make datacenters operate on renewable energy.☆86Updated last year
- LLM Serving Performance Evaluation Harness☆82Updated 10 months ago
- LM engine is a library for pretraining/finetuning LLMs☆102Updated this week
- ☆48Updated last year
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆31Updated last year
- A curated list of awesome Green AI resources and tools to assess and reduce the environmental impacts of using and deploying AI.☆99Updated 2 weeks ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆49Updated 4 months ago
- GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM☆175Updated last year
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆66Updated last year
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆30Updated last year
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆153Updated last year
- Easy, Fast, and Scalable Multimodal AI☆82Updated last week
- PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".☆93Updated 2 years ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆135Updated last year
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆357Updated this week
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆204Updated last year
- LLM-Inference-Bench☆56Updated 5 months ago
- [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation☆245Updated last year
- PyTorch library for cost-effective, fast and easy serving of MoE models.☆268Updated 2 months ago
- A resilient distributed training framework☆96Updated last year
- ☆20Updated 2 years ago
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆35Updated 4 months ago
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆134Updated last year
- Efficient LLM Inference Acceleration using Prompting☆51Updated last year
- An early research stage expert-parallel load balancer for MoE models based on linear programming.☆481Updated last month
- ☆42Updated last year
- Perplexity open source garden for inference technology☆321Updated last week