SotaroKaneda / MLCarbon
End-to-end carbon footprint mod- eling tool
☆34Updated 8 months ago
Alternatives and similar repositories for MLCarbon:
Users that are interested in MLCarbon are comparing it to the libraries listed below
- How much energy do GenAI models consume?☆41Updated 3 months ago
- Carbon Explorer helps evaluating solutions make datacenters operate on renewable energy.☆69Updated 2 months ago
- ACT An Architectural Carbon Modeling Tool for Designing Sustainable Computer Systems☆35Updated last month
- Simulator and datasets to research on carbon-aware temporal workload shifting.☆24Updated last year
- Surrogate-based Hyperparameter Tuning System☆28Updated last year
- A repository of scripts that can be used to monitor energy consumption.☆16Updated last year
- Predict the performance of LLM inference services☆14Updated 6 months ago
- a curated list of high-quality papers on resource-efficient LLMs 🌱☆93Updated 2 weeks ago
- ☆43Updated 6 months ago
- ☆24Updated last year
- Deep Learning Energy Measurement and Optimization☆230Updated this week
- Cloud Energy is an XGBoost & linear model based on the energy data from the SPECPower database for the cloud to estimate wattage consumpt…☆21Updated this week
- LLM Serving Performance Evaluation Harness☆65Updated 4 months ago
- 🔋🎯 Thread-level, NUMA-aware energy attribution model for multi-tenancy☆52Updated last year
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆34Updated 2 years ago
- Cloud Native Benchmarking of Foundation Models☆21Updated 2 months ago
- A resilient distributed training framework☆88Updated 9 months ago
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆109Updated 10 months ago
- Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)☆12Updated 7 months ago
- A system to predict hourly carbon intensity in the electrical grids using machine learning. CarbonCast provides average carbon intensity …☆36Updated 2 months ago
- Multi-Instance-GPU profiling tool☆56Updated last year
- ☆18Updated 6 months ago
- A curated list of awesome Green AI resources and tools to assess and reduce the environmental impacts of using and deploying AI.☆60Updated this week
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)☆80Updated last year
- Here are my personal paper reading notes (including cloud computing, resource management, systems, machine learning, deep learning, and o…☆62Updated this week
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆22Updated last month
- Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"☆29Updated 10 months ago
- A Python library to capture the energy consumption of code snippets☆76Updated last year
- LLM serving cluster simulator☆89Updated 8 months ago
- LLM Inference analyzer for different hardware platforms☆47Updated last month