A canonical source of GenAI energy benchmark and meausrements
☆50Nov 29, 2025Updated 3 months ago
Alternatives and similar repositories for leaderboard-v2
Users that are interested in leaderboard-v2 are comparing it to the libraries listed below
Sorting:
- Measure and optimize the energy consumption of your AI applications!☆338Mar 1, 2026Updated last week
- (ICPP '20) ShadowTutor: Distributed Partial Distillation for Mobile Video DNN Inference☆12Jun 22, 2020Updated 5 years ago
- The official Python library for Openlayer, the Continuous Model Improvement Platform for AI. 📈☆16Updated this week
- ☆26Aug 31, 2023Updated 2 years ago
- AI Energy Score: Initiative to establish comparable energy efficiency ratings for AI models.☆38Dec 2, 2025Updated 3 months ago
- Repository for opt-out requests.☆10Mar 25, 2024Updated last year
- [ACL 2025 Long Main] Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinions☆39Apr 21, 2025Updated 10 months ago
- An omnipowerful personal assistant powered by LLMs, Zapier NLA, and custom actions.☆16Sep 13, 2024Updated last year
- A Generic Resource-Aware Hyperparameter Tuning Execution Engine☆15Jan 8, 2022Updated 4 years ago
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆36Jan 9, 2023Updated 3 years ago
- A resilient distributed training framework☆97Apr 11, 2024Updated last year
- The first collection of surrogate benchmarks for Joint Architecture and Hyperparameter Search.☆15Mar 22, 2023Updated 2 years ago
- Resource Allocation for Dynamic Demands☆22Dec 26, 2023Updated 2 years ago
- ☆19Nov 5, 2024Updated last year
- ☆22May 15, 2021Updated 4 years ago
- Easy, Fast, and Scalable Multimodal AI☆113Updated this week
- ☆24Apr 18, 2019Updated 6 years ago
- Carbon Explorer helps evaluating solutions make datacenters operate on renewable energy.☆88Nov 8, 2024Updated last year
- Oort: Efficient Federated Learning via Guided Participant Selection☆134Oct 27, 2021Updated 4 years ago
- Getting Starting with NIMBUS-CORE☆10Dec 16, 2023Updated 2 years ago
- Managed collective communication service☆23Sep 2, 2024Updated last year
- ☆22Sep 4, 2023Updated 2 years ago
- 👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)☆24May 2, 2023Updated 2 years ago
- flame is a federated learning system for edge with flexibility and scalability at the core of its design.☆61Nov 6, 2025Updated 4 months ago
- ☆21Sep 9, 2024Updated last year
- IBM development fork of https://github.com/huggingface/text-generation-inference☆63Sep 18, 2025Updated 5 months ago
- A python package to design and debug RL agents.☆33Jan 15, 2026Updated last month
- 🌱 A tool for measuring the power consumption and carbon footprint of your software.☆38Mar 1, 2026Updated last week
- [Preprint] Making AI Less ''Thirsty'': Uncovering and Addressing the Secret Water Footprint of AI☆31Apr 7, 2023Updated 2 years ago
- Official repository for "Bridging Adversarial Robustness and Gradient Interpretability".☆30May 2, 2019Updated 6 years ago
- This the implementation of LeCo☆31Jan 20, 2025Updated last year
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆331Sep 25, 2025Updated 5 months ago
- A python script to walk the directory tree of a C/C++ project of embedded system to generate CMakeLists.txt files for building the execut…☆10May 6, 2022Updated 3 years ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆246Nov 3, 2024Updated last year
- Fully Local Push-to-Transcribe☆18Nov 6, 2025Updated 4 months ago
- Text & sentiment analysis of WhatsApp chat data.☆10Feb 3, 2020Updated 6 years ago
- NDIToolbox is an open source extensible signal and image processing application under development by TRI/Austin designed to assist with t…☆10Aug 19, 2018Updated 7 years ago
- Python wrapper for the energy system optimization framework IESopt.☆18Mar 2, 2026Updated last week
- DOMAINEVAL is an auto-constructed benchmark for multi-domain code generation that consists of 2k+ subjects (i.e., description, reference …☆14Dec 12, 2024Updated last year