foundation-model-stack / fm-training-estimatorLinks
Estimate resources needed to train LLMs
☆13Updated 6 months ago
Alternatives and similar repositories for fm-training-estimator
Users that are interested in fm-training-estimator are comparing it to the libraries listed below
Sorting:
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆47Updated this week
- llm-d benchmark scripts and tooling☆25Updated last week
- Create and deploy virtual-experiments - co-processing computational workflows☆10Updated last month
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆42Updated this week
- Source code for Activated LoRA☆20Updated 3 weeks ago
- Optimizing loading training data from cloud bucket storage for cloud-based distributed deep learning. Official repository for Quantifying…☆12Updated 3 years ago
- ☆12Updated last week
- MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.☆157Updated 11 months ago
- Python library for Synthetic Data Generation☆45Updated this week
- Cloud Native Benchmarking of Foundation Models☆41Updated last month
- A starter kit for evaluating benchmarks on the 🤗 Hub☆14Updated last year
- ☆48Updated last month
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆11Updated 2 months ago
- Benchmark suite for LLMs from Fireworks.ai☆82Updated this week
- ☆38Updated this week
- LM engine is a library for pretraining/finetuning LLMs☆65Updated last week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆61Updated 3 months ago
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆39Updated last month
- A tool to detect infrastructure issues on cloud native AI systems☆47Updated last month
- Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.☆232Updated last year
- A tool for benchmarking LLMs on Modal☆43Updated last week
- ☆23Updated 3 years ago
- Community maintained hardware plugin for vLLM on Spyre☆32Updated this week
- Document Automation Reference Kit☆15Updated last year
- Benchmarking PyTorch 2.0 different models☆20Updated 2 years ago
- MLPerf™ logging library☆36Updated last week
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆20Updated this week
- The project delivers a comprehensive full-stack solution for the Intel® Enterprise AI Foundation on the OpenShift platform to provision I…☆20Updated last month
- This repository contains the results and code for the MLPerf™ Training v4.0 benchmark.☆12Updated last year
- ScalarLM - a unified training and inference stack☆55Updated last month