foundation-model-stack / fm-training-estimatorLinks
Estimate resources needed to train LLMs
โ13Updated 8 months ago
Alternatives and similar repositories for fm-training-estimator
Users that are interested in fm-training-estimator are comparing it to the libraries listed below
Sorting:
- ๐ Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.โ52Updated this week
- Python library for Synthetic Data Generationโ51Updated 2 weeks ago
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Dataโ44Updated last week
- โ12Updated last month
- llm-d benchmark scripts and toolingโ31Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inferenceโ61Updated last month
- Cloud Native Benchmarking of Foundation Modelsโ44Updated 3 months ago
- Create and deploy virtual-experiments - co-processing computational workflowsโ10Updated 3 months ago
- Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.โ236Updated 2 years ago
- โ19Updated last year
- โ23Updated 3 years ago
- Community maintained hardware plugin for vLLM on Spyreโ37Updated this week
- This repository contains the results and code for the MLPerfโข Training v4.0 benchmark.โ12Updated last year
- โ264Updated this week
- Example ML projects that use the Determined library.โ32Updated last year
- A tool to detect infrastructure issues on cloud native AI systemsโ49Updated last month
- A top-like tool for monitoring GPUs in a clusterโ85Updated last year
- โ49Updated 3 months ago
- ๐ฆ Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data โฆโ211Updated last week
- A starter kit for evaluating benchmarks on the ๐ค Hubโ15Updated last year
- Benchmark suite for LLMs from Fireworks.aiโ83Updated last week
- Mellea is a library for writing generative programs.โ209Updated last week
- MLCubeยฎ is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.โ157Updated last year
- Notes and artifacts from the ONNX steering committeeโ27Updated last week
- LM engine is a library for pretraining/finetuning LLMsโ74Updated last week
- ๐ Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.โ13Updated 3 weeks ago
- Machine Learning Agility (MLAgility) benchmark and benchmarking toolsโ40Updated 3 months ago
- Python library for Evaluationโ16Updated 2 weeks ago
- Helm charts for llm-dโ50Updated 3 months ago
- โ41Updated last week