foundation-model-stack / fm-training-estimatorLinks
Estimate resources needed to train LLMs
β14Updated last month
Alternatives and similar repositories for fm-training-estimator
Users that are interested in fm-training-estimator are comparing it to the libraries listed below
Sorting:
- π Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.β56Updated last week
- An extendible framework for executing benchmarks and computational experiments at scaleβ37Updated this week
- β13Updated 4 months ago
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Dataβ49Updated this week
- Python library for Synthetic Data Generationβ52Updated last month
- Community maintained hardware plugin for vLLM on Spyreβ40Updated this week
- β51Updated 6 months ago
- Create and deploy virtual-experiments - co-processing computational workflowsβ10Updated last week
- IBM development fork of https://github.com/huggingface/text-generation-inferenceβ63Updated 4 months ago
- Cloud Native Benchmarking of Foundation Modelsβ45Updated 6 months ago
- llm-d benchmark scripts and toolingβ44Updated this week
- A tool to detect infrastructure issues on cloud native AI systemsβ52Updated 4 months ago
- Bridge operator repoβ21Updated 4 months ago
- Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.β234Updated 2 years ago
- Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)β32Updated last week
- β24Updated 3 years ago
- β19Updated last year
- Prometheus collector and exporter for Slurm cluster metrics. A Slinky project.β15Updated 3 months ago
- Python library for Evaluationβ16Updated last week
- β44Updated last week
- β280Updated this week
- Benchmark suite for LLMs from Fireworks.aiβ89Updated this week
- A top-like tool for monitoring GPUs in a clusterβ84Updated last year
- A Lossless Compression Library for AI pipelinesβ302Updated 7 months ago
- Taxonomy tree that will allow you to create models tuned with your dataβ291Updated 5 months ago
- Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.β113Updated 3 months ago
- π Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.β13Updated last week
- An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the develoβ¦β34Updated last week
- InstructLab Community wide collaboration space including contributing, security, code of conduct, etcβ94Updated last week
- MLPerfβ’ logging libraryβ38Updated last month