foundation-model-stack / fm-training-estimatorLinks
Estimate resources needed to train LLMs
☆14Updated last month
Alternatives and similar repositories for fm-training-estimator
Users that are interested in fm-training-estimator are comparing it to the libraries listed below
Sorting:
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆55Updated 3 weeks ago
- An extendible framework for executing benchmarks and computational experiments at scale☆36Updated this week
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆44Updated this week
- Create and deploy virtual-experiments - co-processing computational workflows☆10Updated 6 months ago
- Python library for Synthetic Data Generation☆51Updated 2 weeks ago
- llm-d benchmark scripts and tooling☆41Updated this week
- Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.☆234Updated 2 years ago
- Community maintained hardware plugin for vLLM on Spyre☆39Updated this week
- ☆51Updated 5 months ago
- Bridge operator repo☆21Updated 3 months ago
- ☆13Updated 3 months ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆62Updated 3 months ago
- ☆23Updated 3 years ago
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆13Updated 3 weeks ago
- Cloud Native Benchmarking of Foundation Models☆44Updated 5 months ago
- The project delivers a comprehensive full-stack solution for the Intel® Enterprise AI Foundation on the OpenShift platform to provision I…☆20Updated 5 months ago
- GitHub bot to assist with the taxonomy contribution workflow☆17Updated last year
- A tool to detect infrastructure issues on cloud native AI systems☆52Updated 3 months ago
- ☆19Updated last year
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆212Updated this week
- Python library for Evaluation☆16Updated last week
- MLPerf™ logging library☆38Updated 3 weeks ago
- InstructLab Community wide collaboration space including contributing, security, code of conduct, etc☆93Updated last month
- A top-like tool for monitoring GPUs in a cluster☆84Updated last year
- A Lossless Compression Library for AI pipelines☆290Updated 6 months ago
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆40Updated 5 months ago
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆169Updated this week
- Trusted Service Identity is closing the gap of preventing access to secrets by an untrusted operator during the process of obtaining auth…☆27Updated 3 months ago
- A starter kit for evaluating benchmarks on the 🤗 Hub☆15Updated 2 years ago
- Taxonomy tree that will allow you to create models tuned with your data☆289Updated 4 months ago