foundation-model-stack / fm-training-estimator
Estimate resources needed to train LLMs
☆13Updated 2 months ago
Alternatives and similar repositories for fm-training-estimator:
Users that are interested in fm-training-estimator are comparing it to the libraries listed below
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆41Updated this week
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆37Updated this week
- ☆12Updated last week
- Python library for Synthetic Data Generation☆41Updated last week
- ☆40Updated last month
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆9Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆60Updated 4 months ago
- Cloud Native Benchmarking of Foundation Models☆32Updated 6 months ago
- Python library for Evaluation☆14Updated last week
- GitHub bot to assist with the taxonomy contribution workflow☆16Updated 6 months ago
- Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.☆105Updated 7 months ago
- Tackle Data-intensive Validity Analyzer☆39Updated last year
- Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.☆232Updated last year
- Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others☆39Updated 6 months ago
- This repository contains resources, documentation and artifacts describing LLM agents☆14Updated 3 months ago
- Create and deploy virtual-experiments - co-processing computational workflows☆10Updated last month
- InstaSlice Operator facilitates slicing of accelerators using stable APIs☆35Updated this week
- KubeStellar - a flexible solution for multi-cluster configuration management for edge, multi-cloud, and hybrid cloud☆378Updated this week
- An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the develo…☆27Updated 2 weeks ago
- Artifacts for the Distributed Workloads stack as part of ODH☆30Updated last week
- ☆19Updated last week
- Tutorials and demos related to move2kube☆12Updated 2 months ago
- Optimized primitives for collective multi-GPU communication☆9Updated 11 months ago
- Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat custo…☆27Updated last year
- Python bindings for TrustyAI's explainability library☆16Updated last week
- Dolomite Engine is a library for pretraining/finetuning LLMs☆52Updated this week
- Oper8 is a framework for writing kubernetes operators in python. It implements many common patterns used by large cloud applications that…☆17Updated last week
- Move2Kube is a command-line tool for automating creation of Infrastructure as code (IaC) artifacts. It has inbuilt support for creating I…☆393Updated 2 months ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- Model Server for Kepler☆27Updated this week