foundation-model-stack / fm-training-estimatorLinks
Estimate resources needed to train LLMs
β13Updated 7 months ago
Alternatives and similar repositories for fm-training-estimator
Users that are interested in fm-training-estimator are comparing it to the libraries listed below
Sorting:
- π Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.β52Updated this week
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Dataβ43Updated this week
- llm-d benchmark scripts and toolingβ30Updated this week
- Create and deploy virtual-experiments - co-processing computational workflowsβ10Updated 3 months ago
- Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.β234Updated 2 years ago
- β12Updated last week
- Python library for Synthetic Data Generationβ51Updated last week
- β49Updated 2 months ago
- Cloud Native Benchmarking of Foundation Modelsβ44Updated 2 months ago
- IBM development fork of https://github.com/huggingface/text-generation-inferenceβ61Updated last month
- β23Updated 3 years ago
- A tool to detect infrastructure issues on cloud native AI systemsβ48Updated last month
- Python library for Evaluationβ16Updated last week
- Community maintained hardware plugin for vLLM on Spyreβ35Updated last week
- Taxonomy tree that will allow you to create models tuned with your dataβ285Updated last month
- CLI for the Serverless Supercomputerβ25Updated last month
- MLPerfβ’ logging libraryβ37Updated this week
- A top-like tool for monitoring GPUs in a clusterβ85Updated last year
- Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.β107Updated 3 months ago
- Helm charts for llm-dβ50Updated 2 months ago
- InstructLab Community wide collaboration space including contributing, security, code of conduct, etcβ92Updated last week
- An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the develoβ¦β30Updated this week
- Generates a diagram of IBM Cloud VPC resourcesβ18Updated 2 years ago
- Run Slurm as a Kubernetes scheduler. A Slinky project.β44Updated last week
- Benchmark suite for LLMs from Fireworks.aiβ83Updated 2 weeks ago
- π Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.β13Updated last week
- β257Updated this week
- OpenShift Migration Controllerβ22Updated 2 weeks ago
- Intent Driven Orchestration enables management of applications through their Service Level Objectives, while minimizing developer and admβ¦β43Updated 2 months ago
- β14Updated 5 months ago