AI-Hypercomputer / ml-goodput-measurementLinks
☆17Updated last week
Alternatives and similar repositories for ml-goodput-measurement
Users that are interested in ml-goodput-measurement are comparing it to the libraries listed below
Sorting:
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆125Updated this week
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆62Updated 2 months ago
- ☆34Updated last week
- Experimenting with how best to do multi-host dataloading☆10Updated 2 years ago
- This is a port of Mistral-7B model in JAX☆32Updated 11 months ago
- ☆141Updated 3 weeks ago
- Package of Pathways-on-Cloud utilities☆15Updated last week
- PathwaysJob API is an OSS Kubernetes-native API, to deploy ML training and batch inference workloads, using Pathways on GKE.☆11Updated last week
- Causal Analysis of Agent Behavior for AI Safety☆18Updated last year
- Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`☆45Updated last year
- Machine Learning eXperiment Utilities☆46Updated last year
- Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.☆73Updated last week
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆11Updated last week
- ☆14Updated last month
- JAX Implementation of Black Forest Labs' Flux.1 family of models☆34Updated 8 months ago
- Google TPU optimizations for transformers models☆113Updated 5 months ago
- T5Patches is a set of tools for fast and targeted editing of generative language models built with T5X.☆12Updated last year
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated 2 weeks ago
- An implementation of the Llama architecture, to instruct and delight☆21Updated 3 weeks ago
- ☆21Updated 3 months ago
- A simplified and automated orchestration workflow to perform ML end-to-end (E2E) model tests and benchmarking on Cloud VMs across differe…☆48Updated this week
- ☆18Updated this week
- Modular, scalable library to train ML models☆123Updated this week
- Two implementations of ZeRO-1 optimizer sharding in JAX☆14Updated 2 years ago
- A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.☆114Updated this week
- Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…☆27Updated last year
- ☆21Updated last week
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated 3 months ago
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated 5 months ago
- ☆126Updated last month