aws-samples / aws-parallelcluster-megatron

Related projects ⓘ

Alternatives and complementary repositories for aws-parallelcluster-megatron

• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆76Updated 2 years ago
• modal-labs / ci-on-modal
  A sample pattern for running CI tests on Modal
  ☆13Updated 2 months ago
• pytorch-tpu / examples
  This repository contains example code to build models on TPUs
  ☆30Updated last year
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆44Updated 2 weeks ago
• cat-state / tinypar
  ☆20Updated last year
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆33Updated 2 years ago
• iwiwi / epochraft
  Checkpointable dataset utilities for foundation model training
  ☆32Updated 9 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆28Updated last month
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆42Updated 5 months ago
• sholtodouglas / scalingExperiments
  ☆57Updated 2 years ago
• sdpython / onnxcustom
  Tutorial on how to convert machine learned models into ONNX
  ☆15Updated last year
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆58Updated 4 months ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆45Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 9 months ago
• AakashKumarNain / mistral_jax
  This is a port of Mistral-7B model in JAX
  ☆30Updated 4 months ago
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆16Updated last year
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆29Updated 2 weeks ago
• kevinwu23 / StanfordFineTuneBench
  ☆21Updated last week
• AGI-Arena / MARS
  The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models
  ☆65Updated this week
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆32Updated last year
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆31Updated 5 months ago
• huggingface / bloom-jax-inference
  ☆64Updated 2 years ago
• criteo / fromconfig
  A library to instantiate any Python object from configuration files.
  ☆24Updated 2 years ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆56Updated last month
• sgugger / torchdynamo-tests
  ☆20Updated last year
• shashankprasanna / pytorch-examples
  A repository of PyTorch example
  ☆10Updated last year
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆113Updated 6 months ago
• NVIDIA / NeMo-Run
  A tool to configure, launch and manage your machine learning experiments.
  ☆64Updated this week
• weaviate / arXiv-demo-dataset
  This repository will contain a demo using Weaviate with data and metadata from the arXiv dataset.
  ☆11Updated 2 years ago