Alternatives and similar repositories for Compute-Trends

Users that are interested in Compute-Trends are comparing it to the libraries listed below

• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆15Updated 11 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆37Updated 7 months ago
• UmerHA / triton_util
  Make triton easier
  ☆48Updated last year
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆20Updated 2 years ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 3 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆46Updated last year
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆61Updated last week
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆136Updated 5 months ago
• graphcore / tutorials
  Training material for IPU users: tutorials, feature examples, simple applications
  ☆87Updated 2 years ago
• determined-ai / determined-examples
  Example ML projects that use the Determined library.
  ☆32Updated last year
• stanford-cs324 / winter2023
  ☆38Updated 2 years ago
• tml-tuebingen / chatgpt-algorithm-exam
  ChatGPT Participates in a Computer Science Exam (2023)
  ☆31Updated 2 years ago
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆48Updated 11 months ago
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 7 months ago
• malfet / llm_experiments
  ☆12Updated 2 months ago
• mlcommons / training_policies
  Issues related to MLPerf™ training policies, including rules and suggested changes
  ☆95Updated last month
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• axonn-ai / axonn
  Parallel framework for training and fine-tuning deep neural networks
  ☆68Updated 2 weeks ago
• google-deepmind / dks
  Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…
  ☆74Updated 4 months ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆117Updated last year
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆62Updated last month
• HazyResearch / train-tk
  train with kittens!
  ☆63Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆91Updated 2 years ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆91Updated 5 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 9 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• mlcommons / logging
  MLPerf™ logging library
  ☆37Updated last month
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆114Updated 2 years ago
• gpu-mode / popcorn-cli
  ☆69Updated last week
• saurabhaloneai / Llama-3-From-Scratch-In-Pure-Jax
  This repository contain the simple llama3 implementation in pure jax.
  ☆70Updated 9 months ago