gpauloski / BERT-PyTorch

Related projects ⓘ

Alternatives and complementary repositories for BERT-PyTorch

• yuanwei2019 / EAdam-optimizer
  Some improvements on Adam
  ☆28Updated 4 years ago
• mlcommons / training_results_v0.7
  This repository contains the results and code for the MLPerf™ Training v0.7 benchmark.
  ☆56Updated last year
• CHARM-Tx / linear_mem_attention_pytorch
  Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch
  ☆12Updated 2 years ago
• NVIDIA / dllogger
  A logging tool for deep learning.
  ☆52Updated 2 years ago
• NVIDIA / HMM_sample_code
  CUDA 12.2 HMM demos
  ☆17Updated 3 months ago
• exists-forall / striped_attention
  ☆36Updated last year
• usyd-fsalab / NeuralNetworkRandomness
  ☆14Updated 2 years ago
• NVIDIA / LDDL
  Distributed preprocessing and data loading for language datasets
  ☆39Updated 7 months ago
• argonne-lcf / LLM-Inference-Bench
  LLM-Inference-Bench
  ☆11Updated last week
• HicrestLaboratory / SPARTA
  SParse AcceleRation on Tensor Architecture
  ☆17Updated last month
• DeadAt0m / adafactor-pytorch
  A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
  ☆24Updated 5 years ago
• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago
• spcl / sten
  Sparsity support for PyTorch
  ☆31Updated this week
• cybertronai / bflm
  ☆16Updated 5 years ago
• ekondis / gpuroofperf-toolkit
  A GPU performance prediction toolkit for CUDA programs
  ☆16Updated 5 years ago
• NERSC / sc21-dl-tutorial
  Material for the SC21 Deep Learning at Scale Tutorial
  ☆25Updated last year
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆21Updated last year
• eth-cscs / conflux
  Distributed Communication-Optimal LU-factorization Algorithm
  ☆12Updated 3 years ago
• reger-men / HPL_GPU
  High-Performance Linpack Benchmark adopted version for GPU backend
  ☆11Updated 2 years ago
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated this week
• RUCAIBox / MPOP
  ☆13Updated 3 years ago
• DmitryLyakh / CUDA_Tutorial
  ☆22Updated 5 years ago
• juntang-zhuang / ACProp-Optimizer
  Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)
  ☆15Updated 3 years ago
• nvidia-china-sae / WholeGraph
  ☆11Updated 3 years ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆98Updated this week
• mcarilli / mixed_precision_references
  Personal collection of references for high performance mixed precision training.
  ☆41Updated 5 years ago
• microsoft / DeepSpeed-Kernels
  ☆55Updated 6 months ago
• cgraywang / transformer-on-diet
  Code repo for "Transformer on a Diet" paper
  ☆31Updated 4 years ago
• axonn-ai / axonn
  A parallel framework for training deep neural networks
  ☆45Updated 3 weeks ago