tensorflow / mesh

Related projects ⓘ

Alternatives and complementary repositories for mesh

• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,187Updated 2 months ago
• pytorch / xla
  Enabling PyTorch on XLA Devices (e.g. Google TPU)
  ☆2,482Updated this week
• pytorch / elastic
  PyTorch elastic training
  ☆730Updated 2 years ago
• openai / sparse_attention
  Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
  ☆1,524Updated 4 years ago
• tensorflow / lingvo
  Lingvo
  ☆2,816Updated this week
• openai / blocksparse
  Efficient GPU kernels for block-sparse matrix multiplication and convolution
  ☆1,025Updated last year
• cybertronai / gradient-checkpointing
  Make huge neural nets fit in memory
  ☆2,726Updated 4 years ago
• google-deepmind / dm-haiku
  JAX-based neural network library
  ☆2,894Updated last week
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆545Updated 3 years ago
• microsoft / fastformers
  FastFormers - highly efficient transformer models for NLU
  ☆701Updated 9 months ago
• keroro824 / HashingDeepLearning
  Codebase for "SLIDE : In Defense of Smart Algorithms over Hardware Acceleration for Large-Scale Deep Learning Systems"
  ☆1,076Updated 3 years ago
• kakaobrain / torchgpipe
  A GPipe implementation in PyTorch
  ☆814Updated 3 months ago
• nyu-mll / jiant
  jiant is an nlp toolkit
  ☆1,644Updated last year
• facebookresearch / XLM
  PyTorch original implementation of Cross-lingual Language Model Pretraining.
  ☆2,889Updated last year
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆727Updated 10 months ago
• tensorflow / addons
  Useful extra functionality for TensorFlow 2.x maintained by SIG-addons
  ☆1,692Updated 2 months ago
• google / seqio
  Task-based datasets, preprocessing, and evaluation for sequence models.
  ☆558Updated this week
• ELS-RD / kernl
  Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackab…
  ☆1,532Updated 8 months ago
• Tencent / TurboTransformers
  a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
  ☆1,483Updated last year
• harvardnlp / pytorch-struct
  Fast, general, and tested differentiable structured prediction in PyTorch
  ☆1,108Updated 2 years ago
• lucidrains / reformer-pytorch
  Reformer, the efficient Transformer, in Pytorch
  ☆2,116Updated last year
• alexa / bort
  Repository for the paper "Optimal Subarchitecture Extraction for BERT"
  ☆470Updated 2 years ago
• pytorch / torchdynamo
  A Python-level JIT compiler designed to make unmodified PyTorch programs faster.
  ☆1,010Updated 6 months ago
• pytorch / benchmark
  TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
  ☆874Updated this week
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆683Updated 4 years ago
• google-research / electra
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆2,336Updated 7 months ago
• idiap / fast-transformers
  Pytorch library for fast transformer implementations
  ☆1,642Updated last year
• mlcommons / training
  Reference implementations of MLPerf™ training benchmarks
  ☆1,614Updated 3 weeks ago
• pytorch / functorch
  functorch is JAX-like composable function transforms for PyTorch.
  ☆1,394Updated this week
• pytorch / FBGEMM
  FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
  ☆1,202Updated this week