Alternatives and similar repositories for G-SLIDE

Users that are interested in G-SLIDE are comparing it to the libraries listed below

• apd10 / universal_memory_allocation
  ☆15Updated 3 years ago
• HazyResearch / mongoose
  A Learnable LSH Framework for Efficient NN Training
  ☆31Updated 3 years ago
• HazyResearch / anchor-stability
  A study of the downstream instability of word embeddings
  ☆12Updated 2 years ago
• twinkle0331 / Xcompression
  [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)
  ☆22Updated 2 years ago
• ray-project / distml
  Distributed ML Optimizer
  ☆32Updated 3 years ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• chentingpc / dpq_embedding_compression
  Differentiable Product Quantization for End-to-End Embedding Compression.
  ☆62Updated 2 years ago
• cuMF / culda_cgs
  Efficient LDA solution on GPUs.
  ☆24Updated 6 years ago
• OpenHero / im2col
  image to column
  ☆30Updated 11 years ago
• daochenzha / neuroshard
  [MLSys 2023] Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models
  ☆16Updated 2 years ago
• rlin27 / DeBut
  Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.
  ☆12Updated 3 years ago
• usyd-fsalab / NeuralNetworkRandomness
  ☆14Updated 3 years ago
• petuum / tuun
  Hyperparameter tuning via uncertainty modeling
  ☆47Updated last year
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆56Updated 3 years ago
• smartnets / dataloader-benchmarks
  DL Dataloader Benchmarks
  ☆19Updated 5 months ago
• guanh01 / CS692-mlsys
  This is the (evolving) reading list for the seminar.
  ☆59Updated 4 years ago
• juntang-zhuang / ACProp-Optimizer
  Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)
  ☆15Updated 3 years ago
• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆47Updated 2 years ago
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆105Updated 2 years ago
• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated 5 months ago
• tt-embedding / tt-embeddings
  ☆27Updated 5 years ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆44Updated 9 months ago
• spcl / substation
  Research and development for optimizing transformers
  ☆129Updated 4 years ago
• LIJUNYI95 / SuperAdam
  Official Pytorch Implementation for the paper 'SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients'
  ☆17Updated 3 years ago
• MAC-AutoML / YOCO-BERT
  The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…
  ☆48Updated 4 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆53Updated 2 years ago
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆34Updated last year
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 3 years ago
• Aleph-Alpha-Research / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year