Alternatives and similar repositories for LLC

Users that are interested in LLC are comparing it to the libraries listed below

• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated 4 months ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆33Updated 2 years ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 3 years ago
• LAION-AI / laion50BU
  Un-*** 50 billions multimodality dataset
  ☆22Updated 3 years ago
• VITA-Group / Lifelong-Learning-LTH
  [ICLR 2021] "Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning" by Tianlong Chen*, Zhenyu Zhang*, Sijia Liu, S…
  ☆25Updated 3 years ago
• facebookresearch / SIMAT
  codebase for the SIMAT dataset and evaluation
  ☆38Updated 3 years ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated 2 years ago
• mlfoundations / dataset2metadata
  ☆26Updated last year
• VITA-Group / instant_soup
  [ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Ti…
  ☆11Updated last year
• juntang-zhuang / ACProp-Optimizer
  Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)
  ☆16Updated 4 years ago
• minyoungg / overparam
  ☆41Updated 2 years ago
• shwinshaker / LipGrow
  An adaptive training algorithm for residual network
  ☆17Updated 5 years ago
• lucidrains / remixer-pytorch
  Implementation of the Remixer Block from the Remixer paper, in Pytorch
  ☆36Updated 4 years ago
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆19Updated 5 years ago
• duterscmy / CD-MoE
  Official PyTorch implementation of CD-MOE
  ☆12Updated 6 months ago
• xtinkt / editable
  A supplementary code for Editable Neural Networks, an ICLR 2020 submission.
  ☆46Updated 5 years ago
• yuweihao / LV-BERT
  LV-BERT: Exploiting Layer Variety for BERT (Findings of ACL 2021)
  ☆18Updated 2 years ago
• microsoft / GEM
  ☆24Updated 4 years ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆59Updated 3 years ago
• yonatanbitton / data_efficient_masked_language_modeling_for_vision_and_language
  Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".
  ☆18Updated 4 years ago
• facebookresearch / dmae_st
  Directed masked autoencoders
  ☆14Updated 2 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆50Updated 3 years ago
• ag1988 / top_k_attention
  The accompanying code for "Memory-efficient Transformers via Top-k Attention" (Ankit Gupta, Guy Dar, Shaya Goodman, David Ciprut, Jonatha…
  ☆69Updated 4 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆65Updated 4 years ago
• rwightman / imagenet-12k
  ImageNet-12k subset of ImageNet-21k (fall11)
  ☆21Updated 2 years ago
• VITA-Group / AsViT
  [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…
  ☆76Updated 3 years ago
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆74Updated 4 years ago
• VITA-Group / CV_LTH_Pre-training
  [CVPR 2021] "The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models" Tianlong Chen, Jon…
  ☆68Updated 2 years ago
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated 2 years ago
• LAION-AI / Conditional-Pretraining-of-Large-Language-Models
  ☆37Updated 2 years ago