facebookresearch / Data_Acquisition_for_ML_Benchmark

Related projects: ⓘ

• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆77Updated last year
• ahennequ / pytorch-custom-mma
  ☆29Updated last year
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆28Updated 4 months ago
• gregorbachmann / scaling_mlps
  ☆48Updated 3 months ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆43Updated last year
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆35Updated 2 years ago
• tech-srl / layer_norm_expressivity_role
  Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)
  ☆43Updated last year
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆38Updated last year
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆15Updated 10 months ago
• lucidrains / slot-transformer
  ☆21Updated this week
• sebulo / LoQT
  ☆23Updated this week
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆28Updated last week
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆58Updated this week
• shoaibahmed / metadata_archaeology
  Official code for the paper: "Metadata Archaeology"
  ☆18Updated last year
• ag1988 / top_k_attention
  The accompanying code for "Memory-efficient Transformers via Top-k Attention" (Ankit Gupta, Guy Dar, Shaya Goodman, David Ciprut, Jonatha…
  ☆58Updated 3 years ago
• facebookresearch / SIMAT
  codebase for the SIMAT dataset and evaluation
  ☆38Updated 2 years ago
• naver-ai / imagenet-annotation-tool
  ☆17Updated last year
• facebookresearch / dmae_st
  Directed masked autoencoders
  ☆13Updated last year
• lucidrains / einops-exts
  Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️
  ☆52Updated last year
• rwightman / imagenet-12k
  ImageNet-12k subset of ImageNet-21k (fall11)
  ☆19Updated last year
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆47Updated 2 years ago
• microsoft / SparseMixer
  Sparse Backpropagation for Mixture-of-Expert Training
  ☆17Updated 2 months ago
• wjxts / RegularizedBN
  ☆20Updated last year
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆23Updated 11 months ago
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆87Updated last year
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆58Updated 2 years ago
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆17Updated 10 months ago
• google-deepmind / scaling_laws_for_routing
  ☆13Updated 2 years ago
• Lightning-AI / lightning-Habana
  Lightning support for Intel Habana accelerators.
  ☆25Updated 2 weeks ago
• facebookresearch / DejaVu
  Repository for the paper Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning
  ☆37Updated last year
• schwartz-lab-NLP / papa
  Code for the PAPA paper
  ☆27Updated last year