facebookresearch / NasRec

Related projects ⓘ

Alternatives and complementary repositories for NasRec

• snu-mllab / LayerMerge
  Official PyTorch implementation of "LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging" (ICML'24)
  ☆27Updated 2 months ago
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆47Updated this week
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆23Updated last year
• NVlabs / COAT
  ☆24Updated this week
• tridao / flash-attention-wheels
  ☆41Updated 11 months ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆73Updated 3 weeks ago
• facebookresearch / dmae_st
  Directed masked autoencoders
  ☆14Updated last year
• TencentARC / BEBR
  Official code for "Binary embedding based retrieval at Tencent"
  ☆42Updated 8 months ago
• facebookresearch / multi_view_active_learning
  Code for paper Rethinking the Data Annotation Process for Multi-view 3D Pose Estimation with Active Learning and Self-Training
  ☆23Updated last year
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆20Updated 4 months ago
• kakaobrain / coyo-vit
  ViT trained on COYO-Labeled-300M dataset
  ☆29Updated last year
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 9 months ago
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆29Updated 2 months ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆25Updated 4 months ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆56Updated last month
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆45Updated 4 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆59Updated 7 months ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆32Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated last month
• jack-willturner / gymnastics
  A "gym" style toolkit for building lightweight NAS systems.
  ☆13Updated 2 years ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆42Updated last year
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆43Updated last year
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆34Updated 8 months ago
• IntelLabs / DyNAS-T
  Dynamic Neural Architecture Search Toolkit
  ☆29Updated 5 months ago
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆18Updated 11 months ago
• sail-sg / TEC
  ☆15Updated last year
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated 11 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated last month