facebookresearch / NasRec

Related projects ⓘ

Alternatives and complementary repositories for NasRec

• snu-mllab / LayerMerge
  Official PyTorch implementation of "LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging" (ICML'24)
  ☆27Updated 3 months ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆20Updated 5 months ago
• crypdick / timm-lr-scheduler-explorer
  A dashboard for exploring timm learning rate schedulers
  ☆18Updated last year
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆60Updated 8 months ago
• GreenBitAI / bitorch-engine
  A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.
  ☆28Updated 4 months ago
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆23Updated last year
• facebookresearch / coocmap
  code for paper "Accessing higher dimensions for unsupervised word translation"
  ☆21Updated last year
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆43Updated last year
• NVlabs / COAT
  ☆32Updated this week
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 10 months ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆75Updated this week
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆20Updated last week
• INT-FlashAttention2024 / INT-FlashAttention
  ☆47Updated 2 months ago
• facebookresearch / RLCompOpt
  Learning Compiler Pass Orders using Coreset and Normalized Value Prediction. (ICML 2023)
  ☆18Updated last year
• ai-compiler-study / triton-kernels
  Triton kernels for Flux
  ☆17Updated last week
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last month
• facebookresearch / dmae_st
  Directed masked autoencoders
  ☆14Updated last year
• TencentARC / BEBR
  Official code for "Binary embedding based retrieval at Tencent"
  ☆42Updated 8 months ago
• tding1 / Efficient-LLM-Survey
  The Efficiency Spectrum of LLM
  ☆52Updated 11 months ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆43Updated last year
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆57Updated last year
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆46Updated 4 months ago
• lernapparat / torchhacks
  Hacks for PyTorch
  ☆17Updated last year
• BBuf / flash-rwkv
  ☆29Updated 5 months ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 11 months ago
• tencent-ailab / TriNet
  TriNet: stabilizing self-supervised learning from complete or slow collapse on ASR.
  ☆26Updated last year