Alternatives and similar repositories for EC-NAS-Bench

Users that are interested in EC-NAS-Bench are comparing it to the libraries listed below

• google-research-datasets / tpu_graphs
  ☆129Updated last year
• google-research / jaxpruner
  ☆234Updated last year
• CerebrasResearch / Sparse-IFT
  Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency
  ☆25Updated last year
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆178Updated 2 weeks ago
• HazyResearch / fly
  ☆222Updated 2 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆115Updated last year
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆188Updated 2 months ago
• google / aqt
  ☆344Updated this week
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆252Updated last month
• srush / do-we-need-attention
  ☆167Updated 2 years ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆121Updated last year
• open-lm-engine / lm-engine
  LM engine is a library for pretraining/finetuning LLMs
  ☆113Updated last week
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆148Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆260Updated 2 years ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• epfml / dynamic-sparse-flash-attention
  ☆150Updated 2 years ago
• pilancilab / caldera
  Compressing Large Language Models using Low Precision and Low Rank Decomposition
  ☆106Updated 2 months ago
• nebuly-ai / exploring-AI-optimization
  Curated list of awesome material on optimization techniques to make artificial intelligence faster and more efficient 🚀
  ☆119Updated 2 years ago
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆114Updated 2 years ago
• HazyResearch / flash-fft-conv
  FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
  ☆341Updated last year
• insuhan / hyper-attn
  ☆83Updated 2 years ago
• dkopi / Bitune
  Implementation of Bitune: Bidirectional Instruction-Tuning
  ☆23Updated 7 months ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆113Updated 3 months ago
• ml-energy / leaderboard-v2
  A canonical source of GenAI energy benchmark and meausrements
  ☆50Updated 2 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆69Updated last year
• spcl / sten
  Sparsity support for PyTorch
  ☆38Updated 10 months ago
• meta-pytorch / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆226Updated last year
• OFSkean / information_flow
  ☆38Updated 6 months ago
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆75Updated 11 months ago
• wiegerw / nerva
  C++ and Python libraries for neural networks.
  ☆18Updated 2 months ago