Alternatives and similar repositories for EC-NAS-Bench

Users that are interested in EC-NAS-Bench are comparing it to the libraries listed below

• CerebrasResearch / Sparse-IFT
  Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency
  ☆25Updated last year
• open-lm-engine / lm-engine
  LM engine is a library for pretraining/finetuning LLMs
  ☆77Updated last week
• google-research-datasets / tpu_graphs
  ☆129Updated last year
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆172Updated 8 months ago
• HazyResearch / fly
  ☆221Updated 2 years ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆69Updated last year
• hmarkc / parallel-prompt-decoding
  Efficient LLM Inference Acceleration using Prompting
  ☆51Updated last year
• chandar-lab / EfficientLLMs
  ☆18Updated last year
• Ying1123 / awesome-neural-symbolic
  A list of awesome neural symbolic papers.
  ☆50Updated 3 years ago
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆74Updated 9 months ago
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆146Updated last year
• IST-DASLab / sparseprop
  ☆15Updated 2 years ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆185Updated last month
• google-research / jaxpruner
  ☆234Updated 10 months ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆121Updated last year
• srush / do-we-need-attention
  ☆167Updated 2 years ago
• zankner / Hydra
  ☆48Updated last year
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆257Updated 2 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆218Updated 9 months ago
• spcl / sten
  Sparsity support for PyTorch
  ☆37Updated 8 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆258Updated 2 years ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• kernelmachine / balanced-kmeans
  ☆21Updated last year
• kssteven418 / BigLittleDecoder
  [NeurIPS'23] Speculative Decoding with Big Little Decoder
  ☆95Updated last year
• huggingface / nn_pruning
  Prune a model while finetuning or training.
  ☆404Updated 3 years ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆79Updated last year
• epfml / dynamic-sparse-flash-attention
  ☆150Updated 2 years ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆246Updated 2 months ago
• epfl-dlab / transformers-CFG
  🤗 A specialized library for integrating context-free grammars (CFG) in EBNF with the Hugging Face Transformers
  ☆130Updated 8 months ago
• google / aqt
  ☆340Updated last week