Alternatives and similar repositories for EC-NAS-Bench

Users that are interested in EC-NAS-Bench are comparing it to the libraries listed below

• CerebrasResearch / Sparse-IFT
  Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency
  ☆25Updated last year
• google-research-datasets / tpu_graphs
  ☆125Updated last year
• google-research / jaxpruner
  ☆234Updated 7 months ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆107Updated 4 months ago
• Ying1123 / awesome-neural-symbolic
  A list of awesome neural symbolic papers.
  ☆48Updated 3 years ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• carloalbertobarbano / forward-forward-pytorch
  PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling
  ☆15Updated 2 years ago
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆70Updated 7 months ago
• nebuly-ai / exploring-AI-optimization
  Curated list of awesome material on optimization techniques to make artificial intelligence faster and more efficient 🚀
  ☆119Updated 2 years ago
• HazyResearch / fly
  ☆217Updated 2 years ago
• chandar-lab / EfficientLLMs
  ☆17Updated last year
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆157Updated 6 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆177Updated 6 months ago
• spcl / sten
  Sparsity support for PyTorch
  ☆37Updated 6 months ago
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆89Updated 2 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆68Updated 10 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆231Updated 2 weeks ago
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆399Updated last week
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆108Updated last year
• insuhan / hyper-attn
  ☆83Updated last year
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆78Updated last year
• VectorInstitute / flex_model
  ☆13Updated last year
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆48Updated 9 months ago
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆146Updated last year
• epfml / dynamic-sparse-flash-attention
  ☆148Updated 2 years ago
• ml-energy / leaderboard
  How much energy do GenAI models consume?
  ☆47Updated 4 months ago
• microsoft / encoder-decoder-slm
  Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…
  ☆30Updated 8 months ago
• kssteven418 / BigLittleDecoder
  [NeurIPS'23] Speculative Decoding with Big Little Decoder
  ☆94Updated last year
• epfl-dlab / transformers-CFG
  🤗 A specialized library for integrating context-free grammars (CFG) in EBNF with the Hugging Face Transformers
  ☆124Updated 6 months ago
• HanGuo97 / lq-lora
  ☆127Updated last year