Alternatives and similar repositories for EC-NAS-Bench

Users that are interested in EC-NAS-Bench are comparing it to the libraries listed below

• IST-DASLab / sparseprop
  ☆14Updated last year
• CerebrasResearch / Sparse-IFT
  Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency
  ☆25Updated 10 months ago
• Ying1123 / awesome-neural-symbolic
  A list of awesome neural symbolic papers.
  ☆47Updated 2 years ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆70Updated last year
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆75Updated last year
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆173Updated 2 months ago
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆62Updated 4 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆197Updated 3 months ago
• microsoft / encoder-decoder-slm
  Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…
  ☆27Updated 4 months ago
• google-research / jaxpruner
  ☆228Updated 3 months ago
• google-research-datasets / tpu_graphs
  ☆125Updated 11 months ago
• wiegerw / nerva
  C++ and Python libraries for neural networks.
  ☆15Updated 3 weeks ago
• AllanYangZhou / universal_neural_functional
  ☆51Updated last year
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆104Updated 6 months ago
• chandar-lab / EfficientLLMs
  ☆18Updated 10 months ago
• insuhan / hyper-attn
  ☆81Updated last year
• IntelLabs / DyNAS-T
  Dynamic Neural Architecture Search Toolkit
  ☆30Updated 6 months ago
• Felix-Petersen / algovision
  Differentiable Algorithms and Algorithmic Supervision.
  ☆116Updated last year
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆134Updated 9 months ago
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆68Updated 3 months ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆94Updated 3 weeks ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆256Updated last year
• srush / do-we-need-attention
  ☆166Updated last year
• alexzhang13 / Triton-Puzzles-Solutions
  Personal solutions to the Triton Puzzles
  ☆18Updated 10 months ago
• VectorInstitute / flex_model
  ☆13Updated last year
• dkopi / Bitune
  Implementation of Bitune: Bidirectional Instruction-Tuning
  ☆19Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆116Updated 5 months ago
• AlanAnsell / peft
  ☆18Updated 11 months ago
• HanGuo97 / log-linear-attention
  ☆88Updated this week
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆125Updated 6 months ago