Alternatives and similar repositories for AI-research-papers-pseudo-code:

Users that are interested in AI-research-papers-pseudo-code are comparing it to the libraries listed below

• tspeterkim / mixed-precision-from-scratch
  Mixed precision training from scratch with Tensors and CUDA
  ☆21Updated 8 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆66Updated 9 months ago
• gnovack / distributed-training-and-deepspeed
  ☆17Updated last year
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆90Updated last year
• mgmalek / efficient_cross_entropy
  ☆83Updated 7 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆114Updated 10 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆116Updated 3 months ago
• hydrallm / llama-moe-v1
  ☆94Updated last year
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆229Updated 3 weeks ago
• epfml / dynamic-sparse-flash-attention
  ☆135Updated last year
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆81Updated last year
• kyo-takano / chinchilla
  A toolkit for scaling law research ⚖
  ☆43Updated last month
• srush / mamba-primer
  ☆37Updated 9 months ago
• NetEase-FuXi / EETQ
  Easy and Efficient Quantization for Transformers
  ☆191Updated last month
• allenai / OLMo-core
  PyTorch building blocks for OLMo
  ☆47Updated this week
• HanGuo97 / lq-lora
  ☆124Updated 11 months ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆78Updated 2 years ago
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆114Updated 7 months ago
• xijiu9 / Train_Transformers_with_INT4
  ☆140Updated last year
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆14Updated 2 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆67Updated 7 months ago
• anadim / the-little-retrieval-test
  ☆34Updated last year
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆64Updated 4 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated last year
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆55Updated 2 months ago
• tding1 / Efficient-LLM-Survey
  The Efficiency Spectrum of LLM
  ☆52Updated last year
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆28Updated 2 months ago
• microsoft / RLHF-APA
  RL algorithm: Advantage induced policy alignment
  ☆62Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆121Updated 9 months ago
• cloneofsimo / min-fsdp
  ☆75Updated 6 months ago