Alternatives and similar repositories for CUDA-L1

Users that are interested in CUDA-L1 are comparing it to the libraries listed below

• bluorion-com / ZClip
  Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".
  ☆131Updated last month
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆283Updated this week
• huggingface / kernels
  Load compute kernels from the Hub
  ☆220Updated this week
• sayakpaul / nanoDiT
  Just another reasonably minimal repo for class-conditional training of pixel-space diffusion transformers.
  ☆120Updated 2 months ago
• OpenMachine-ai / transformer-tricks
  A collection of tricks and tools to speed up transformer models
  ☆169Updated 2 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆184Updated 6 months ago
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆190Updated 8 months ago
• HanGuo97 / log-linear-attention
  ☆232Updated 2 months ago
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆264Updated 10 months ago
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆94Updated last week
• BorealisAI / neuzip
  Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…
  ☆59Updated 9 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆81Updated this week
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆76Updated 7 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆127Updated 8 months ago
• Think-a-Tron / evolve
  open source alpha evolve
  ☆66Updated 2 months ago
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆68Updated 3 months ago
• s-sahoo / Eso-LMs
  Esoteric Language Models
  ☆89Updated last week
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆94Updated 2 weeks ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆103Updated 5 months ago
• QuixiAI / grokadamw
  ☆134Updated 11 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆198Updated last year
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆142Updated this week
• IST-DASLab / QuEST
  Work in progress.
  ☆70Updated last month
• hyhieu / easy_pybind
  ☆32Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆130Updated 2 months ago
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆245Updated 3 weeks ago
• NVlabs / hymba
  ☆190Updated 7 months ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆385Updated last month
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆86Updated last month
• huggingface / large-scale-image-deduplication
  ☆123Updated 2 weeks ago