Alternatives and similar repositories for GPU-Grants:

Users that are interested in GPU-Grants are comparing it to the libraries listed below

• apoorvkh / academic-pretraining
  $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
  ☆133Updated this week
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆116Updated 4 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆83Updated 3 weeks ago
• CLAIRE-Labo / flash_attention
  A basic pure pytorch implementation of flash attention
  ☆16Updated 4 months ago
• facebookresearch / mexma
  MEXMA: Token-level objectives improve sentence representations
  ☆41Updated 2 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆83Updated 3 months ago
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 6 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆122Updated 10 months ago
• euclaise / supertrainer2000
  ☆49Updated 11 months ago
• apoorvkh / torchrunx
  Easily run PyTorch on multiple GPUs & machines
  ☆38Updated this week
• fal-ai-community / minDDPD
  ☆33Updated 2 months ago
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆55Updated 9 months ago
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆69Updated 2 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆121Updated last month
• justinlovelace / Diffusion-Guided-LM
  ☆23Updated 7 months ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated this week
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 4 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆97Updated 2 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆109Updated 2 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 6 months ago
• cisnlp / GlotCC
  🕸 GlotCC Dataset and Pipline -- NeurIPS 2024
  ☆18Updated 4 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated 10 months ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆84Updated this week
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• zacharyhorvitz / Fk-Diffusion-Steering
  A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.
  ☆103Updated 3 weeks ago
• vivien000 / regex-constrained-decoding
  Fast, High-Fidelity LLM Decoding with Regex Constraints
  ☆20Updated 7 months ago