qrsch / doubutsu

Related projects ⓘ

Alternatives and complementary repositories for doubutsu

• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆66Updated this week
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆92Updated this week
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 2 months ago
• NousResearch / StripedHyenaTrainer
  ☆55Updated 11 months ago
• cloneofsimo / min-fsdp
  ☆72Updated 4 months ago
• okarthikb / state-space-models
  ☆27Updated 4 months ago
• apple / ml-mofi
  ☆57Updated 7 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆83Updated last week
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆71Updated last year
• euclaise / supertrainer2000
  ☆49Updated 7 months ago
• andravin / spio
  Efficient CUDA kernels for training convolutional neural networks with PyTorch.
  ☆33Updated last week
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆87Updated 6 months ago
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆58Updated 3 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆84Updated 2 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆43Updated this week
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆115Updated 4 months ago
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆111Updated 2 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆61Updated this week
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• CERC-AAI / Robin
  ☆62Updated last month
• xjdr-alt / llmri
  look how they massacred my boy
  ☆54Updated 3 weeks ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆44Updated 2 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆158Updated 2 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆112Updated 6 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 7 months ago
• KellerJordan / Muon
  Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead
  ☆69Updated this week
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆71Updated 9 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 7 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆29Updated 6 months ago
• YuchenJin / llm.c
  LLM training in simple, raw C/CUDA
  ☆12Updated last month