euclaise / supertrainer2000

Related projects ⓘ

Alternatives and complementary repositories for supertrainer2000

• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆67Updated this week
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆84Updated last week
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 7 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated 10 months ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• epfml / DenseFormer
  ☆76Updated 7 months ago
• NousResearch / StripedHyenaTrainer
  ☆57Updated 11 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆44Updated this week
• CarperAI / treasure_trove
  ☆22Updated last year
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 4 months ago
• cognitivecomputations / grokadamw
  ☆118Updated 3 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆104Updated last month
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆113Updated 3 weeks ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆117Updated this week
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 7 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated 10 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆23Updated 8 months ago
• arcee-ai / DAM
  ☆40Updated 2 weeks ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆71Updated last month
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆58Updated 4 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 2 months ago
• cloneofsimo / min-fsdp
  ☆73Updated 4 months ago
• cognitivecomputations / spectrum
  ☆93Updated last month
• KellerJordan / Muon
  Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead
  ☆109Updated last week
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆177Updated last month