Alternatives and similar repositories for litter

Users that are interested in litter are comparing it to the libraries listed below

• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆101Updated 6 months ago
• borisdayma / clip-jax
  Train vision models using JAX and 🤗 transformers
  ☆98Updated 3 months ago
• ml-gde / jflux
  JAX Implementation of Black Forest Labs' Flux.1 family of models
  ☆34Updated 8 months ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆116Updated 2 years ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆85Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆121Updated 2 years ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• yk / llmvm
  ☆30Updated last year
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated 2 years ago
• euclaise / supertrainer2000
  ☆49Updated last year
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆68Updated last year
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆45Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆165Updated 5 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• CERC-AAI / Robin
  ☆63Updated 9 months ago
• leehanchung / lora-instruct
  Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
  ☆104Updated last month
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆36Updated 2 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆65Updated 11 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆129Updated last year
• NolanoOrg / smol-gpt
  Smol but mighty language model
  ☆62Updated 2 years ago
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• KaiNylund / lm-weights-encode-time
  ☆68Updated 11 months ago
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆98Updated 5 months ago
• abacaj / train-with-fsdp
  ☆92Updated last year
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago