Alternatives and similar repositories for litter:

Users that are interested in litter are comparing it to the libraries listed below

• leehanchung / lora-instruct
  Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
  ☆103Updated 8 months ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated last year
• ml-gde / jflux
  JAX Implementation of Black Forest Labs' Flux.1 family of models
  ☆31Updated 6 months ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆164Updated 2 months ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆62Updated 8 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆44Updated 10 months ago
• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆122Updated last year
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆94Updated 3 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆139Updated 2 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆98Updated 4 months ago
• cloneofsimo / min-fsdp
  ☆78Updated 9 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆123Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• euclaise / supertrainer2000
  ☆49Updated last year
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆82Updated last year
• hunar4321 / reweight-gpt
  Reweight GPT - a simple neural network using transformer architecture for next character prediction
  ☆53Updated last year
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• NolanoOrg / smol-gpt
  Smol but mighty language model
  ☆63Updated 2 years ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• ClashLuke / SOAP
  ☆21Updated 5 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated this week
• abacaj / train-with-fsdp
  ☆92Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆91Updated last year
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 5 months ago
• IsaacRe / Syntactically-Constrained-Sampling
  LLM sampling method for enforcing syntax adherence in generated output
  ☆24Updated last year
• Aleph-Alpha / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆58Updated 5 months ago