Alternatives and similar repositories for transformer-xl:

Users that are interested in transformer-xl are comparing it to the libraries listed below

• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• okarthikb / DPO
  Implementation of Direct Preference Optimization
  ☆15Updated last year
• google-deepmind / asyncdiloco
  ☆43Updated last year
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• cloneofsimo / min-fsdp
  ☆78Updated 9 months ago
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆34Updated 5 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 10 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆111Updated 4 months ago
• ml-jku / LRAM
  A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks
  ☆32Updated 5 months ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• upiterbarg / diff_history
  [ICML 2024] Official code release accompanying the paper "diff History for Neural Language Agents" (Piterbarg, Pinto, Fergus)
  ☆20Updated 8 months ago
• Sea-Snell / CALM-Dialogue
  Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"
  ☆34Updated 2 years ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆82Updated last year
• abacaj / train-with-fsdp
  ☆92Updated last year
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆45Updated last month
• CEC-Agent / CEC
  Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"
  ☆31Updated last year
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆49Updated last year
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆204Updated last year
• conglu1997 / intelligent-go-explore
  Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models
  ☆54Updated 2 months ago
• davisyoshida / easy-lora-and-gptq
  JAX notebook showing how to LoRA + GPTQ arbitrary models
  ☆9Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 10 months ago
• okarthikb / state-space-models
  ☆27Updated 9 months ago
• sholtodouglas / scalingExperiments
  ☆60Updated 3 years ago
• euclaise / supertrainer2000
  ☆49Updated last year
• CarperAI / Algorithm-Distillation-RLHF
  ☆34Updated 2 years ago
• cloneofsimo / zeroshampoo
  ☆33Updated 7 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆123Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago