Alternatives and similar repositories for transformer-xl:

Users that are interested in transformer-xl are comparing it to the libraries listed below

• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆28Updated 2 months ago
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆45Updated 7 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆40Updated 7 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• okarthikb / DPO
  Implementation of Direct Preference Optimization
  ☆15Updated last year
• facebookresearch / oni
  Learn online intrinsic rewards from LLM feedback
  ☆34Updated last month
• HomebrewNLP / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆47Updated last year
• cloneofsimo / zeroshampoo
  ☆33Updated 4 months ago
• google-deepmind / asyncdiloco
  ☆41Updated last year
• upiterbarg / diff_history
  [ICML 2024] Official code release accompanying the paper "diff History for Neural Language Agents" (Piterbarg, Pinto, Fergus)
  ☆20Updated 5 months ago
• radarFudan / mamba-minimal-jax
  ☆30Updated 2 months ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆68Updated last year
• vmicheli / delta-iris
  Efficient World Models with Context-Aware Tokenization. ICML 2024
  ☆89Updated 4 months ago
• abdulhaim / LMRL-Gym
  ☆76Updated 6 months ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆79Updated 2 years ago
• Sea-Snell / CALM-Dialogue
  Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"
  ☆34Updated 2 years ago
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆65Updated 2 years ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆121Updated 9 months ago
• CEC-Agent / CEC
  Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"
  ☆31Updated last year
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆33Updated last year
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 7 months ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• conglu1997 / intelligent-go-explore
  Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models
  ☆47Updated 7 months ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆47Updated 3 years ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆30Updated last month
• cloneofsimo / min-fsdp
  ☆75Updated 6 months ago
• ml-jku / LRAM
  A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks
  ☆28Updated 2 months ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆130Updated 9 months ago