Alternatives and similar repositories for transformer-xl

Users that are interested in transformer-xl are comparing it to the libraries listed below

• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆210Updated 2 years ago
• dvruette / barrel-rec-pytorch
  ☆53Updated 2 years ago
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆92Updated 2 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆51Updated 2 years ago
• CEC-Agent / CEC
  Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"
  ☆31Updated 2 years ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆86Updated 2 years ago
• mgrankin / minGPT
  minGPT in JAX
  ☆48Updated 4 years ago
• Cornell-RL / tril
  ☆128Updated last year
• Sea-Snell / CALM-Dialogue
  Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"
  ☆34Updated 3 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆87Updated 3 years ago
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆120Updated last year
• okarthikb / DPO
  Implementation of Direct Preference Optimization
  ☆17Updated 2 years ago
• cloneofsimo / min-fsdp
  ☆92Updated last year
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆92Updated last year
• ml-jku / LRAM
  A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks
  ☆36Updated last year
• vmicheli / delta-iris
  Efficient World Models with Context-Aware Tokenization. ICML 2024
  ☆115Updated last year
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• google-research / jestimator
  Amos optimizer with JEstimator lib.
  ☆82Updated last year
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆66Updated 3 years ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• sholtodouglas / scalingExperiments
  ☆63Updated 3 years ago
• keyonvafa / world-model-evaluation
  ☆76Updated last year
• Sea-Snell / Implicit-Language-Q-Learning
  Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"
  ☆210Updated 2 years ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆137Updated last year
• radarFudan / mamba-minimal-jax
  ☆35Updated last year
• ssokota / mec
  Code for minimum-entropy coupling.
  ☆32Updated 3 weeks ago
• FLAIROx / cultural-accumulation
  ☆16Updated last year
• andyljones / boardlaw
  Scaling scaling laws with board games.
  ☆53Updated 2 years ago
• google-deepmind / enn_acme
  ☆31Updated 3 years ago