Alternatives and similar repositories for transformer-xl

Users that are interested in transformer-xl are comparing it to the libraries listed below

• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆210Updated 2 years ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆92Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆87Updated 3 years ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆86Updated 2 years ago
• okarthikb / DPO
  Implementation of Direct Preference Optimization
  ☆17Updated 2 years ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• sholtodouglas / scalingExperiments
  ☆63Updated 3 years ago
• conglu1997 / intelligent-go-explore
  Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models
  ☆65Updated 10 months ago
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆34Updated last year
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆51Updated last year
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆66Updated 3 years ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆70Updated last year
• Sea-Snell / CALM-Dialogue
  Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"
  ☆34Updated 3 years ago
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆120Updated last year
• keyonvafa / world-model-evaluation
  ☆75Updated last year
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆60Updated 3 years ago
• vmicheli / delta-iris
  Efficient World Models with Context-Aware Tokenization. ICML 2024
  ☆116Updated last year
• radarFudan / mamba-minimal-jax
  ☆35Updated last year
• Cornell-RL / tril
  ☆128Updated last year
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆169Updated 5 months ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆138Updated last year
• NousResearch / StripedHyenaTrainer
  ☆62Updated 2 years ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆162Updated last year
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆170Updated 11 months ago
• CEC-Agent / CEC
  Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"
  ☆31Updated 2 years ago
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆81Updated 3 years ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆136Updated last year
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago