Alternatives and similar repositories for transformer-xl

Users that are interested in transformer-xl are comparing it to the libraries listed below

• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• ml-jku / LRAM
  A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks
  ☆33Updated 8 months ago
• andyljones / boardlaw
  Scaling scaling laws with board games.
  ☆49Updated 2 years ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆84Updated last year
• FLAIROx / cultural-accumulation
  ☆13Updated last year
• CarperAI / Algorithm-Distillation-RLHF
  ☆34Updated 2 years ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆35Updated last year
• upiterbarg / diff_history
  [ICML 2024] Official code release accompanying the paper "diff History for Neural Language Agents" (Piterbarg, Pinto, Fergus)
  ☆20Updated 10 months ago
• Sea-Snell / CALM-Dialogue
  Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"
  ☆34Updated 2 years ago
• google-deepmind / enn_acme
  ☆31Updated 2 years ago
• conglu1997 / intelligent-go-explore
  Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models
  ☆60Updated 4 months ago
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• btnorman / First-Explore
  Repo to reproduce the First-Explore paper results
  ☆37Updated 6 months ago
• CEC-Agent / CEC
  Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"
  ☆31Updated last year
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• ssokota / mec
  Code for minimum-entropy coupling.
  ☆32Updated last year
• facebookresearch / oni
  Learn online intrinsic rewards from LLM feedback
  ☆41Updated 7 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆85Updated last year
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆204Updated last year
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆46Updated 3 weeks ago
• keyonvafa / world-model-evaluation
  ☆59Updated 8 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• epfml / DenseFormer
  ☆81Updated last year
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆36Updated 2 years ago
• okarthikb / DPO
  Implementation of Direct Preference Optimization
  ☆16Updated 2 years ago
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆66Updated 2 years ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆35Updated 2 weeks ago
• dylandoblar / noether-networks
  Meta-learning inductive biases in the form of useful conserved quantities.
  ☆37Updated 2 years ago