Alternatives and similar repositories for transformer-xl

Users that are interested in transformer-xl are comparing it to the libraries listed below

• Sea-Snell / CALM-Dialogue
  Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"
  ☆34Updated 2 years ago
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• facebookresearch / oni
  Learn online intrinsic rewards from LLM feedback
  ☆41Updated 6 months ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• upiterbarg / diff_history
  [ICML 2024] Official code release accompanying the paper "diff History for Neural Language Agents" (Piterbarg, Pinto, Fergus)
  ☆20Updated 10 months ago
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆35Updated 7 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• davisyoshida / easy-lora-and-gptq
  JAX notebook showing how to LoRA + GPTQ arbitrary models
  ☆10Updated last year
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆81Updated 3 years ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆84Updated last year
• berlino / seq_icl
  ☆53Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated 2 weeks ago
• cloneofsimo / min-fsdp
  ☆78Updated 11 months ago
• andyljones / boardlaw
  Scaling scaling laws with board games.
  ☆49Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆51Updated 3 months ago
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆20Updated 2 years ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 9 months ago
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆66Updated 2 years ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆68Updated last year
• cloneofsimo / zeroshampoo
  ☆34Updated 9 months ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆165Updated 4 months ago
• wattenberg / superposition
  Code associated to papers on superposition (in ML interpretability)
  ☆28Updated 2 years ago
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆118Updated last year
• conglu1997 / intelligent-go-explore
  Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models
  ☆58Updated 4 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆136Updated last year
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆205Updated last year