Alternatives and similar repositories for improved-t5:

Users that are interested in improved-t5 are comparing it to the libraries listed below

• allenai / bff
  ☆38Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆104Updated 4 months ago
• InflectionAI / Inflection-Benchmarks
  Public Inflection Benchmarks
  ☆68Updated last year
• cloneofsimo / min-fsdp
  ☆76Updated 9 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated last year
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆64Updated 2 years ago
• hadasah / btm
  ☆72Updated 11 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆109Updated 4 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• berlino / seq_icl
  ☆51Updated 10 months ago
• apple / ml-planner
  ☆48Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 7 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 5 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆72Updated 8 months ago
• google-deepmind / mishax
  ☆128Updated 2 weeks ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆85Updated 6 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆63Updated 2 months ago
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated last year
• KaiNylund / lm-weights-encode-time
  ☆67Updated 8 months ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆187Updated 8 months ago
• Zyphra / Zyda_processing
  ☆33Updated 9 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆81Updated last year
• epfml / DenseFormer
  ☆79Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆86Updated 3 weeks ago
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆50Updated 9 months ago