Alternatives and similar repositories for mrt5:

Users that are interested in mrt5 are comparing it to the libraries listed below

• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated 11 months ago
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆76Updated 4 months ago
• Zyphra / Zyda_processing
  ☆31Updated 8 months ago
• Aleph-Alpha / trigrams
  ☆51Updated 6 months ago
• arcee-ai / DAM
  ☆48Updated 3 months ago
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆64Updated 10 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆54Updated 6 months ago
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆59Updated 7 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 11 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆21Updated last month
• euclaise / supertrainer2000
  ☆49Updated 11 months ago
• TristanThrush / i-am-a-strange-dataset
  Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"
  ☆41Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 6 months ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• wolfecameron / lora_instruction_tune
  ☆40Updated 9 months ago
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated last week
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆25Updated 8 months ago
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 6 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆44Updated 7 months ago
• joshuacnf / Ctrl-G
  ☆80Updated last month
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated 10 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 11 months ago
• vmarinowski / infini-attention
  An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'
  ☆49Updated 6 months ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆82Updated last month
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆121Updated last month
• RobertCsordas / moeut
  ☆73Updated 6 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆47Updated last month