Alternatives and similar repositories for bart-base-jax

Users that are interested in bart-base-jax are comparing it to the libraries listed below

• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated last year
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated 2 years ago
• Jellyfish042 / uncheatable_eval
  Evaluating LLMs with Dynamic Data
  ☆94Updated last month
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆116Updated 2 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆82Updated 3 years ago
• Zyphra / Zyda_processing
  ☆39Updated last year
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆33Updated last year
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆73Updated last year
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆107Updated 6 months ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆137Updated last year
• Knowledgator / TurboT5
  Truly flash T5 realization!
  ☆70Updated last year
• ayaka14732 / TrAVis
  TrAVis: Visualise BERT attention in your browser
  ☆58Updated 2 years ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated 2 years ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated 2 years ago
• deep-spin / infinite-former
  ☆67Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆56Updated this week
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆107Updated last year
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆56Updated 2 years ago
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆40Updated 10 months ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆59Updated last month
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 3 years ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated last year
• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆77Updated last year
• chandar-lab / NeoBERT
  ☆83Updated 3 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆27Updated last year
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆95Updated 2 years ago
• google-research-datasets / presto
  A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs
  ☆115Updated 2 years ago
• EleutherAI / openwebtext2
  ☆90Updated 3 years ago