Alternatives and similar repositories for bart-base-jax

Users that are interested in bart-base-jax are comparing it to the libraries listed below

• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆116Updated 2 years ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆56Updated last year
• deep-spin / infinite-former
  ☆66Updated last year
• Jellyfish042 / uncheatable_eval
  Evaluating LLMs with Dynamic Data
  ☆91Updated last month
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆56Updated 2 weeks ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆136Updated last year
• Dahoas / reward-modeling
  ☆98Updated 2 years ago
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆229Updated 11 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆82Updated 3 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated 2 years ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated 2 years ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆73Updated last year
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated last year
• cimeister / typical-sampling
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
  ☆82Updated 3 years ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆107Updated 5 months ago
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated 2 years ago
• Zyphra / Zyda_processing
  ☆38Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 11 months ago
• warner-benjamin / optimi
  Fast, Modern, and Low Precision PyTorch Optimizers
  ☆109Updated last week
• google-deepmind / randomized_positional_encodings
  Randomized Positional Encodings Boost Length Generalization of Transformers
  ☆82Updated last year
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆33Updated last year
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆192Updated last year
• ayaka14732 / TrAVis
  TrAVis: Visualise BERT attention in your browser
  ☆58Updated 2 years ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated 2 years ago
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆166Updated 6 months ago
• chandar-lab / NeoBERT
  ☆81Updated 2 months ago
• BlinkDL / WorldModel
  Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business /…
  ☆40Updated 2 years ago