ayaka14732 / bart-base-jax
JAX implementation of the bart-base model
☆30Updated last year
Alternatives and similar repositories for bart-base-jax:
Users that are interested in bart-base-jax are comparing it to the libraries listed below
- PyTorch building blocks for the OLMo ecosystem☆54Updated this week
- ☆48Updated last year
- A fast implementation of T5/UL2 in PyTorch using Flash Attention☆81Updated 3 weeks ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated last year
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO …☆53Updated last week
- [ACL 24 Findings] Implementation of Resonance RoPE and the PosGen synthetic dataset.☆21Updated 11 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated last year
- Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI☆57Updated last year
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆30Updated 8 months ago
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated last year
- In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning☆33Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 8 months ago
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- Truly flash T5 realization!☆63Updated 9 months ago
- Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business /…☆40Updated last year
- An English-to-Cantonese machine translation model☆49Updated 10 months ago
- ☆49Updated 11 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated 11 months ago
- ☆37Updated last year
- Evaluating LLMs with Dynamic Data☆75Updated last week
- GoldFinch and other hybrid transformer components☆43Updated 7 months ago
- TrAVis: Visualise BERT attention in your browser☆58Updated 2 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆70Updated 11 months ago
- ☆31Updated 8 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated 2 months ago
- Collection of autoregressive model implementation☆81Updated last week
- [TMLR'23] Contrastive Search Is What You Need For Neural Text Generation☆119Updated last year