Alternatives and similar repositories for finetune-gpt2xl:

Users that are interested in finetune-gpt2xl are comparing it to the libraries listed below

• mallorbc / Finetune_LLMs
  Repo for fine-tuning Casual LLMs
  ☆453Updated last year
• bigscience-workshop / t-zero
  Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
  ☆464Updated 2 years ago
• lucidrains / RETRO-pytorch
  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
  ☆862Updated last year
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆579Updated last year
• JulesGM / ParlAI_SearchEngine
  A search engine for ParlAI's BlenderBot project (and probably other ones as well)
  ☆131Updated 3 years ago
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆530Updated 6 months ago
• corolla-johnson / mkultra
  Prompt tuning toolkit for GPT-2 and GPT-Neo
  ☆88Updated 3 years ago
• dreasysnail / RetGen
  ☆111Updated 2 years ago
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆472Updated 2 years ago
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆351Updated last year
• google-research / longt5
  ☆182Updated last year
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆561Updated 6 months ago
• CarperAI / cheese
  Used for adaptive human in the loop evaluation of language and embedding models.
  ☆308Updated 2 years ago
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆466Updated last year
• zphang / minimal-gpt-neox-20b
  ☆130Updated 2 years ago
• tunib-ai / parallelformers
  Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
  ☆785Updated last year
• facebookresearch / atlas
  Code repository for supporting the paper "Atlas Few-shot Learning with Retrieval Augmented Language Models",(https//arxiv.org/abs/2208.03…
  ☆531Updated last year
• urvashik / knnlm
  ☆318Updated 3 years ago
• ftarlaci / GPT2sQA
  Fine-tuning GPT-2 Small for Question Answering
  ☆130Updated 2 years ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• timoschick / dino
  This repository contains the code for "Generating Datasets with Pretrained Language Models".
  ☆188Updated 3 years ago
• EleutherAI / the-pile
  ☆1,555Updated last year
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆225Updated last year
• allenai / natural-instructions
  Expanding natural instructions
  ☆991Updated last year
• zphang / minimal-llama
  ☆459Updated last year
• allenai / unifiedqa
  UnifiedQA: Crossing Format Boundaries With a Single QA System
  ☆432Updated 2 years ago
• sleekmike / Finetune_GPT-J_6B_8-bit
  Fine-tuning GPT-J-6B on colab or equivalent PC GPU with your custom datasets: 8-bit weights with low-rank adaptors (LoRA)
  ☆74Updated 2 years ago
• yangkevin2 / emnlp22-re3-story-generation
  ☆251Updated 2 years ago
• Shivanandroy / simpleT5
  simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
  ☆394Updated last year
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆154Updated last year