Alternatives and similar repositories for gpt-j-fine-tuning-example

Users that are interested in gpt-j-fine-tuning-example are comparing it to the libraries listed below

• zphang / minimal-gpt-neox-20b
  ☆131Updated 3 years ago
• BlinkDL / RWKV-v2-RNN-Pile
  RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
  ☆67Updated 3 years ago
• ArEnSc / Production-RWKV
  This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…
  ☆65Updated 2 years ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• VE-FORBRYDERNE / mtj-softtuner
  Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance
  ☆28Updated 2 years ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆116Updated 2 years ago
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• labmlai / neox
  Simple Annotated implementation of GPT-NeoX in PyTorch
  ☆110Updated 3 years ago
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆147Updated 2 years ago
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆67Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• ConiferLabsWA / flan-ul2-alpaca
  ☆33Updated 2 years ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 3 years ago
• hitomi-team / sukima
  A ready-to-deploy container for implementing an easy to use REST API to access Language Models.
  ☆66Updated 2 years ago
• donaldafeith / Pytorch_Merge
  Merge LLM that are split in to parts
  ☆27Updated 4 months ago
• corolla-johnson / mkultra
  Prompt tuning toolkit for GPT-2 and GPT-Neo
  ☆89Updated 4 years ago
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆79Updated last year
• pszemraj / ai-msgbot
  Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.
  ☆49Updated 3 years ago
• modular-ml / wrapyfi-examples_llama
  Inference code for facebook LLaMA models with Wrapyfi support
  ☆129Updated 2 years ago
• leehanchung / lora-instruct
  Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
  ☆104Updated 6 months ago
• yangkevin2 / emnlp22-re3-story-generation
  ☆254Updated 2 years ago
• sleekmike / Finetune_GPT-J_6B_8-bit
  Fine-tuning GPT-J-6B on colab or equivalent PC GPU with your custom datasets: 8-bit weights with low-rank adaptors (LoRA)
  ☆74Updated 3 years ago
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated 2 years ago
• LAION-AI / blade2blade
  Adversarial Training and SFT for Bot Safety Models
  ☆40Updated 2 years ago
• EleutherAI / openwebtext2
  ☆92Updated 3 years ago
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• illidanlab / personaGPT
  Implementation of PersonaGPT Dialog Model
  ☆111Updated 4 years ago
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆85Updated 2 years ago
• radi-cho / botbots
  A dataset featuring diverse dialogues between two ChatGPT (gpt-3.5-turbo) instances with system messages written by GPT-4. Covering vario…
  ☆164Updated 2 years ago