Alternatives and similar repositories for gpt-j-fine-tuning-example

Users that are interested in gpt-j-fine-tuning-example are comparing it to the libraries listed below

• vihangd / alpaca-qlora
  Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA
  ☆81Updated last year
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆78Updated last year
• leehanchung / lora-instruct
  Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
  ☆103Updated last month
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• mobarski / alpaca-libre
  Reimplementation of the task generation part from the Alpaca paper
  ☆119Updated 2 years ago
• corolla-johnson / mkultra
  Prompt tuning toolkit for GPT-2 and GPT-Neo
  ☆88Updated 3 years ago
• VE-FORBRYDERNE / mtj-softtuner
  Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance
  ☆28Updated 2 years ago
• zphang / minimal-gpt-neox-20b
  ☆130Updated 3 years ago
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆103Updated 2 years ago
• sleekmike / Finetune_GPT-J_6B_8-bit
  Fine-tuning GPT-J-6B on colab or equivalent PC GPU with your custom datasets: 8-bit weights with low-rank adaptors (LoRA)
  ☆74Updated 3 years ago
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆67Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated 2 years ago
• hydrallm / llama-moe-v1
  ☆95Updated last year
• lxe / llama-peft-tuner
  Tune LLaMa-7B on Alpaca Dataset using PEFT / LORA Based on @zphang's https://github.com/zphang/minimal-llama scripts.
  ☆25Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆51Updated 2 years ago
• BlinkDL / RWKV-v2-RNN-Pile
  RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
  ☆67Updated 2 years ago
• harubaru / convogpt
  Conversational Language model toolkit for training against human preferences.
  ☆41Updated last year
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆41Updated 7 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• euclaise / supertrainer2000
  ☆49Updated last year