Alternatives and similar repositories for gpt-j-fine-tuning-example:

Users that are interested in gpt-j-fine-tuning-example are comparing it to the libraries listed below

• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated last year
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆67Updated last year
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated last year
• VE-FORBRYDERNE / mtj-softtuner
  Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance
  ☆28Updated 2 years ago
• sleekmike / Finetune_GPT-J_6B_8-bit
  Fine-tuning GPT-J-6B on colab or equivalent PC GPU with your custom datasets: 8-bit weights with low-rank adaptors (LoRA)
  ☆74Updated 2 years ago
• leehanchung / lora-instruct
  Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
  ☆103Updated 8 months ago
• iwalton3 / mpt-lora-patch
  Patch for MPT-7B which allows using and training a LoRA
  ☆58Updated last year
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆51Updated last year
• Langboat / mengzi-retrieval-lm
  An experimental implementation of the retrieval-enhanced language model
  ☆74Updated 2 years ago
• corolla-johnson / mkultra
  Prompt tuning toolkit for GPT-2 and GPT-Neo
  ☆88Updated 3 years ago
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• mobarski / alpaca-libre
  Reimplementation of the task generation part from the Alpaca paper
  ☆119Updated 2 years ago
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated last year
• zphang / minimal-gpt-neox-20b
  ☆130Updated 2 years ago
• LAION-AI / blade2blade
  Adversarial Training and SFT for Bot Safety Models
  ☆39Updated 2 years ago
• jina-ai / textbook
  distill chatGPT coding ability into small model (1b)
  ☆28Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated last year
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated 2 years ago
• TehVenomm / LM_Transformers_BlockMerge
  Image Diffusion block merging technique applied to transformers based Language Models.
  ☆54Updated last year
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆45Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• EleutherAI / github-downloader
  Script for downloading GitHub.
  ☆93Updated 9 months ago