Alternatives and similar repositories for nanoGPT-LoRA

Users that are interested in nanoGPT-LoRA are comparing it to the libraries listed below

• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆469Updated last year
• microsoft / AdaMix
  This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.1…
  ☆136Updated 2 years ago
• UIC-Liu-Lab / ContinualLM
  An Extensible Continual Learning Framework Focused on Language Models (LMs)
  ☆291Updated last year
• lee-ny / teaching_arithmetic
  ☆84Updated 2 years ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆216Updated last year
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆532Updated last year
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆561Updated 10 months ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆138Updated last year
• kmeng01 / rome
  Locating and editing factual associations in GPT (NeurIPS 2022)
  ☆707Updated last year
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆182Updated 3 years ago
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆321Updated last year
• raunak-agarwal / instruction-datasets
  Datasets for Instruction Tuning of Large Language Models
  ☆259Updated 2 years ago
• joykirat18 / How-To-Think-Step-by-Step
  How to think step-by-step: A mechanistic understanding of chain-of-thought reasoning
  ☆25Updated last year
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆551Updated last year
• anthropics / ConstitutionalHarmlessnessPaper
  ☆249Updated 2 years ago
• samrawal / llama2_chat_templater
  Wrapper to easily generate the chat template for Llama2
  ☆65Updated last year
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆295Updated 11 months ago
• orhonovich / unnatural-instructions
  ☆180Updated 2 years ago
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆98Updated 2 years ago
• glgh / awesome-llm-human-preference-datasets
  A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
  ☆384Updated 2 years ago
• wesg52 / sparse-probing-paper
  Sparse probing paper full code.
  ☆65Updated 2 years ago
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆227Updated 2 years ago
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆180Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• Olivia-fsm / DoGE
  Codebase for ICML submission "DOGE: Domain Reweighting with Generalization Estimation"
  ☆21Updated last year
• vihangd / alpaca-qlora
  Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA
  ☆81Updated 2 years ago
• OpenMOSS / Language-Model-SAEs
  Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.
  ☆168Updated this week
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆368Updated last year
• Cohere-Labs-Community / parameter-efficient-moe
  ☆272Updated 2 years ago
• Dahoas / reward-modeling
  ☆98Updated 2 years ago