Alternatives and similar repositories for low-rank-adaptation-blog

Users that are interested in low-rank-adaptation-blog are comparing it to the libraries listed below

• vibrantlabsai / nemesis
  Reward Model framework for LLM RLHF
  ☆62Updated 2 years ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆221Updated 2 years ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆155Updated last year
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆107Updated last year
• Moocember / Optimization-by-PROmpting
  ☆78Updated 2 years ago
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated last year
• geronimi73 / phi2-finetune
  ☆86Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆94Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆111Updated last year
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆86Updated 2 years ago
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆85Updated 2 years ago
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆73Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆116Updated 2 years ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆59Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆226Updated 3 months ago
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆170Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆80Updated last year
• jakespringer / echo-embeddings
  ☆162Updated last year
• young-geng / koala_data_pipeline
  The data processing pipeline for the Koala chatbot language model
  ☆118Updated 2 years ago
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆180Updated last year
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆137Updated 2 years ago
• orhonovich / unnatural-instructions
  ☆180Updated 2 years ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆343Updated 6 months ago
• leehanchung / lora-instruct
  Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
  ☆104Updated 7 months ago
• imoneoi / multipack
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆203Updated last year
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆210Updated last year
• LAION-AI / blade2blade
  Adversarial Training and SFT for Bot Safety Models
  ☆40Updated 2 years ago