Alternatives and similar repositories for vanilla-llama

Users that are interested in vanilla-llama are comparing it to the libraries listed below

• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆537Updated last year
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆632Updated last year
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆532Updated last year
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆469Updated last year
• zphang / minimal-llama
  ☆457Updated 2 years ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆811Updated 2 years ago
• SqueezeAILab / SqueezeLLM
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆708Updated last year
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆991Updated last year
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆564Updated last year
• Vahe1994 / SpQR
  ☆550Updated 11 months ago
• kuleshov-group / llmtools
  Finetuning Large Language Models on One Consumer GPU in 2 Bits
  ☆733Updated last year
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆145Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆384Updated last year
• epfLLM / Megatron-LLM
  distributed trainer for LLMs
  ☆584Updated last year
• ypeleg / llama
  User-friendly LLaMA: Train or Run the model using PyTorch. Nothing else.
  ☆339Updated 2 years ago
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆405Updated last year
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆315Updated 2 years ago
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆659Updated last year
• epfml / landmark-attention
  Landmark Attention: Random-Access Infinite Context Length for Transformers
  ☆427Updated last year
• pratyushasharma / laser
  The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  ☆389Updated last year
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆552Updated last year
• BlackSamorez / tensor_parallel
  Automatically split your PyTorch models on multiple GPUs for training & inference
  ☆658Updated last year
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆224Updated 2 years ago
• conceptofmind / LaMDA-rlhf-pytorch
  Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
  ☆472Updated last year
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆661Updated last year
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆824Updated 2 years ago
• TencentARC / LLaMA-Pro
  [ACL 2024] Progressive LLaMA with Block Expansion.
  ☆513Updated last year
• lucidrains / MEGABYTE-pytorch
  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
  ☆654Updated 11 months ago
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆357Updated 2 years ago
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆416Updated last year