Alternatives and similar repositories for vanilla-llama

Users that are interested in vanilla-llama are comparing it to the libraries listed below

• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆611Updated last year
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆547Updated last year
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆220Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆367Updated last year
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆809Updated last year
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆518Updated last year
• ypeleg / llama
  User-friendly LLaMA: Train or Run the model using PyTorch. Nothing else.
  ☆338Updated 2 years ago
• IST-DASLab / sparsegpt
  Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".
  ☆799Updated 9 months ago
• bojone / NBCE
  Naive Bayes-based Context Extension
  ☆325Updated 5 months ago
• jackaduma / Vicuna-LoRA-RLHF-PyTorch
  A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…
  ☆215Updated last year
• zphang / minimal-llama
  ☆457Updated last year
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆454Updated last year
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆396Updated last year
• git-cloner / llama-lora-fine-tuning
  llama fine-tuning with lora
  ☆139Updated last year
• raunak-agarwal / instruction-datasets
  All available datasets for Instruction Tuning of Large Language Models
  ☆250Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆415Updated 9 months ago
• XueFuzhao / InstructionWild
  ☆459Updated 11 months ago
• johnsmith0031 / alpaca_lora_4bit
  ☆534Updated last year
• horseee / LLM-Pruner
  [NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baich…
  ☆1,014Updated 7 months ago
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆984Updated 11 months ago
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆564Updated 7 months ago
• SqueezeAILab / SqueezeLLM
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆689Updated 9 months ago
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆300Updated 2 years ago
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆313Updated 2 years ago
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆635Updated 10 months ago
• lucidrains / MEGABYTE-pytorch
  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
  ☆642Updated 5 months ago
• locuslab / wanda
  A simple and effective LLM pruning approach.
  ☆752Updated 9 months ago
• epfml / landmark-attention
  Landmark Attention: Random-Access Infinite Context Length for Transformers
  ☆421Updated last year
• kuleshov-group / llmtools
  Finetuning Large Language Models on One Consumer GPU in 2 Bits
  ☆721Updated last year
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago