Alternatives and similar repositories for vanilla-llama

Users that are interested in vanilla-llama are comparing it to the libraries listed below

• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆566Updated last year
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆537Updated last year
• zphang / minimal-llama
  ☆457Updated 2 years ago
• jackaduma / Vicuna-LoRA-RLHF-PyTorch
  A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…
  ☆221Updated last year
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆639Updated last year
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆533Updated last year
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆809Updated 2 years ago
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆987Updated last year
• ypeleg / llama
  User-friendly LLaMA: Train or Run the model using PyTorch. Nothing else.
  ☆339Updated 2 years ago
• modular-ml / wrapyfi-examples_llama
  Inference code for facebook LLaMA models with Wrapyfi support
  ☆129Updated 2 years ago
• epfml / landmark-attention
  Landmark Attention: Random-Access Infinite Context Length for Transformers
  ☆426Updated 2 years ago
• lucidrains / MEGABYTE-pytorch
  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
  ☆654Updated last year
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆473Updated last year
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆409Updated last year
• feizc / MLE-LLaMA
  Multi-language Enhanced LLaMA
  ☆303Updated 2 years ago
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated 2 years ago
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆666Updated last year
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆551Updated last year
• conceptofmind / LaMDA-rlhf-pytorch
  Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
  ☆470Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆387Updated last year
• kuleshov-group / llmtools
  Finetuning Large Language Models on One Consumer GPU in 2 Bits
  ☆734Updated last year
• epfLLM / Megatron-LLM
  distributed trainer for LLMs
  ☆588Updated last year
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆358Updated 2 years ago
• XueFuzhao / InstructionWild
  ☆459Updated last year
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆224Updated 2 years ago
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆417Updated last year
• linhduongtuan / BLOOM-LORA
  Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…
  ☆184Updated 2 years ago
• SqueezeAILab / SqueezeLLM
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆713Updated last year
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆823Updated 2 years ago
• conceptofmind / toolformer
  ☆380Updated 2 years ago