Alternatives and similar repositories for vanilla-llama

Users that are interested in vanilla-llama are comparing it to the libraries listed below

• zphang / minimal-llama
  ☆458Updated last year
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆564Updated 9 months ago
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆621Updated last year
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆523Updated last year
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆989Updated last year
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆458Updated last year
• jackaduma / Vicuna-LoRA-RLHF-PyTorch
  A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…
  ☆218Updated last year
• ypeleg / llama
  User-friendly LLaMA: Train or Run the model using PyTorch. Nothing else.
  ☆338Updated 2 years ago
• Vahe1994 / SpQR
  ☆543Updated 7 months ago
• kuleshov-group / llmtools
  Finetuning Large Language Models on One Consumer GPU in 2 Bits
  ☆726Updated last year
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆538Updated 9 months ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆809Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated last year
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆352Updated 2 years ago
• conceptofmind / LaMDA-rlhf-pytorch
  Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
  ☆471Updated last year
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆302Updated 2 years ago
• BlackSamorez / tensor_parallel
  Automatically split your PyTorch models on multiple GPUs for training & inference
  ☆656Updated last year
• SqueezeAILab / SqueezeLLM
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆695Updated 11 months ago
• epfml / landmark-attention
  Landmark Attention: Random-Access Infinite Context Length for Transformers
  ☆423Updated last year
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,402Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆374Updated last year
• lucidrains / MEGABYTE-pytorch
  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
  ☆646Updated 6 months ago
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆223Updated last year
• horseee / LLM-Pruner
  [NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baich…
  ☆1,035Updated 9 months ago
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆546Updated last year
• modular-ml / wrapyfi-examples_llama
  Inference code for facebook LLaMA models with Wrapyfi support
  ☆129Updated 2 years ago
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆412Updated 2 years ago
• google-research / distilling-step-by-step
  ☆547Updated last year
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆138Updated last year
• pratyushasharma / laser
  The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  ☆388Updated last year