Alternatives and similar repositories for pytorch-llama:

Users that are interested in pytorch-llama are comparing it to the libraries listed below

• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆60Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆94Updated last year
• hkproj / pytorch-llama-notes
  Notes about LLaMA 2 model
  ☆53Updated last year
• hkproj / triton-flash-attention
  ☆128Updated last month
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆240Updated last month
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆196Updated 11 months ago
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆321Updated 3 months ago
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆133Updated last month
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆584Updated 11 months ago
• feifeibear / LLMSpeculativeSampling
  Fast inference from large lauguage models via speculative decoding
  ☆657Updated 5 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆145Updated 8 months ago
• hemingkx / SpeculativeDecodingPapers
  📰 Must-read papers and blogs on Speculative Decoding ⚡️
  ☆595Updated this week
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆69Updated 11 months ago
• FasterDecoding / REST
  REST: Retrieval-Based Speculative Decoding, NAACL 2024
  ☆192Updated 2 months ago
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆126Updated 11 months ago
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆363Updated 8 months ago
• microsoft / TransformerCompression
  For releasing code related to compression methods for transformers, accompanying our publications
  ☆408Updated last month
• xfactlab / orpo
  Official repository for ORPO
  ☆437Updated 8 months ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆357Updated this week
• for-ai / parameter-efficient-moe
  ☆251Updated last year
• NVIDIA / NeMo-Aligner
  Scalable toolkit for efficient model alignment
  ☆719Updated this week
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆724Updated this week
• HKUNLP / ChunkLlama
  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"
  ☆389Updated 4 months ago
• jongwooko / distillm
  Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)
  ☆184Updated 5 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆144Updated 8 months ago
• timinar / BabyLlama
  Training code for Baby-Llama, our submission to the strict-small track of the BabyLM challenge.
  ☆77Updated last year
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆701Updated 4 months ago
• shreyansh26 / Speculative-Sampling
  Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind
  ☆87Updated 11 months ago
• SafeAILab / EAGLE
  Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)
  ☆968Updated this week
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆28Updated last year