Alternatives and similar repositories for pytorch-llama-notes:

Users that are interested in pytorch-llama-notes are comparing it to the libraries listed below

• Macaronlin / LLaMA3-Quantization
  A repository dedicated to evaluating the performance of quantizied LLaMA3 using various quantization methods..
  ☆178Updated last month
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆69Updated 11 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆294Updated last year
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆70Updated last year
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆42Updated 5 months ago
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆28Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆54Updated 10 months ago
• hkproj / mistral-llm-notes
  Notes on the Mistral AI model
  ☆18Updated last year
• hkproj / triton-flash-attention
  ☆128Updated last month
• pprp / Awesome-LLM-Quantization
  Awesome list for LLM quantization
  ☆170Updated last month
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆61Updated last year
• metame-ai / awesome-llm-plaza
  awesome llm plaza: daily tracking all sorts of awesome topics of llm, e.g. llm for coding, robotics, reasoning, multimod etc.
  ☆188Updated this week
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆272Updated last week
• neubig / minllama-assignment
  ☆80Updated 4 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆145Updated 8 months ago
• mit-han-lab / duo-attention
  [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  ☆426Updated last week
• mistralai / mistral-evals
  ☆59Updated 2 weeks ago
• FasterDecoding / TEAL
  ☆111Updated last week
• intel / auto-round
  Advanced Quantization Algorithm for LLMs/VLMs.
  ☆372Updated this week
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆157Updated 7 months ago
• thu-nics / MoA
  The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆114Updated 2 months ago
• stanford-cs336 / spring2024-lectures
  ☆214Updated last month
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆160Updated 2 months ago
• FairyFali / SLMs-Survey
  Survey of Small Language Models from Penn State, ...
  ☆156Updated last month
• jongwooko / distillm
  Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)
  ☆186Updated 5 months ago
• nbasyl / LLM-FP4
  The official implementation of the EMNLP 2023 paper LLM-FP4
  ☆184Updated last year
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆107Updated 2 months ago
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆324Updated 3 months ago
• HKUNLP / ChunkLlama
  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"
  ☆389Updated 4 months ago
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆240Updated last month