hkproj / pytorch-llama-notes

Related projects ⓘ

Alternatives and complementary repositories for pytorch-llama-notes

• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆258Updated last year
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆54Updated last year
• hkproj / mistral-llm-notes
  Notes on the Mistral AI model
  ☆18Updated 10 months ago
• Macaronlin / LLaMA3-Quantization
  A repository dedicated to evaluating the performance of quantizied LLaMA3 using various quantization methods..
  ☆166Updated 3 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆97Updated last month
• shreyansh26 / Speculative-Sampling
  Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind
  ☆82Updated 8 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆43Updated 7 months ago
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆58Updated 11 months ago
• pprp / Awesome-LLM-Quantization
  Awesome list for LLM quantization
  ☆127Updated this week
• nyunAI / Faster-LLM-Survey
  ☆40Updated 7 months ago
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆27Updated 10 months ago
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆41Updated last year
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆117Updated 8 months ago
• thu-nics / MoA
  The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆101Updated last week
• xijiu9 / Train_Transformers_with_INT4
  ☆134Updated last year
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆135Updated 5 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆143Updated last week
• mit-han-lab / pruning-sparsity-publications
  ☆21Updated last year
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆36Updated 2 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆252Updated last year
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆87Updated 2 weeks ago
• hkproj / bert-from-scratch
  BERT explained from scratch
  ☆12Updated last year
• timinar / BabyLlama
  Training code for Baby-Llama, our submission to the strict-small track of the BabyLM challenge.
  ☆68Updated last year
• metame-ai / awesome-llm-plaza
  awesome llm plaza: daily tracking all sorts of awesome topics of llm, e.g. llm for coding, robotics, reasoning, multimod etc.
  ☆154Updated this week
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆82Updated last year
• yxli2123 / LoftQ
  ☆199Updated 5 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆111Updated 8 months ago
• run-ai / llmperf
  ☆47Updated 2 months ago
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Demystifying the Compression of Mixture-of-Experts Through a Unified Framework".
  ☆48Updated 3 weeks ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆38Updated 8 months ago