hkproj / pytorch-llama

Related projects: ⓘ

• NVIDIA / NeMo-Aligner
  Scalable toolkit for efficient model alignment
  ☆509Updated this week
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆179Updated 6 months ago
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆241Updated 3 weeks ago
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆111Updated 6 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,116Updated this week
• epfLLM / Megatron-LLM
  distributed trainer for LLMs
  ☆524Updated 4 months ago
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆539Updated 6 months ago
• philschmid / deep-learning-pytorch-huggingface
  ☆629Updated last week
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆72Updated last year
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆322Updated 3 months ago
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆47Updated 11 months ago
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆608Updated last month
• xfactlab / orpo
  Official repository for ORPO
  ☆409Updated 3 months ago
• bkitano / llama-from-scratch
  Llama from scratch, or How to implement a paper without crying
  ☆499Updated 3 months ago
• forhaoliu / ringattention
  Transformers with Arbitrarily Large Context
  ☆613Updated last month
• lucidrains / ring-attention-pytorch
  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
  ☆452Updated last month
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆309Updated 2 weeks ago
• microsoft / TransformerCompression
  For releasing code related to compression methods for transformers, accompanying our publications
  ☆356Updated 2 weeks ago
• dingo-actual / infini-transformer
  PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…
  ☆271Updated 4 months ago
• vllm-project / llm-compressor
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
  ☆416Updated this week
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆26Updated 8 months ago
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆38Updated last year
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆530Updated 4 months ago
• SqueezeAILab / SqueezeLLM
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆629Updated last month
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆416Updated 6 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆284Updated last month
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆248Updated 10 months ago
• SafeAILab / EAGLE
  Official Implementation of EAGLE-1 and EAGLE-2
  ☆749Updated 3 weeks ago
• pratyushasharma / laser
  The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  ☆361Updated 2 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆306Updated 5 months ago