evanmiller / LLM-Reading-List

Related projects ⓘ

Alternatives and complementary repositories for LLM-Reading-List

• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆903Updated 10 months ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆715Updated last month
• apoorvumang / prompt-lookup-decoding
  ☆470Updated 2 months ago
• tysam-code / hlb-gpt
  Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…
  ☆334Updated 3 months ago
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆545Updated this week
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆702Updated last year
• PiotrNawrot / nanoT5
  Fast & Simple repository for pre-training and fine-tuning T5-style models
  ☆970Updated 3 months ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,135Updated this week
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆397Updated 9 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆754Updated this week
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆190Updated 8 years ago
• kuleshov-group / llmtools
  Finetuning Large Language Models on One Consumer GPU in 2 Bits
  ☆707Updated 5 months ago
• hao-ai-lab / LookaheadDecoding
  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
  ☆1,149Updated last month
• mistralai / megablocks-public
  ☆860Updated 11 months ago
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆325Updated last year
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆214Updated 4 months ago
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆693Updated 3 weeks ago
• SkunkworksAI / hydra-moe
  ☆411Updated last year
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆701Updated last week
• punica-ai / punica
  Serving multiple LoRA finetuned LLM as one
  ☆984Updated 6 months ago
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,391Updated 8 months ago
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆411Updated 3 months ago
• KellerJordan / modded-nanogpt
  NanoGPT (124M) quality in 7.8 8xH100-minutes
  ☆1,033Updated this week
• arpitingle / gpu-alpha
  High Quality Resources on GPU Programming/Architecture
  ☆566Updated 3 months ago
• sabetAI / BLoRA
  batched loras
  ☆336Updated last year
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆157Updated last year
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆167Updated 3 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆675Updated 7 months ago
• Cerebras / gigaGPT
  a small code base for training large models
  ☆266Updated 2 weeks ago
• explosion / curated-transformers
  🤖 A PyTorch library of curated Transformer models and their composable components
  ☆866Updated 7 months ago