cchan / nanoGPT-fp8

Related projects ⓘ

Alternatives and complementary repositories for nanoGPT-fp8

• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆45Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆41Updated 4 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• NousResearch / StripedHyenaTrainer
  ☆55Updated 11 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆43Updated this week
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated 8 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆24Updated last year
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆42Updated 6 months ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆56Updated last month
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆44Updated 2 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆36Updated 7 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 10 months ago
• euclaise / supertrainer2000
  ☆49Updated 7 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆22Updated 7 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆66Updated this week
• HazyResearch / train-tk
  train with kittens!
  ☆48Updated 2 weeks ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 9 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 7 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 3 months ago
• google-deepmind / asyncdiloco
  ☆39Updated 9 months ago
• arcee-ai / DAM
  ☆38Updated this week
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆37Updated 4 months ago
• apple / ml-recurrent-drafter
  ☆96Updated last month
• Zyphra / Zyda_processing
  ☆26Updated 4 months ago
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆20Updated last year