Alternatives and similar repositories for gradient-accumulation-blog:

Users that are interested in gradient-accumulation-blog are comparing it to the libraries listed below

• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated last year
• v-prgmr / mergekit
  Tools for merging pretrained large language models.
  ☆19Updated 9 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated last month
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• cedrickchee / llama
  Inference code for LLaMA 2 models
  ☆30Updated 8 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆41Updated last year
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆66Updated this week
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆46Updated last year
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆40Updated last year
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆34Updated last year
• pygongnlp / CoSearchAgent
  [SIGIR 2024 (Demo)] CoSearchAgent: A Lightweight Collborative Search Agent with Large Language Models
  ☆23Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated 11 months ago
• aniketmaurya / llm-inference
  Large Language Model (LLM) Inference API and Chatbot
  ☆125Updated last year
• mzbac / qlora-inference-multi-gpu
  ☆12Updated last year
• geronimi73 / 3090_shorts
  minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆38Updated last week
• kyegomez / Finetuning-Suite
  Finetune any model on HF in less than 30 seconds
  ☆58Updated 2 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 8 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• pacman100 / peft-codegen-25
  ☆24Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆40Updated last month
• wangitu / Ada-Instruct
  ☆17Updated 11 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• mobarski / alpaca-libre
  Reimplementation of the task generation part from the Alpaca paper
  ☆119Updated 2 years ago
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆21Updated last year
• philschmid / optimum-static-quantization
  ☆28Updated last year