Alternatives and similar repositories for LLMGPUMemEstimator

Users that are interested in LLMGPUMemEstimator are comparing it to the libraries listed below

• cavalierlulu / rag_survey
  ☆124Updated last year
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆150Updated last year
• CASIA-LM / ChineseWebText
  ☆169Updated last year
• RUCAIBox / EASYEP
  ☆18Updated 2 months ago
• RUC-GSAI / Llama-3-SynE
  Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …
  ☆33Updated 3 weeks ago
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆40Updated last year
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆57Updated last year
• IronBeliever / CaR
  Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
  ☆81Updated 7 months ago
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆44Updated last year
• keezen / ntk_alibi
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆68Updated last year
• aplmikex / deduplication_mnbvc
  文本去重
  ☆72Updated last year
• RUC-GSAI / Yulan-GARDEN
  Official Repository for SIGIR2024 Demo Paper "An Integrated Data Processing Framework for Pretraining Foundation Models"
  ☆81Updated 9 months ago
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆63Updated 4 months ago
• OpenMOSS / HalluQA
  Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"
  ☆131Updated last year
• akaihaoshuai / baby-llama2-chinese_cybertron
  使用单个24G显卡，从0开始训练LLM
  ☆55Updated last month
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated last year
• thu-coai / CritiqueLLM
  ☆142Updated 11 months ago
• FlagOpen / Infinity-Instruct
  ☆48Updated last year
• sugarandgugu / Simple-Trl-Training
  基于DPO算法微调语言大模型，简单好上手。
  ☆39Updated 11 months ago
• mutonix / RefGPT
  ☆97Updated last year
• MikeGu721 / EasyLLM
  make LLM easier to use
  ☆59Updated last year
• Felixgithub2017 / MMCU
  MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING
  ☆87Updated last year
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆160Updated this week
• CSHaitao / ChatGLM_mutli_gpu_tuning
  deepspeed+trainer简单高效实现多卡微调大模型
  ☆126Updated 2 years ago
• DA-southampton / RedGPT
  ☆63Updated 2 years ago
• LydiaXiaohongLi / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆19Updated last year
• CASIA-LM / MoDS
  ☆141Updated last year
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆96Updated last year
• l294265421 / alpaca-rlhf
  Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat
  ☆114Updated 2 years ago