Alternatives and similar repositories for llm-training-calculator:

Users that are interested in llm-training-calculator are comparing it to the libraries listed below

• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆343Updated 2 months ago
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆144Updated last year
• cavalierlulu / rag_survey
  ☆123Updated last year
• hengjiUSTC / learn-llm
  ☆107Updated 5 months ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆268Updated this week
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆243Updated last week
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated last year
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆240Updated 5 months ago
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆63Updated 7 months ago
• LLaMafia / llamafia.github
  ☆318Updated 9 months ago
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆95Updated last year
• sunkx109 / llama
  Inference code for LLaMA models
  ☆120Updated last year
• CASIA-LM / ChineseWebText
  ☆168Updated last year
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆62Updated last year
• pp1230 / LLMGPUMemEstimator
  The GPU RAM Estimator provides a simple tool for estimating GPU memory usage during training and inference.
  ☆33Updated last year
• thu-coai / CritiqueLLM
  ☆143Updated 9 months ago
• mindspore-lab / mindformers
  ☆161Updated 2 weeks ago
• llm-factory / LLaMA-Factory-Doc
  LLaMA Factory Document
  ☆121Updated last week
• LLMServe / DistServe
  Disaggregated serving system for Large Language Models (LLMs).
  ☆562Updated 3 weeks ago
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆321Updated 7 months ago
• RUC-GSAI / Yulan-GARDEN
  Official Repository for SIGIR2024 Demo Paper "An Integrated Data Processing Framework for Pretraining Foundation Models"
  ☆77Updated 8 months ago
• QwenLM / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆135Updated 4 months ago
• sanowl / OmegaPRM
  this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…
  ☆28Updated 3 weeks ago
• OpenMOSS / HalluQA
  Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"
  ☆124Updated 10 months ago
• madsys-dev / deepseekv2-profile
  ☆131Updated last month
• MoFHeka / LLaMA-Megatron
  A LLaMA1/LLaMA12 Megatron implement.
  ☆28Updated last year
• SkyworkAI / skywork-o1-prm-inference
  ☆63Updated 5 months ago
• IronBeliever / CaR
  Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
  ☆78Updated 5 months ago
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆382Updated this week
• mindspore-lab / mindrlhf
  ☆33Updated 4 months ago