pp1230 / LLMGPUMemEstimator
The GPU RAM Estimator provides a simple tool for estimating GPU memory usage during training and inference.
☆33Updated 11 months ago
Alternatives and similar repositories for LLMGPUMemEstimator:
Users that are interested in LLMGPUMemEstimator are comparing it to the libraries listed below
- Fantastic Data Engineering for Large Language Models☆85Updated 3 months ago
- 怎么训练一个LLM分词器☆142Updated last year
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆40Updated last year
- ☆97Updated last year
- ☆45Updated 9 months ago
- ☆122Updated last year
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆56Updated 11 months ago
- Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models☆62Updated last month
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆32Updated 3 months ago
- 使用单个24G显卡,从0开始训练LLM☆50Updated 5 months ago
- Imitate OpenAI with Local Models☆88Updated 7 months ago
- ☆84Updated last year
- 基于DPO算法微调语言大模型,简单好上手。☆35Updated 9 months ago
- ☆166Updated last year
- SuperCLUE-Math6:新一代中文原生多轮多步数学推理数据集的探索之旅☆53Updated last year
- NTK scaled version of ALiBi position encoding in Transformer.