KaihuaTang / LLM-TP-Inference-on-910BLinks
本项目提供了基于910B的huggingface LLM模型的Tensor Parallel(TP)部署教程，同时也可以作为一份极简的TP学习代码。
☆30Updated last month
Alternatives and similar repositories for LLM-TP-Inference-on-910B
Users that are interested in LLM-TP-Inference-on-910B are comparing it to the libraries listed below
Sorting:
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated last year
- 2025.01：从零到一实现了一个多模态大模型，并命名为Reyes（睿视），R：睿，eyes：眼。Reyes的参数量为8B，视觉编码器使用的是InternViT-300M-448px-V2_5,语言模型侧使用的是Qwen2.5-7B-Instruct，Reyes也通过一个两…☆30Updated last week
- ☆112Updated 7 months ago
- ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]☆200Updated 6 months ago
- ☆29Updated last year
- SFT+RL boosts multimodal reasoning☆45Updated 7 months ago
- ☆213Updated last month
- MLLM @ Game☆16Updated 9 months ago
- RLLaVA is a user-friendly framework for multi-modal RL research and optimized for resource-constrained teams.☆54Updated last week
- pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用☆129Updated last year
- Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)☆18Updated last year
- Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.☆84Updated 3 months ago
- "what, how, where, and how well? a survey on test-time scaling in large language models" repository☆86Updated this week
- (ICLR 2026) Unveiling Super Experts in Mixture-of-Experts Large Language Models☆35Updated 4 months ago
- Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines☆130Updated last year
- The official repository for the Scientific Paper Idea Proposer (SciPIP)☆67Updated 11 months ago
- DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）☆187Updated 2 years ago
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆147Updated 10 months ago
- ☆90Updated last year
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain☆106Updated last year
- DELT: Data Efficacy for Language Model Training☆43Updated this week
- ☆74Updated 8 months ago
- Build a daily academic subscription pipeline! Get daily Arxiv papers and corresponding chatGPT summaries with pre-defined keywords. It is…☆46Updated 2 years ago
- [SCIS] MULTI-Benchmark: Multimodal Understanding Leaderboard with Text and Images☆44Updated 2 months ago
- Official code for ICLR 2024 paper "Do Generated Data Always Help Contrastive Learning?"☆31Updated last year
- Parameter-Efficient Fine-Tuning for Foundation Models☆110Updated 10 months ago
- An efficient multi-modal instruction-following data synthesis tool and the official implementation of Oasis https://arxiv.org/abs/2503.08…☆37Updated 8 months ago
- SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Reward☆91Updated 6 months ago
- ☆52Updated 2 weeks ago
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆171Updated 2 weeks ago