KaihuaTang / LLM-TP-Inference-on-910BLinks
本项目提供了基于910B的huggingface LLM模型的Tensor Parallel(TP)部署教程，同时也可以作为一份极简的TP学习代码。
☆24Updated 8 months ago
Alternatives and similar repositories for LLM-TP-Inference-on-910B
Users that are interested in LLM-TP-Inference-on-910B are comparing it to the libraries listed below
Sorting:
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated 8 months ago
- ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory☆95Updated last month
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding☆47Updated 5 months ago
- DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）☆164Updated last year
- ☆25Updated 2 months ago
- MLLM @ Game☆14Updated 3 weeks ago
- Pretrain、decay、SFT a CodeLLM from scratch 🧙♂️☆35Updated last year
- ☆60Updated 2 weeks ago
- ☆39Updated this week
- Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)☆16Updated last year
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆69Updated 3 months ago
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain☆104Updated last year
- Xtuner Factory☆33Updated last year
- The official repository for the Scientific Paper Idea Proposer (SciPIP)☆62Updated 3 months ago
- qwen-nsa☆66Updated last month
- Repository for the NeurIPS 2024 paper "SearchLVLMs: A Plug-and-Play Framework for Augmenting Large Vision-Language Models by Searching Up…☆24Updated 5 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆103Updated last week
- ☆102Updated last month
- 从零到一实现了一个多模态大模型，并命名为Reyes（睿视），R：睿，eyes：眼。Reyes的参数量为8B，视觉编码器使用的是InternViT-300M-448px-V2_5,语言模型侧使用的是Qwen2.5-7B-Instruct，Reyes也通过一个两层MLP投影层连…☆13Updated 3 months ago
- WanJuan-CC是以CommonCrawl为基础，经过数据抽取，规则清洗，去重，安全过滤，质量清洗等步骤得到的高质量数据。☆13Updated last year
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆59Updated 9 months ago
- Token level visualization tools for large language models☆81Updated 4 months ago
- ☆28Updated last year
- 本项目使用LLaVA 1.6多模态模型实现以文搜图和以图搜图功能。☆23Updated last year
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆127Updated last month
- ✨✨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆136Updated 3 weeks ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆132Updated 11 months ago
- Parameter-Efficient Fine-Tuning for Foundation Models☆65Updated 2 months ago
- ICLR 2025☆26Updated 2 weeks ago
- Efficient Mixture of Experts for LLM Paper List☆68Updated 5 months ago