KaihuaTang / LLM-TP-Inference-on-910B
本项目提供了基于910B的huggingface LLM模型的Tensor Parallel(TP)部署教程，同时也可以作为一份极简的TP学习代码。
☆21Updated 7 months ago
Alternatives and similar repositories for LLM-TP-Inference-on-910B:
Users that are interested in LLM-TP-Inference-on-910B are comparing it to the libraries listed below
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated 6 months ago
- Repository for the NeurIPS 2024 paper "SearchLVLMs: A Plug-and-Play Framework for Augmenting Large Vision-Language Models by Searching Up…☆22Updated 4 months ago
- Moved to https://github.com/NUS-HPC-AI-Lab/InfoBatch☆6Updated last year
- Parameter-Efficient Fine-Tuning for Foundation Models☆57Updated 3 weeks ago
- ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory☆91Updated 2 weeks ago
- ☆51Updated this week
- Precision Search through Multi-Style Inputs☆68Updated this week
- GIFT: Generative Interpretable Fine-Tuning☆20Updated 6 months ago
- ☆29Updated 2 weeks ago
- minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora☆41Updated last year
- WanJuan-CC是以CommonCrawl为基础，经过数据抽取，规则清洗，去重，安全过滤，质量清洗等步骤得到的高质量数据。☆13Updated last year
- [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"☆17Updated 6 months ago
- ☆82Updated 11 months ago
- This is the official repo for ByteVideoLLM/Dynamic-VLM☆20Updated 4 months ago
- [CVPR 2025] DynRefer: Delving into Region-level Multimodal Tasks via Dynamic Resolution☆46Updated last month
- 一个mmcv 的logger hook, 可以用来把模型结果推送到微信上☆20Updated 2 years ago
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding☆44Updated 4 months ago
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆54Updated 7 months ago
- MLLM @ Game☆11Updated 3 weeks ago
- This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).☆37Updated 6 months ago
- The official repository for the Scientific Paper Idea Proposer (SciPIP)☆63Updated last month
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆60Updated 5 months ago
- LMM solved catastrophic forgetting, AAAI2025☆40Updated last week
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆46Updated 11 months ago
- ☆54Updated 8 months ago
- ☆10Updated 3 months ago
- ☆20Updated last year
- This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …☆39Updated 6 months ago
- Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines☆123Updated 5 months ago
- Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)☆12Updated 11 months ago