Alternatives and similar repositories for fine-tune-qwen2-vl-with-llama-factory:

Users that are interested in fine-tune-qwen2-vl-with-llama-factory are comparing it to the libraries listed below

• philschmid / huggingface-inferentia2-samples
  ☆10Updated 7 months ago
• LLM-inference-router / vllm-router
  vLLM Router
  ☆17Updated 10 months ago
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated 9 months ago
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆20Updated 3 years ago
• aws-samples / solution-for-deploying-dify-on-aws
  ☆20Updated last week
• triple-Mu / Stable-Diffusion-TensorRT
  Stable Diffusion in TensorRT 8.5+
  ☆14Updated last year
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆41Updated 7 months ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆41Updated last year
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆45Updated last year
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆80Updated last week
• aws-samples / llm_model_hub
  ☆25Updated this week
• aws-samples / llm-gateway
  ☆25Updated last month
• CactusQ / TensorRT-LLM-Tutorial
  Getting started with TensorRT-LLM using BLOOM as a case study
  ☆13Updated 10 months ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆17Updated 2 weeks ago
• kyegomez / TinyGPTV
  Simple Implementation of TinyGPTV in super simple Zeta lego blocks
  ☆15Updated 2 months ago
• aws-samples / evaluating-large-language-models-using-llm-as-a-judge
  ☆12Updated last week
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆48Updated last year
• substratusai / vllm-docker
  ☆49Updated 2 weeks ago
• NVIDIA / tao_tensorflow1_backend
  TAO Toolkit deep learning networks with TensorFlow 1.x backend
  ☆13Updated 11 months ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆12Updated 5 months ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆81Updated 2 months ago
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆46Updated 6 months ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.
  ☆27Updated 2 months ago
• AXERA-TECH / CLIP-ONNX-AX650-CPP
  ☆21Updated 3 weeks ago
• DataXujing / TensorRT-LLM-ChatGLM3
  大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM
  ☆26Updated 10 months ago
• Bruce-Lee-LY / cutlass_gemm
  Multiple GEMM operators are constructed with cutlass to support LLM inference.
  ☆16Updated 3 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆79Updated this week
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated 7 months ago
• yinuotxie / Efficient-LLM-Inferencing-on-GPUs
  Penn CIS 5650 (GPU Programming and Architecture) Final Project
  ☆26Updated last year
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆30Updated 2 months ago