Alternatives and similar repositories for llama.cpp.qwen2vl:

Users that are interested in llama.cpp.qwen2vl are comparing it to the libraries listed below

• tc-mb / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆92Updated this week
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆72Updated 11 months ago
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆43Updated 9 months ago
• 1694439208 / GOT-OCR-Inference
  研究GOT-OCR-项目落地加速，不限语言
  ☆59Updated 5 months ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆41Updated last year
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆131Updated last month
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆87Updated 2 weeks ago
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆49Updated last year
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated 10 months ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆35Updated 5 months ago
• infinigence / Infini-Megrez-Omni
  ☆218Updated last month
• owenliang / DeepSeek-Distill-Qwen-For-Child
  ☆30Updated 3 weeks ago
• lovemefan / ggml-learning-notes
  ggml学习笔记，ggml是一个机器学习的推理框架
  ☆14Updated last year
• Tlntin / qwen-ascend-llm
  ☆39Updated 5 months ago
• AXERA-TECH / CLIP-ONNX-AX650-CPP
  ☆25Updated 3 months ago
• ZHEQIUSHUI / SAM-ONNX-AX650-CPP
  SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。
  ☆46Updated last year
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆46Updated last year
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• DataXujing / TensorRT-LLM-ChatGLM3
  大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM
  ☆26Updated last year
• morsoli / llmbenchmark
  大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
  ☆16Updated 6 months ago
• BestAnHongjun / LMDeploy-Jetson
  Deploying LLMs offline on the NVIDIA Jetson platform marks the dawn of a new era in embodied intelligence, where devices can function ind…
  ☆89Updated last year
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated 11 months ago
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆53Updated 9 months ago
• richjjj / cuvid-tensorrt-multi
  ffmpeg+cuvid+tensorrt+multicamera
  ☆12Updated 3 months ago
• daquexian / faster-rwkv
  ☆124Updated last year
• cqu20160901 / FastSAM_onnx_rknn
  FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。
  ☆18Updated 10 months ago
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆67Updated 8 months ago
• futz12 / ncnn_ppstructure_table
  A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル
  ☆18Updated last month
• SUSTech-IDEA / SUS-Chat
  SUS-Chat: Instruction tuning done right
  ☆48Updated last year