Alternatives and similar repositories for LMDeploy-Jetson

Users that are interested in LMDeploy-Jetson are comparing it to the libraries listed below

• BestAnHongjun / InternDog
  基于InternLM2大模型的离线具身智能导盲犬
  ☆101Updated last year
• RethinkFun / trian_ppo
  ☆82Updated 8 months ago
• AI-Study-Han / Zero-Qwen-VL
  训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。
  ☆61Updated 9 months ago
• yinghuo302 / ascend-llm
  基于昇腾310芯片的大语言模型部署
  ☆18Updated last year
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆48Updated last year
• DeepLink-org / dlinfer
  ☆51Updated last week
• D-Robotics-AI-Lab / DOSOD
  A Light-Weight Framework for Open-Set Object Detection with Decoupled Feature Alignment in Joint Space
  ☆86Updated 5 months ago
• sesmfs / onnx_quant_tool
  An onnx-based quantitation tool.
  ☆71Updated last year
• DataXujing / TensorRT-LLM-ChatGLM3
  大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM
  ☆26Updated last year
• xzyun2011 / wulewule
  基于InterLM的《黑神话：悟空》AI小助手，了解更多背后的故事--在更新视频中
  ☆31Updated 5 months ago
• Tlntin / qwen-ascend-llm
  ☆44Updated 7 months ago
• lucasjinreal / Namo-R1
  A CPU Realtime VLM in 500M. Surpassed Moondream2 and SmolVLM. Training from scratch with ease.
  ☆213Updated 2 months ago
• ICT-ANS / StarLight
  ☆60Updated 11 months ago
• TencentARC / mllm-npu
  mllm-npu: training multimodal large language models on Ascend NPUs
  ☆90Updated 9 months ago
• hopef / llama3_chat
  Llama3 Streaming Chat Sample
  ☆22Updated last year
• thb1314 / mmyolo_tensorrt
  ☆139Updated last year
• ruikangliu / FlatQuant
  [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"
  ☆138Updated last month
• infinigence / Infini-Megrez-Omni
  ☆233Updated 4 months ago
• BooHwang / segment_anything_tensorrt
  Accelerate segment anything model inference using Tensorrt 8.6.1.6
  ☆93Updated last year
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆128Updated last week
• AXERA-TECH / OWLVIT-ONNX-AX650-CPP
  ☆22Updated last year
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆295Updated 5 months ago
• linkangheng / PR1
  Official code implementation of Perception R1: Pioneering Perception Policy with Reinforcement Learning
  ☆206Updated 2 weeks ago
• owenliang / mnist-onnx-runtime
  MoE model with onnx runtime
  ☆45Updated last year
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆35Updated 5 months ago
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆142Updated 2 weeks ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• datawhalechina / ai-hardware-robotics
  ☆40Updated last week
• ModelTC / llmc
  [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a V…
  ☆492Updated this week