sophgo/LLM-TPU external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

sophgo/LLM-TPU

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/sophgo/LLM-TPU)

Close

sophgo / LLM-TPUView on GitHubMore

• External links
• Readme badge

Run generative AI models in sophgo BM1684X/BM1688

☆312Sep 23, 2026Updated 2 weeks ago

Alternatives and similar repositories for LLM-TPU

Users that are interested in LLM-TPU are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• sophgo / sophon-demo

  View on GitHub
  ☆530Updated this week
• sophgo / tpu-mlir

  View on GitHub
  Machine learning compiler based on MLIR for Sophgo TPU.
  ☆997Updated this week
• wangyifan2018 / ChatDoc-TPU

  View on GitHub
  适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆13Jun 5, 2024Updated 2 years ago
• ZillaRU / ChatTTS-ONNX

  View on GitHub
  ChatTTS is a generative speech model for daily dialogue.
  ☆14Oct 21, 2024Updated last year
• sophgo / ChatGLM2-TPU

  View on GitHub
  run ChatGLM2-6B in BM1684X
  ☆49Mar 1, 2024Updated 2 years ago
• Open source password manager - Proton Pass • Ad
  Securely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
• sophgo / sophon-stream

  View on GitHub
  ☆142Jun 5, 2026Updated 4 months ago
• sophgo / libsophon

  View on GitHub
  Sophgo AI chips driver and runtime library.
  ☆28Sep 26, 2026Updated 2 weeks ago
• sophgo / ChatGLM3-TPU

  View on GitHub
  run chatglm3-6b in BM1684X
  ☆38Mar 1, 2024Updated 2 years ago
• wangyifan2018 / LangChain-Chatchat-TPU

  View on GitHub
  适用于sophon bm1684x的Langchain-Chatchat，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆18May 23, 2024Updated 2 years ago
• ZillaRU / EmotiVoice-TPU

  View on GitHub
  Text2speech & tone color conversion demo running on SG2300x 结合openvoice和emotivoice的TTS+即时克隆
  ☆22Oct 30, 2024Updated last year
• JKay0327 / whisper-TPU_py

  View on GitHub
  A whisper repo for TPU
  ☆11Jun 4, 2024Updated 2 years ago
• ZillaRU / SD-lcm-tpu

  View on GitHub
  Stable Diffusion+LCM在SG2300X上，纵享丝滑一秒出图
  ☆17Nov 29, 2024Updated last year
• wangzhaode / onnx-llm

  View on GitHub
  llm deploy project based onnx.
  ☆49Oct 9, 2024Updated 2 years ago
• sophgo / tdl_sdk

  View on GitHub
  ☆48Aug 24, 2026Updated last month
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• ZillaRU / roop_face

  View on GitHub
  使用SG2300X实现无瑕疵换脸
  ☆33Sep 2, 2024Updated 2 years ago
• sophgo / tpu_compiler

  View on GitHub
  cvitek ai compiler base on MLIR
  ☆23Mar 14, 2022Updated 4 years ago
• wangzhaode / llm-export

  View on GitHub
  llm-export can export llm model to onnx.
  ☆356May 8, 2026Updated 5 months ago
• Cambricon / triton-linalg

  View on GitHub
  Development repository for the Triton-Linalg conversion
  ☆225Feb 7, 2025Updated last year
• ZillaRU / AnnoAnything

  View on GitHub
  万物检测（零样本检测+识别） demo for SG2300X 【Recognize Anything + GroundingDINO】
  ☆24May 9, 2024Updated 2 years ago
• sophgo / sophon-tools

  View on GitHub
  sophon-tools（xun.li，mingxuan.che)
  ☆28Sep 24, 2026Updated 2 weeks ago
• foundation-model-stack / vllm-triton-backend

  View on GitHub
  A Triton-only attention backend for vLLM
  ☆28Jul 14, 2026Updated 2 months ago
• WALLE-AI / uReasoningLLMs

  View on GitHub
  Deepseek-r1复现科普与资源汇总
  ☆22Mar 5, 2025Updated last year
• LittleRain626 / rknn_yolov5_3588_bytetrack

  View on GitHub
  ☆31Jun 2, 2022Updated 4 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• jingzhunxue / flow_mirror

  View on GitHub
  flow mirror models from JZX AI Labs
  ☆43Sep 30, 2024Updated 2 years ago
• kelvin0207 / SparSynergy

  View on GitHub
  Open source RTL implementation of Tensor Core, Sparse Tensor Core, BitWave and SparSynergy in the article: "SparSynergy: Unlocking Flexib…
  ☆26Aug 29, 2026Updated last month
• vortexgpgpu / Volt

  View on GitHub
  ☆22Feb 9, 2026Updated 8 months ago
• AXERA-TECH / ax-llm

  View on GitHub
  Explore LLM model deployment based on AXera's AI chips, It provides OpenAI‑compatible APIs and supports AX620E, AX650 and AX637 series ch…
  ☆169Updated this week
• cherichy / tilecute

  View on GitHub
  ☆32Jul 2, 2025Updated last year
• airockchip / rknn-llm

  View on GitHub
  ☆1,712Sep 29, 2026Updated last week
• ZillaRU / VideoSearch-tpu

  View on GitHub
  基于SG2300X的视频检索【使用自然语言搜索视频内容，定位到符合描述的具体时间段】
  ☆13Feb 29, 2024Updated 2 years ago
• HPCRL / Ansor-AF-DS

  View on GitHub
  This repository contains the figures, tables and source code in the ICS'24 paper: "Accelerated Auto-Tuning of GPU Kernels for Tensor Comp…
  ☆10Dec 5, 2024Updated last year
• ZillaRU / AnnoSeg

  View on GitHub
  An auto-annotation demo running on SG2300X (YOLOv8/GroundingDINO + MobileSAM)
  ☆11Nov 30, 2023Updated 2 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• sophon-ai-algo / examples

  View on GitHub
  Examples for SophonSDK
  ☆107Aug 11, 2022Updated 4 years ago
• vortexgpgpu / pocl

  View on GitHub
  a clone of POCL that includes RISC-V newlib devices support and Vortex
  ☆49Updated this week
• 455670288 / rknn_face_landmarks_deploy

  View on GitHub
  基于rknn的官方Android项目rknn_yolov5_android_apk_demo进行修改，部署人脸检测模型retinaface和106人脸关键点检测模型，支持实时人脸检测。支持rk356x和rk3588设备npu推理。
  ☆25Mar 14, 2024Updated 2 years ago
• yhwang-hub / yolov5_QAT

  View on GitHub
  Quantize yolov5 using pytorch_quantization.🚀🚀🚀
  ☆15Oct 24, 2023Updated 2 years ago
• kyutai-labs / jax-flash-attn3

  View on GitHub
  JAX bindings for the flash-attention3 kernels
  ☆23Sep 9, 2026Updated last month
• mit-han-lab / spatten

  View on GitHub
  [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
  ☆141Aug 27, 2024Updated 2 years ago
• FeiGeChuanShu / trt2023

  View on GitHub
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆43Oct 20, 2023Updated 2 years ago