sophgo/LLM-TPU external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

sophgo/LLM-TPU

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/sophgo/LLM-TPU)

Close

sophgo / LLM-TPUView on GitHubMore

• External links
• Readme badge

Run generative AI models in sophgo BM1684X/BM1688

☆308Sep 17, 2026Updated this week

Alternatives and similar repositories for LLM-TPU

Users that are interested in LLM-TPU are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• sophgo / sophon-demo

  View on GitHub
  ☆528Updated this week
• sophgo / tpu-mlir

  View on GitHub
  Machine learning compiler based on MLIR for Sophgo TPU.
  ☆982Aug 31, 2026Updated 2 weeks ago
• wangyifan2018 / ChatDoc-TPU

  View on GitHub
  适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆13Jun 5, 2024Updated 2 years ago
• ZillaRU / ChatTTS-ONNX

  View on GitHub
  ChatTTS is a generative speech model for daily dialogue.
  ☆14Oct 21, 2024Updated last year
• sophgo / ChatGLM2-TPU

  View on GitHub
  run ChatGLM2-6B in BM1684X
  ☆49Mar 1, 2024Updated 2 years ago
• Serverless GPU API endpoints on Runpod - Get Bonus Credits • Ad
  Skip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
• sophgo / sophon-stream

  View on GitHub
  ☆141Jun 5, 2026Updated 3 months ago
• sophgo / libsophon

  View on GitHub
  Sophgo AI chips driver and runtime library.
  ☆27Aug 10, 2026Updated last month
• sophgo / ChatGLM3-TPU

  View on GitHub
  run chatglm3-6b in BM1684X
  ☆38Mar 1, 2024Updated 2 years ago
• wangyifan2018 / LangChain-Chatchat-TPU

  View on GitHub
  适用于sophon bm1684x的Langchain-Chatchat，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆18May 23, 2024Updated 2 years ago
• ZillaRU / EmotiVoice-TPU

  View on GitHub
  Text2speech & tone color conversion demo running on SG2300x 结合openvoice和emotivoice的TTS+即时克隆
  ☆22Oct 30, 2024Updated last year
• JKay0327 / whisper-TPU_py

  View on GitHub
  A whisper repo for TPU
  ☆11Jun 4, 2024Updated 2 years ago
• ZillaRU / SD-lcm-tpu

  View on GitHub
  Stable Diffusion+LCM在SG2300X上，纵享丝滑一秒出图
  ☆17Nov 29, 2024Updated last year
• wangzhaode / onnx-llm

  View on GitHub
  llm deploy project based onnx.
  ☆49Oct 9, 2024Updated last year
• sophgo / tdl_sdk

  View on GitHub
  ☆48Aug 24, 2026Updated 3 weeks ago
• GPUs on demand by Runpod - Special Offer Available • Ad
  Run AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
• ZillaRU / roop_face

  View on GitHub
  使用SG2300X实现无瑕疵换脸
  ☆33Sep 2, 2024Updated 2 years ago
• sophgo / tpu_compiler

  View on GitHub
  cvitek ai compiler base on MLIR
  ☆23Mar 14, 2022Updated 4 years ago
• wangzhaode / llm-export

  View on GitHub
  llm-export can export llm model to onnx.
  ☆357May 8, 2026Updated 4 months ago
• Cambricon / triton-linalg

  View on GitHub
  Development repository for the Triton-Linalg conversion
  ☆225Feb 7, 2025Updated last year
• ZillaRU / AnnoAnything

  View on GitHub
  万物检测（零样本检测+识别） demo for SG2300X 【Recognize Anything + GroundingDINO】
  ☆24May 9, 2024Updated 2 years ago
• sophgo / sophon-tools

  View on GitHub
  sophon-tools（xun.li，mingxuan.che)
  ☆27Updated this week
• foundation-model-stack / vllm-triton-backend

  View on GitHub
  A Triton-only attention backend for vLLM
  ☆28Jul 14, 2026Updated 2 months ago
• sophgo / sophon_ffmpeg

  View on GitHub
  ☆21May 12, 2026Updated 4 months ago
• WALLE-AI / uReasoningLLMs

  View on GitHub
  Deepseek-r1复现科普与资源汇总
  ☆22Mar 5, 2025Updated last year
• Simple, predictable pricing with DigitalOcean hosting • Ad
  Always know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
• LittleRain626 / rknn_yolov5_3588_bytetrack

  View on GitHub
  ☆31Jun 2, 2022Updated 4 years ago
• jingzhunxue / flow_mirror

  View on GitHub
  flow mirror models from JZX AI Labs
  ☆43Sep 30, 2024Updated last year
• kelvin0207 / SparSynergy

  View on GitHub
  Open source RTL implementation of Tensor Core, Sparse Tensor Core, BitWave and SparSynergy in the article: "SparSynergy: Unlocking Flexib…
  ☆26Aug 29, 2026Updated 3 weeks ago
• vortexgpgpu / Volt

  View on GitHub
  ☆19Feb 9, 2026Updated 7 months ago
• AXERA-TECH / ax-llm

  View on GitHub
  Explore LLM model deployment based on AXera's AI chips, It provides OpenAI‑compatible APIs and supports AX620E, AX650 and AX637 series ch…
  ☆169Sep 9, 2026Updated last week
• cherichy / tilecute

  View on GitHub
  ☆32Jul 2, 2025Updated last year
• airockchip / rknn-llm

  View on GitHub
  ☆1,682Jun 17, 2026Updated 3 months ago
• HuaweiAtlas / samples

  View on GitHub
  ☆15Feb 5, 2020Updated 6 years ago
• ZillaRU / VideoSearch-tpu

  View on GitHub
  基于SG2300X的视频检索【使用自然语言搜索视频内容，定位到符合描述的具体时间段】
  ☆13Feb 29, 2024Updated 2 years ago
• Open source password manager - Proton Pass • Ad
  Securely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
• HPCRL / Ansor-AF-DS

  View on GitHub
  This repository contains the figures, tables and source code in the ICS'24 paper: "Accelerated Auto-Tuning of GPU Kernels for Tensor Comp…
  ☆10Dec 5, 2024Updated last year
• ZillaRU / AnnoSeg

  View on GitHub
  An auto-annotation demo running on SG2300X (YOLOv8/GroundingDINO + MobileSAM)
  ☆10Nov 30, 2023Updated 2 years ago
• sophon-ai-algo / examples

  View on GitHub
  Examples for SophonSDK
  ☆107Aug 11, 2022Updated 4 years ago
• vortexgpgpu / pocl

  View on GitHub
  a clone of POCL that includes RISC-V newlib devices support and Vortex
  ☆49Jul 30, 2026Updated last month
• 455670288 / rknn_face_landmarks_deploy

  View on GitHub
  基于rknn的官方Android项目rknn_yolov5_android_apk_demo进行修改，部署人脸检测模型retinaface和106人脸关键点检测模型，支持实时人脸检测。支持rk356x和rk3588设备npu推理。
  ☆25Mar 14, 2024Updated 2 years ago
• yhwang-hub / yolov5_QAT

  View on GitHub
  Quantize yolov5 using pytorch_quantization.🚀🚀🚀
  ☆15Oct 24, 2023Updated 2 years ago
• kyutai-labs / jax-flash-attn3

  View on GitHub
  JAX bindings for the flash-attention3 kernels
  ☆23Sep 9, 2026Updated last week