sophgo/LLM-TPU external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

sophgo/LLM-TPU

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/sophgo/LLM-TPU)

Close

sophgo / LLM-TPUView on GitHubMore

• External links
• Readme badge

Run generative AI models in sophgo BM1684X/BM1688

☆284May 27, 2026Updated this week

Alternatives and similar repositories for LLM-TPU

Users that are interested in LLM-TPU are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• sophgo / sophon-demo

  View on GitHub
  ☆490Updated this week
• sophgo / tpu-mlir

  View on GitHub
  Machine learning compiler based on MLIR for Sophgo TPU.
  ☆921May 11, 2026Updated 2 weeks ago
• wangyifan2018 / ChatDoc-TPU

  View on GitHub
  适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆13Jun 5, 2024Updated last year
• ZillaRU / ChatTTS-ONNX

  View on GitHub
  ChatTTS is a generative speech model for daily dialogue.
  ☆14Oct 21, 2024Updated last year
• sophgo / ChatGLM2-TPU

  View on GitHub
  run ChatGLM2-6B in BM1684X
  ☆49Mar 1, 2024Updated 2 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• sophgo / sophon-stream

  View on GitHub
  ☆140May 13, 2026Updated 2 weeks ago
• sophgo / libsophon

  View on GitHub
  Sophgo AI chips driver and runtime library.
  ☆24May 19, 2026Updated last week
• ZillaRU / EmotiVoice-TPU

  View on GitHub
  Text2speech & tone color conversion demo running on SG2300x 结合openvoice和emotivoice的TTS+即时克隆
  ☆22Oct 30, 2024Updated last year
• sophgo / ChatGLM3-TPU

  View on GitHub
  run chatglm3-6b in BM1684X
  ☆39Mar 1, 2024Updated 2 years ago
• wangyifan2018 / LangChain-Chatchat-TPU

  View on GitHub
  适用于sophon bm1684x的Langchain-Chatchat，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆18May 23, 2024Updated 2 years ago
• JKay0327 / whisper-TPU_py

  View on GitHub
  A whisper repo for TPU
  ☆11Jun 4, 2024Updated last year
• ZillaRU / SD-lcm-tpu

  View on GitHub
  Stable Diffusion+LCM在SG2300X上，纵享丝滑一秒出图
  ☆17Nov 29, 2024Updated last year
• wangzhaode / onnx-llm

  View on GitHub
  llm deploy project based onnx.
  ☆49Oct 9, 2024Updated last year
• ZillaRU / roop_face

  View on GitHub
  使用SG2300X实现无瑕疵换脸
  ☆33Sep 2, 2024Updated last year
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• sophgo / tpu_compiler

  View on GitHub
  cvitek ai compiler base on MLIR
  ☆23Mar 14, 2022Updated 4 years ago
• wangzhaode / llm-export

  View on GitHub
  llm-export can export llm model to onnx.
  ☆352May 8, 2026Updated 3 weeks ago
• kyutai-labs / jax-flash-attn3

  View on GitHub
  JAX bindings for the flash-attention3 kernels
  ☆22Jan 2, 2026Updated 4 months ago
• airockchip / rknn-llm

  View on GitHub
  ☆1,464Mar 12, 2026Updated 2 months ago
• AXERA-TECH / ax-llm

  View on GitHub
  Explore LLM model deployment based on AXera's AI chips
  ☆151May 19, 2026Updated last week
• sophgo / sophon-tools

  View on GitHub
  sophon-tools（xun.li，mingxuan.che)
  ☆21May 19, 2026Updated last week
• Cambricon / triton-linalg

  View on GitHub
  Development repository for the Triton-Linalg conversion
  ☆219Feb 7, 2025Updated last year
• ZillaRU / AnnoAnything

  View on GitHub
  万物检测（零样本检测+识别） demo for SG2300X 【Recognize Anything + GroundingDINO】
  ☆24May 9, 2024Updated 2 years ago
• sophgo / sophon_ffmpeg

  View on GitHub
  ☆20May 12, 2026Updated 2 weeks ago
• End-to-end encrypted cloud storage - Proton Drive • Ad
  Special offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
• WALLE-AI / uReasoningLLMs

  View on GitHub
  Deepseek-r1复现科普与资源汇总
  ☆22Mar 5, 2025Updated last year
• jingzhunxue / flow_mirror

  View on GitHub
  flow mirror models from JZX AI Labs
  ☆43Sep 30, 2024Updated last year
• LittleRain626 / rknn_yolov5_3588_bytetrack

  View on GitHub
  ☆30Jun 2, 2022Updated 3 years ago
• airockchip / rknn-toolkit2

  View on GitHub
  ☆3,003Jul 29, 2025Updated 10 months ago
• airockchip / rknn_model_zoo

  View on GitHub
  ☆2,497Apr 9, 2025Updated last year
• HuaweiAtlas / samples

  View on GitHub
  ☆15Feb 5, 2020Updated 6 years ago
• yhinai / TensorGPGPU

  View on GitHub
  RISC-V vector and tensor compute extensions for Vortex GPGPU acceleration for ML workloads. Optimized for transformer models, CNNs, and g…
  ☆23Apr 25, 2025Updated last year
• ZillaRU / VideoSearch-tpu

  View on GitHub
  基于SG2300X的视频检索【使用自然语言搜索视频内容，定位到符合描述的具体时间段】
  ☆13Feb 29, 2024Updated 2 years ago
• ZillaRU / AnnoSeg

  View on GitHub
  An auto-annotation demo running on SG2300X (YOLOv8/GroundingDINO + MobileSAM)
  ☆10Nov 30, 2023Updated 2 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• vortexgpgpu / pocl

  View on GitHub
  a clone of POCL that includes RISC-V newlib devices support and Vortex
  ☆49May 20, 2026Updated last week
• sophon-ai-algo / examples

  View on GitHub
  Examples for SophonSDK
  ☆107Aug 11, 2022Updated 3 years ago
• 455670288 / rknn_face_landmarks_deploy

  View on GitHub
  基于rknn的官方Android项目rknn_yolov5_android_apk_demo进行修改，部署人脸检测模型retinaface和106人脸关键点检测模型，支持实时人脸检测。支持rk356x和rk3588设备npu推理。
  ☆25Mar 14, 2024Updated 2 years ago
• yhwang-hub / yolov5_QAT

  View on GitHub
  Quantize yolov5 using pytorch_quantization.🚀🚀🚀
  ☆15Oct 24, 2023Updated 2 years ago
• cornell-zhang / allo-pldi24-artifact

  View on GitHub
  Artifact evaluation of PLDI'24 paper "Allo: A Programming Model for Composable Accelerator Design"
  ☆34Apr 11, 2024Updated 2 years ago
• buddy-compiler / buddy-mlir

  View on GitHub
  An MLIR-based compiler framework bridges DSLs (domain-specific languages) to DSAs (domain-specific architectures).
  ☆721May 21, 2026Updated last week
• ModelTC / LightCompress

  View on GitHub
  [EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
  ☆715May 14, 2026Updated 2 weeks ago