Run generative AI models in sophgo BM1684X/BM1688
☆297Aug 5, 2026Updated this week
Alternatives and similar repositories for LLM-TPU
Users that are interested in LLM-TPU are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆513Updated this week
- Machine learning compiler based on MLIR for Sophgo TPU.☆961Aug 4, 2026Updated last week
- 适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答☆13Jun 5, 2024Updated 2 years ago
- ChatTTS is a generative speech model for daily dialogue.☆14Oct 21, 2024Updated last year
- ☆141Jun 5, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Sophgo AI chips driver and runtime library.☆27Jul 27, 2026Updated 2 weeks ago
- run chatglm3-6b in BM1684X☆38Mar 1, 2024Updated 2 years ago
- 适用于sophon bm1684x的Langchain-Chatchat，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答☆18May 23, 2024Updated 2 years ago
- Text2speech & tone color conversion demo running on SG2300x 结合openvoice和emotivoice的TTS+即时克隆☆22Oct 30, 2024Updated last year
- Stable Diffusion+LCM在SG2300X上，纵享丝滑一秒出图☆17Nov 29, 2024Updated last year
- llm deploy project based onnx.☆49Oct 9, 2024Updated last year
- ☆47Jun 30, 2026Updated last month
- 使用SG2300X实现无瑕疵换脸☆33Sep 2, 2024Updated last year
- cvitek ai compiler base on MLIR☆23Mar 14, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- llm-export can export llm model to onnx.☆356May 8, 2026Updated 3 months ago
- Development repository for the Triton-Linalg conversion☆223Feb 7, 2025Updated last year
- 万物检测（零样本检测+识别） demo for SG2300X 【Recognize Anything + GroundingDINO】☆24May 9, 2024Updated 2 years ago
- sophon-tools（xun.li，mingxuan.che)☆25Updated this week
- A Triton-only attention backend for vLLM☆28Jul 14, 2026Updated 3 weeks ago
- ☆20May 12, 2026Updated 2 months ago
- Deepseek-r1复现科普与资源汇总☆22Mar 5, 2025Updated last year
- ☆31Jun 2, 2022Updated 4 years ago
- flow mirror models from JZX AI Labs☆43Sep 30, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Open source RTL implementation of Tensor Core, Sparse Tensor Core, BitWave and SparSynergy in the article: "SparSynergy: Unlocking Flexib…☆26Mar 29, 2025Updated last year
- ☆18Feb 9, 2026Updated 6 months ago
- Explore LLM model deployment based on AXera's AI chips☆164Updated this week
- ☆32Jul 2, 2025Updated last year
- ☆1,616Jun 17, 2026Updated last month
- ☆15Feb 5, 2020Updated 6 years ago
- 基于SG2300X的视频检索【使用自然语言搜索视频内容，定位到符合描述的具体时间段】☆13Feb 29, 2024Updated 2 years ago
- This repository contains the figures, tables and source code in the ICS'24 paper: "Accelerated Auto-Tuning of GPU Kernels for Tensor Comp…☆10Dec 5, 2024Updated last year
- An auto-annotation demo running on SG2300X (YOLOv8/GroundingDINO + MobileSAM)☆10Nov 30, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Examples for SophonSDK☆107Aug 11, 2022Updated 4 years ago
- a clone of POCL that includes RISC-V newlib devices support and Vortex☆49Jul 30, 2026Updated last week
- 基于rknn的官方Android项目rknn_yolov5_android_apk_demo进行修改，部署人脸检测模型retinaface和106人脸关键点检测模型，支持实时人脸检测。支持rk356x和rk3588设备npu推理。☆25Mar 14, 2024Updated 2 years ago
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆15Oct 24, 2023Updated 2 years ago
- JAX bindings for the flash-attention3 kernels☆23Jan 2, 2026Updated 7 months ago
- [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning☆137Aug 27, 2024Updated last year
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Oct 20, 2023Updated 2 years ago