Run generative AI models in sophgo BM1684X/BM1688
☆292Jul 4, 2026Updated this week
Alternatives and similar repositories for LLM-TPU
Users that are interested in LLM-TPU are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆501Updated this week
- Machine learning compiler based on MLIR for Sophgo TPU.☆942Updated this week
- 适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答☆13Jun 5, 2024Updated 2 years ago
- run ChatGLM2-6B in BM1684X☆49Mar 1, 2024Updated 2 years ago
- ☆141Jun 5, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Sophgo AI chips driver and runtime library.☆24Jun 30, 2026Updated last week
- Text2speech & tone color conversion demo running on SG2300x 结合openvoice和emotivoice的TTS+即时克隆☆22Oct 30, 2024Updated last year
- run chatglm3-6b in BM1684X☆39Mar 1, 2024Updated 2 years ago
- A whisper repo for TPU☆11Jun 4, 2024Updated 2 years ago
- Stable Diffusion+LCM在SG2300X上，纵享丝滑一秒出图☆17Nov 29, 2024Updated last year
- llm deploy project based onnx.☆49Oct 9, 2024Updated last year
- 使用SG2300X实现无瑕疵换脸☆33Sep 2, 2024Updated last year
- cvitek ai compiler base on MLIR☆23Mar 14, 2022Updated 4 years ago
- llm-export can export llm model to onnx.☆353May 8, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- JAX bindings for the flash-attention3 kernels☆23Jan 2, 2026Updated 6 months ago
- ☆1,562Jun 17, 2026Updated 3 weeks ago
- sophon-tools（xun.li，mingxuan.che)☆24Jun 23, 2026Updated 2 weeks ago
- Explore LLM model deployment based on AXera's AI chips☆158Updated this week
- Development repository for the Triton-Linalg conversion☆222Feb 7, 2025Updated last year
- 万物检测（零样本检测+识别） demo for SG2300X 【Recognize Anything + GroundingDINO】☆24May 9, 2024Updated 2 years ago
- ☆20May 12, 2026Updated last month
- Deepseek-r1复现科普与资源汇总☆22Mar 5, 2025Updated last year
- flow mirror models from JZX AI Labs☆43Sep 30, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Open source RTL implementation of Tensor Core, Sparse Tensor Core, BitWave and SparSynergy in the article: "SparSynergy: Unlocking Flexib…☆25Mar 29, 2025Updated last year
- ☆30Jun 2, 2022Updated 4 years ago
- ☆3,156Jul 29, 2025Updated 11 months ago
- ☆2,596Apr 9, 2025Updated last year
- RISC-V vector and tensor compute extensions for Vortex GPGPU acceleration for ML workloads. Optimized for transformer models, CNNs, and g…☆24Apr 25, 2025Updated last year
- 基于SG2300X的视频检索【使用自然语言搜索视频内容，定位到符合描述的具体时间段】☆13Feb 29, 2024Updated 2 years ago
- An auto-annotation demo running on SG2300X (YOLOv8/GroundingDINO + MobileSAM)☆10Nov 30, 2023Updated 2 years ago
- a clone of POCL that includes RISC-V newlib devices support and Vortex☆49Jun 20, 2026Updated 2 weeks ago
- [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning☆136Aug 27, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Examples for SophonSDK☆107Aug 11, 2022Updated 3 years ago
- 基于rknn的官方Android项目rknn_yolov5_android_apk_demo进行修改，部署人脸检测模型retinaface和106人脸关键点检测模型，支持实时人脸检测。支持rk356x和rk3588设备npu推理。☆25Mar 14, 2024Updated 2 years ago
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆15Oct 24, 2023Updated 2 years ago
- Artifact evaluation of PLDI'24 paper "Allo: A Programming Model for Composable Accelerator Design"☆35Apr 11, 2024Updated 2 years ago
- [EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.☆731May 14, 2026Updated last month
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Oct 20, 2023Updated 2 years ago
- An MLIR-based compiler framework bridges DSLs (domain-specific languages) to DSAs (domain-specific architectures).☆735Jul 2, 2026Updated last week