Alternatives and similar repositories for rkllm_talking

Users that are interested in rkllm_talking are comparing it to the libraries listed below

• wudingjian / rkllm_chat
  将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理
  ☆58Updated 11 months ago
• morsoli / llmbenchmark
  大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
  ☆19Updated last year
• Eric0308 / xiaozhi-client
  这是一个用于连接小智AI服务的Python客户端库。它提供了简单的接口来进行语音对话和文本交互。
  ☆22Updated 6 months ago
• QuecPython / AIChatBot-Volcengine-webRTC
  An AI chat bot based on volcengine's webRTC protocol.
  ☆29Updated 4 months ago
• BaronLeeLZP / rockchip_rv1109_rknn-yolov3-demo
  在瑞芯微rockchip的AI芯片rv1109上，利用rknn和opencv库，修改了官方yolov3后处理部分代码Bug，交叉编译yolov3-demo示例后可成功上板部署运行。
  ☆34Updated 3 years ago
• zjd1988 / rknn_backend
  ☆17Updated last year
• EASY-EAI / EASY-EAI-Toolkit-3588
  ☆12Updated 5 months ago
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆40Updated last year
• zilliz-bootcamp / video_analysis
  Recognize faces and objects in the video based on Milvus.
  ☆22Updated 4 years ago
• av1d / rk3588_npu_llm_server
  Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.
  ☆25Updated last year
• modelbox-ai / modelbox
  A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用，支持GPU，…
  ☆156Updated last year
• hpc203 / Detic-onnxrun-cpp-py
  使用ONNXRuntime部署Detic检测2万1千种类别的物体，包含C++和Python两个版本的程序
  ☆17Updated 2 years ago
• jwhna1 / xiaozhi-esp32-server-editor
  小智ESP32服务端配置编辑器是一个图形化工具，专为 xiaozhi-esp32-server 项目设计，旨在简化配置文件的编辑过程。通过直观的界面，用户可以轻松查看和修改 `data/.config.yaml` 文件中的各项配置，无需手动编辑YAML文件。The Xiao…
  ☆26Updated 6 months ago
• hpc203 / Open-Vocabulary-Object-Detection-opencv-onnxrun
  使用OpenCV+onnxruntime部署开放域目标检测，包含C++和Python两个版本的程序
  ☆11Updated last year
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆113Updated last month
• sherlockchou86 / PyLangPipe
  a simple lightweight large language model pipeline framework.
  ☆27Updated 4 months ago
• daxpot / xiaozhi-cpp-server
  本项目为xiaozhi-esp32提供C++后端服务，帮助您快速搭建ESP32设备控制服务器。Backend C++ service for xiaozhi-esp32, helps you quickly build an ESP32 device control ser…
  ☆29Updated 5 months ago
• hpc203 / image_captioning-opencv-onnxrun
  使用OpenCV部署图像描述Image_Captioning，包含C++和Python两个版本的程序
  ☆12Updated last year
• sophgo / tdl_sdk
  ☆29Updated 2 weeks ago
• GIBEREZ / Qt-NCNN-ByteTrack
  使用NCNN推理框架和ByteTrack目标跟踪框架，对网络、文件流URL进行实时性视频推理，而UI界面则由Qt框架实现
  ☆21Updated 11 months ago
• cluangar / YOLOv5-RK3588-Python
  Modify Code From rknn-toolkit2
  ☆54Updated last year
• hpc203 / face-gaze-estimation-opencv-dnn
  使用OpenCV部署L2CS-Net人脸朝向估计，包含C++和Python两个版本的程序，只依赖opencv库就可以运行
  ☆20Updated 2 years ago
• Chrisz236 / llm-rk3588
  Run Large Language Models on RK3588 with GPU-acceleration
  ☆117Updated 2 years ago
• belarbi2733 / deepstream-rtspsrc-yolo
  ☆23Updated 4 years ago
• dog-qiuqiu / simple-rknn2
  The rknn2 API uses the secondary encapsulation of the process, which is easy for everyone to call. It is applicable to rk356x rk3588
  ☆46Updated 3 years ago
• Gwencong / deepstream-pose
  pose estimation code with deepstream and yolo-pose
  ☆13Updated 2 years ago
• hardkernel / rk3568_linux_gstreamer-rockchip
  ☆11Updated last year
• Qengineering / Qengineering
  Machine vision apps
  ☆38Updated 2 months ago
• yinghanguan / PaddleOCR2RKNN
  Convert the official paddleocr model to a deployable model on RK1126
  ☆38Updated 2 years ago
• nihui / ncnn_on_esp32
  ☆79Updated last year