ggml学习笔记，ggml是一个机器学习的推理框架
☆18Mar 24, 2024Updated 2 years ago
Alternatives and similar repositories for ggml-learning-notes
Users that are interested in ggml-learning-notes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A lightweight, single-header C++11 Jinja2 template engine for LLM chat templates.☆20Mar 4, 2026Updated 7 months ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- 基于ComNet的短文本匹配网络模型☆11Jul 9, 2019Updated 7 years ago
- 基于MNN和cpp-httplib实现的简单llm推理服务☆10Apr 9, 2024Updated 2 years ago
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- a ai infra framework for edge device base on nndeploy☆17Nov 27, 2025Updated 11 months ago
- Port of Funasr's Paraformer model in C/C++☆43Jun 19, 2024Updated 2 years ago
- ☆34Sep 8, 2024Updated 2 years ago
- 瑞芯微芯片的rknn推理框架部署(yolo模型)☆15Jul 17, 2025Updated last year
- This project is built upon the official Ultralytics repository, delivering QAT quantization solutions for various Axera chip platforms. I…☆13Updated this week
- workflow of nndeploy☆14Nov 5, 2025Updated 11 months ago
- 动手写全文搜索引擎☆10Aug 12, 2020Updated 6 years ago
- 基于树莓派的智能家居语音控制系统，采用snowboy进行关键词唤醒，配置sonwboy环境详见网上，如果选择最新的树莓派系统会出现很多安装依赖问题，语音控制LED亮灭，语音收发邮件，语音播放天气预报，语音控制LED亮灭，语音播放音乐但是得提前下载好歌曲在本地上，注意路径问题☆11Aug 19, 2022Updated 4 years ago
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆15Oct 24, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- momoten is an experimental translation and runtime layer that implements a restricted, buffer-oriented subset of the Vulkan compute API o…☆27Oct 26, 2026Updated last week
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- ☆20Dec 29, 2023Updated 2 years ago
- 大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标☆20Sep 12, 2024Updated 2 years ago
- ☆24Nov 6, 2025Updated 11 months ago
- llm deploy project based onnx.☆49Oct 9, 2024Updated 2 years ago
- Langchain实现的一个医疗知识库，Embedding模型是m3e-base，向量数据库是FAISS，主要模型是ChatGLM☆11Feb 27, 2025Updated last year
- ☆23Jan 3, 2024Updated 2 years ago
- 一个使用C/C++基于epoll实现的高性能的stackfull协程库，通过HOOK阻塞的系统调用，网络IO事件，协程间的同步事件及定时事件驱动协程的调度，通过汇编完成协程的高速切换，支持海量协程创建，支持协程的动态跨线程负载均衡调度，优先级调度，支持协程的栈上溢出检测及协…☆16Apr 17, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- RKNN-YOLOV5-BatchInference-MultiThreadingYOLOV5多张图片多线程C++推理☆24Nov 6, 2023Updated 2 years ago
- ☆29Jun 30, 2025Updated last year
- A one-page-only CGraph-API-liked DAG project.☆28Feb 11, 2025Updated last year
- 逐行复刻开源 AI 编程 agent opencode，从最小可用 agent loop 渐进演进至生产级 Effect-TS 架构，并展示如何用 AI agent 辅助高效学习陌生技术栈。☆27Sep 22, 2026Updated last month
- 使用 CUDA C++ 实现的 llama 模型推理框架☆64Nov 8, 2024Updated last year
- Simple C++ FFmpeg video encoder. Raw data to mp4 (h264) file.☆21Jan 24, 2021Updated 5 years ago
- ☆34Feb 3, 2025Updated last year
- 图解 vLLM 推理引擎：100 课动手练习册 + ~500 行可运行的迷你推理引擎 | An illustrated, hands-on course on how vLLM works☆40Oct 15, 2026Updated 2 weeks ago
- this a simple taskflow inspired by the githu taskflow proj for learning , it is even more easy than the ori version of task flow☆47Aug 22, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Header-only safetensors loader and saver in C++☆94Dec 27, 2025Updated 10 months ago
- 大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM☆26Feb 26, 2024Updated 2 years ago
- A ROS 1/ROS 2 hybrid package wrapping the Apache TVM project.☆10Jan 24, 2023Updated 3 years ago
- yolov8 旋转目标检测部署，瑞芯微RKNN芯片部署、地平线Horizon芯片部署、TensorRT部署☆28Jun 4, 2024Updated 2 years ago
- This project is intended to build and deploy an SNPE model on Qualcomm Devices, which are having unsupported layers which are not part of…☆10Oct 4, 2021Updated 5 years ago
- MobileSAM のエンコーダー/デコーダーをONNXに変換し、推論するサンプル☆12Apr 11, 2024Updated 2 years ago
- NanoTrack(@HonglinChu), C++ TensorRT deployment. MAX 250 FPS!☆31Nov 6, 2023Updated 2 years ago