Alternatives and similar repositories for ollama-hpp

Users that are interested in ollama-hpp are comparing it to the libraries listed below

• sewenew / tokenizer

  View on GitHub
  C++ implementation of tokenizers, including tiktoken.
  ☆25Dec 7, 2023Updated 2 years ago
• notedit / awesome-mcp-list

  View on GitHub
  Awesome Model Context Protocol Service List
  ☆28Nov 27, 2024Updated last year
• wangzhaode / onnx-llm

  View on GitHub
  llm deploy project based onnx.
  ☆49Oct 9, 2024Updated last year
• tphakala / tflite_c

  View on GitHub
  TensorFlow Lite C precompiled library for Windows, Linux and macOS
  ☆11Dec 30, 2024Updated last year
• ZHEQIUSHUI / SAM-ONNX-AX650-CPP

  View on GitHub
  SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。
  ☆52Jan 30, 2024Updated 2 years ago
• futz12 / ncnn_ppstructure_table

  View on GitHub
  A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル
  ☆20Mar 2, 2025Updated 11 months ago
• EdVince / model_zoo

  View on GitHub
  Recording models
  ☆12Sep 19, 2023Updated 2 years ago
• DavidKk / Vercel-Gemini-Proxy

  View on GitHub
  Gemini API proxy on Vercel Edge.
  ☆16Dec 13, 2025Updated 2 months ago
• desktop-app / lib_webview

  View on GitHub
  Webview helper library.
  ☆18Jan 2, 2026Updated last month
• praydog / IDA-String-Reference-Locator-Plugin

  View on GitHub
  Finds all first occurring string references near another reference
  ☆19Dec 16, 2021Updated 4 years ago
• morsoli / llmbenchmark

  View on GitHub
  大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
  ☆20Sep 12, 2024Updated last year
• BlackyDrum / chromadb-cpp

  View on GitHub
  Easily interact with ChromaDB Vector Database in C++
  ☆20Jan 21, 2026Updated 3 weeks ago
• ftomark / msgpack-rpc-cpp11

  View on GitHub
  EasyRPC is a msgpack-rpc + α implementation for Modern C++17 language.built on top of https://github.com/rpclib/rpclib
  ☆15Oct 21, 2018Updated 7 years ago
• AXERA-TECH / SAM-ONNX-AX650-CPP

  View on GitHub
  ☆17Dec 7, 2023Updated 2 years ago
• AXERA-TECH / ax620e_bsp_sdk

  View on GitHub
  Linux BSP APP & Samples for AXera Pi Zero(AX620Q)
  ☆21Nov 1, 2024Updated last year
• copperspice / cs_mingw_w64

  View on GitHub
  Binary releases of MinGW-CS
  ☆18Sep 5, 2024Updated last year
• chroma-core / hnswlib

  View on GitHub
  Chroma's fork of hnswlib - a header-only C++/python library for fast approximate nearest neighbors
  ☆20Nov 12, 2025Updated 3 months ago
• wolf5x / cppobfuscator

  View on GitHub
  c/c++ obfuscator with clang lib
  ☆25Jan 12, 2014Updated 12 years ago
• triple-mu / HunyuanDiT-TensorRT-libtorch

  View on GitHub
  HunyuanDiT with TensorRT and libtorch
  ☆18May 22, 2024Updated last year
• hscspring / llama.np

  View on GitHub
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆21Nov 22, 2023Updated 2 years ago
• fabio-sim / DocShadow-ONNX-TensorRT

  View on GitHub
  ONNX-compatible DocShadow: High-Resolution Document Shadow Removal. Supports TensorRT 🚀
  ☆24Sep 13, 2023Updated 2 years ago
• Dominic23331 / sam_onnx

  View on GitHub
  ☆25Apr 22, 2023Updated 2 years ago
• replicate / endless-zoom

  View on GitHub
  ☆25Nov 25, 2023Updated 2 years ago
• chanzuckerberg / cryoet-data-portal

  View on GitHub
  CryoET Data Portal
  ☆26Updated this week
• av1d / rk3588_npu_llm_server

  View on GitHub
  Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.
  ☆28May 29, 2024Updated last year
• delta1037 / RknnInferTemplate

  View on GitHub
  RKNN模型推理部署模板
  ☆24Aug 11, 2023Updated 2 years ago
• thooton / jc

  View on GitHub
  Meta-program C/C++ with JavaScript
  ☆28Jan 14, 2023Updated 3 years ago
• we0091234 / NCNN_SAMPLE

  View on GitHub
  ncnn 实现一些项目例子
  ☆26Feb 17, 2023Updated 2 years ago
• AXERA-TECH / CLIP-ONNX-AX650-CPP

  View on GitHub
  ☆28Jun 30, 2025Updated 7 months ago
• Seeed-Studio / sscma-example-esp32

  View on GitHub
  Example of SenseCraft Model Assistant Model deployment related to ESP32
  ☆32Apr 9, 2025Updated 10 months ago
• chetanvaghela457 / cafeteria_full_ecommerce_app_flutter

  View on GitHub
  🛍 A full E-commerce app with nice UI consists of on-boarding, login, sign-up, home, product details, cart and user profile.
  ☆10Sep 8, 2024Updated last year
• syoyo / safetensors-cpp

  View on GitHub
  Header-only safetensors loader and saver in C++
  ☆78Dec 27, 2025Updated last month
• FeiGeChuanShu / CodeFormer-ncnn

  View on GitHub
  ncnn version of CodeFormer
  ☆110Mar 9, 2023Updated 2 years ago
• wangkuiyi / huggingface-tokenizer-in-cxx

  View on GitHub
  ☆70Feb 27, 2023Updated 2 years ago
• SparksofAGI / MHPP

  View on GitHub
  ☆33Sep 14, 2025Updated 5 months ago
• bitdefender / hypervinject-poc

  View on GitHub
  ☆58Jul 31, 2025Updated 6 months ago
• AXERA-TECH / ax-llm

  View on GitHub
  Explore LLM model deployment based on AXera's AI chips
  ☆139Feb 6, 2026Updated last week
• meta-pytorch / tokenizers

  View on GitHub
  C++ implementations for various tokenizers (sentencepiece, tiktoken etc).
  ☆48Feb 4, 2026Updated last week
• bayesml / BayesML

  View on GitHub
  BayesML: your first library for Bayesian machine learning
  ☆16Jan 27, 2026Updated 2 weeks ago