Single-header C++17 libraries for LLM features: OpenAI and Anthropic streaming, retries, caching, cost estimates, RAG, structured JSON output and tool-calling agents. Copy one .hpp, no SDK, no package manager.
☆14Oct 21, 2026Updated last week
Alternatives and similar repositories for llm-cpp
Users that are interested in llm-cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Zanime是一个基于 Gin (Go) + Vue3 构建的分布式动漫资源聚合平台，实现从数据采集到用户交互的完整技术闭环，项目集成了视频观看、社区互动、评论交流、交易功能以及资源搜索等服务☆13Mar 11, 2025Updated last year
- Rust rendering and game engine where every visual is math: glyphs and particles driven by strange attractors, force fields and spring phy…☆31Updated this week
- Free LLM token counter: see how GPT-4 and GPT-4o split your prompt into tokens, which lines cost the most, and which wordy phrases to cut…☆11Updated this week
- Rust CLI and web UI that intercepts an LLM token stream live: per-token confidence and perplexity, on-the-fly token mutation, provider an…☆26Updated this week
- Rust streaming primitives for real-time market data: exchange tick normalization (Binance, Coinbase, Alpaca, Polygon), WebSocket reconnec…☆14Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Tool to convert dwg file format to dxf file format☆11Mar 2, 2022Updated 4 years ago
- RESTful HTTP endpoints to RxInfer☆12Feb 23, 2026Updated 8 months ago
- Reinforcement learning-based gyroscope spoofing attacks against PX4 and ArduPilot UAV flight controllers. Research artifacts and reproduc…☆17Apr 22, 2026Updated 6 months ago
- SDFT optimized for HP ZGX Nano with GLM-4.7-Flash teacher and Qwen3-0.6B☆13Jan 30, 2026Updated 8 months ago
- FinRL contest Task 1 entry: DQN ensemble (D3QN, DoubleDQN, TwinD3QN) trading 1-second BTC order-book data, with DeepSeek news sentiment a…☆18Updated this week
- Parse the CAD DXF file and display it with qt.☆12Dec 4, 2018Updated 7 years ago
- ☆14Jul 23, 2025Updated last year
- This is some extra code for the "Advanced Build With AI" SDK tutorial I gave remotely on May 17.☆13May 17, 2025Updated last year
- Rust crate of validated, decimal-precise trading building blocks: price types, L2 order book, tick-to-OHLCV aggregation, hundreds of stre…☆16Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The core framework of Nexus Hyperion, an advanced intergalactic financial and resource management system. This repository contains the fo…☆13Nov 2, 2024Updated last year
- ☆22Oct 8, 2026Updated 2 weeks ago
- Release repository for the SysML v2 Library for AADL☆15Mar 1, 2026Updated 7 months ago
- This repository contains code for data preparation and experiments for pre training llm with repository level context in various ways☆12Aug 1, 2023Updated 3 years ago
- Random String Generator based on Regular Expression☆20May 31, 2019Updated 7 years ago
- Rust CLI and library that flags low-confidence spans in LLM answers from token logprobs (offline or live via any OpenAI-compatible API) a…☆19Updated this week
- Python package for Dynamic Energy Budget modelling☆12Nov 24, 2025Updated 11 months ago
- Code for the work in: https://www.nature.com/articles/s41534-020-00305-x Basically a generative neural network to tackle the classical ca…☆15Apr 17, 2025Updated last year
- 🔞 A library for PicaComic http web api. 用于 PicaComic 哔咔的 HTTP 网站 API☆21Apr 23, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An easy tool for medical image segmentation results analysis☆16Nov 2, 2022Updated 3 years ago
- ☆42Oct 19, 2026Updated last week
- Fast drone serial number lookup using FAA Remote ID database☆18Sep 4, 2026Updated last month
- SYSMOD Language Extension and Examples for SysML v2☆26Updated this week
- ☆12Aug 11, 2026Updated 2 months ago
- Redesigned Active Scope Probe using KiCad v9☆21Feb 13, 2026Updated 8 months ago
- Evil generation of regular expression test string☆21Nov 22, 2019Updated 6 years ago
- 🏗 Build static blog with lines of HTML and Markdown.☆12Aug 6, 2023Updated 3 years ago
- Antenna plotting program for plotting antenna simulation results☆16Feb 22, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A re-runnable web-search evaluation framework: in-house benchmarks + open-benchmark (SimpleQA/FreshQA) scoring with a blind pairwise judg…☆17Sep 1, 2026Updated last month
- Antenna radiation pattern real-time plotting and analysis software☆14Jan 12, 2025Updated last year
- My understanding of C++20 coroutines with sample code.☆21Sep 30, 2024Updated 2 years ago
- Drag+Drop CMS Template with ⚡ nextjs 👷♀️ builder.io 💅 tailwind 🌐 localization☆13Oct 26, 2023Updated 3 years ago
- Parallel Architecture for Resilient Adaptive Growth & Optimized Networks☆24Nov 3, 2025Updated 11 months ago
- Neovim plugin to add shadcn UI component easily with telescope☆13Feb 14, 2026Updated 8 months ago
- Simulating the fractional quantum Hall effect with neural network variational Monte Carlo☆22Sep 12, 2025Updated last year