cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server at runtime.
☆44Jul 4, 2025Updated last year
Alternatives and similar repositories for cortex.llamacpp
Users that are interested in cortex.llamacpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…☆42Sep 26, 2024Updated last year
- Ichigo Whisper is a compact (22M parameters), open-source speech tokenizer for the Whisper-medium, designed to enhance performance on mul…☆16Jan 20, 2025Updated last year
- win32 native frontend for llama-cli☆14Nov 2, 2024Updated last year
- C++ pipeline with OpenVINO native API for Stable Diffusion v1.5☆13Feb 23, 2024Updated 2 years ago
- Lazy loading of shared libraries for Nim☆20Jul 8, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Simple agent framework using Ollama tool calling☆10Aug 27, 2024Updated last year
- A rules induction system for data mining and exploratory data analysis☆11Jul 17, 2024Updated 2 years ago
- Welcome to the LLM Tutorials and RAG Implementations repository! This repository provides tutorials, guides, and implementations for work…☆13Jul 1, 2025Updated last year
- Your Python AI Coder!☆36May 21, 2025Updated last year
- ☆18Jul 14, 2026Updated last week
- ☆27Mar 17, 2025Updated last year
- Repository sifter and hardlinker☆13Jun 13, 2020Updated 6 years ago
- llama.cpp bindings and utilities for zig☆73Apr 14, 2025Updated last year
- LlamaNet: Decentralized Inference Swarm for llama.cpp☆23Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A plugin for Oobabooga TextUI that allows you to search multiple search engines. Initially we're using Google API or DuckDuckGo.☆18Jun 4, 2023Updated 3 years ago
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆23Jun 23, 2026Updated last month
- Minimalistic batching application for LLMs using ASP.NET Core and LLamaSharp☆12Oct 23, 2024Updated last year
- ☆12Feb 7, 2024Updated 2 years ago
- Kolosal AI is an OpenSource and Lightweight alternative to Ollama to run LLMs 100% offline on your device.☆15Jan 2, 2026Updated 6 months ago
- A proof-of-concept parser for the Prolog programming language, at the Bern University of Applied Sciences for the course "Automata and fo…☆11Jan 17, 2014Updated 12 years ago
- Awesome resources for GIMP☆26May 16, 2026Updated 2 months ago
- search for files in a directory hierarchy☆11Oct 16, 2024Updated last year
- Bindings for FFmpeg☆11May 15, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- LCM OpenVINO model converter☆24Mar 27, 2024Updated 2 years ago
- Multithreaded TCP Client/Server implementation in C++☆12Jul 20, 2022Updated 4 years ago
- Writing Game Boy stuff in Nim through GBDK☆13Sep 11, 2023Updated 2 years ago
- ☆14Mar 13, 2026Updated 4 months ago
- Minimalist stable-diffusion desktop application with only one executable file writen with golang ( No python ).☆18Apr 16, 2025Updated last year
- 🧻 Unroll for-loops at compile-time.☆12Jul 27, 2021Updated 4 years ago
- ☆86Mar 2, 2023Updated 3 years ago
- Draw MNIST digits and classify in real time!☆12Aug 27, 2024Updated last year
- Simple, Fast, Parallel Huggingface GGML model downloader written in python☆24Jul 26, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AI Persona in JSON file☆17Jul 19, 2025Updated last year
- A UI for stable-diffusion.cpp.☆42Updated this week
- Stable Diffusion in pure C/C++☆18Jun 21, 2026Updated last month
- Un-official repo for paper "Structured 3D Latents for Scalable and Versatile 3D Generation". Windows - One click Install☆19Feb 6, 2025Updated last year
- ☆12Aug 30, 2017Updated 8 years ago
- A gameboy emulator written in Nim☆10May 6, 2020Updated 6 years ago
- Experimental finite field primitives (and maybe more)☆11Jul 24, 2020Updated 5 years ago