A collection of experiments related to LLM inference with llama.cpp/mlx
☆40Nov 17, 2026Updated this week
Alternatives and similar repositories for llama-sandbox
Users that are interested in llama-sandbox are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Jun 11, 2026Updated 5 months ago
- Go language bindings for the ggwave C++ library☆14Apr 9, 2025Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- Stable Diffusion in TensorRT 8.5+☆14Mar 19, 2023Updated 3 years ago
- Testing LLM reasoning abilities with family relationship quizzes.☆62Jan 28, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆31Dec 23, 2024Updated last year
- Inference of Mamba, Mamba2 and Mamba3 models in pure C☆203Mar 18, 2026Updated 8 months ago
- LLM plugin for interacting with llama-server models☆32May 28, 2025Updated last year
- ☆18Dec 7, 2023Updated 2 years ago
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法,并重写预处理和后处理部分,具有超高性能!让你在Intel CPU平台上的检测速度起飞! 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度,推理速度更快!☆16Jun 14, 2023Updated 3 years ago
- Recording models☆13Sep 19, 2023Updated 3 years ago
- A C++17 single-file header-only wrapper for llama.cpp☆30Nov 6, 2026Updated last week
- DINOv2 inference engine written in C/C++ using ggml and OpenCV.☆103May 6, 2025Updated last year
- A live multiplayer trivia game where users can bid for the subject of the next question☆29Jan 9, 2026Updated 10 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Rounding vectors☆10Jan 22, 2026Updated 9 months ago
- TensorRT实现BiSeNetV1与BiSeNetV2部署☆20Apr 14, 2022Updated 4 years ago
- ☆20Dec 29, 2023Updated 2 years ago
- ☆12May 2, 2022Updated 4 years ago
- GBNF syntax high-lighter for Visual Studio Code☆15Dec 18, 2025Updated 11 months ago
- The application performs real-time inference on audio from an ALSA capture device☆39Jun 19, 2025Updated last year
- ☆11Apr 10, 2023Updated 3 years ago
- A Pytorch implementation of "Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare To…☆10Apr 20, 2022Updated 4 years ago
- Examples of AI model running on the board, such as horizon/rockchip and so on.☆20Jul 10, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆23Apr 10, 2024Updated 2 years ago
- ☆12Feb 29, 2020Updated 6 years ago
- Llama3 Streaming Chat Sample☆22Apr 24, 2024Updated 2 years ago
- Downsampling array of intervals☆26Dec 11, 2019Updated 6 years ago
- Converts JSON-Schema to GBNF grammar to use with llama.cpp☆56Nov 27, 2023Updated 2 years ago
- Semantic emoji finder. Python/dash UI. Uses sentence transformer embeddings and duckdb☆20Sep 15, 2025Updated last year
- NeRF in NCNN with c++ & vulkan☆68Jun 18, 2023Updated 3 years ago
- A well typed by construction kernel language for bidirectional programming☆14Jan 2, 2025Updated last year
- Port of Microsoft's BioGPT in C/C++ using ggml☆88Feb 21, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆292Jul 23, 2024Updated 2 years ago
- Decrypt multicast Verimatrix streams☆14Apr 21, 2022Updated 4 years ago
- Pybind11 bindings for Whisper.cpp☆63Nov 1, 2026Updated 2 weeks ago
- experiment☆12Jan 1, 2023Updated 3 years ago
- MobileSAM のエンコーダー/デコーダーをONNXに変換し、推論するサンプル☆12Apr 11, 2024Updated 2 years ago
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- ☆17Jul 11, 2025Updated last year
Are these results useful?