A collection of experiments related to LLM inference with llama.cpp/mlx
☆40Aug 26, 2026Updated last month
Alternatives and similar repositories for llama-sandbox
Users that are interested in llama-sandbox are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Go language bindings for the ggwave C++ library☆14Apr 9, 2025Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- ☆18Dec 7, 2023Updated 2 years ago
- Inference of Mamba, Mamba2 and Mamba3 models in pure C☆203Mar 18, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Recording models☆13Sep 19, 2023Updated 3 years ago
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！☆16Jun 14, 2023Updated 3 years ago
- A C++17 single-file header-only wrapper for llama.cpp☆30Updated this week
- PERM GaussianKG☆10Nov 24, 2021Updated 4 years ago
- Repository for ICLR'23 Long-tailed Learning Requires Feature Learning☆10Feb 22, 2023Updated 3 years ago
- DINOv2 inference engine written in C/C++ using ggml and OpenCV.☆103May 6, 2025Updated last year
- TensorRT实现BiSeNetV1与BiSeNetV2部署☆20Apr 14, 2022Updated 4 years ago
- ☆23Apr 10, 2024Updated 2 years ago
- ☆11Apr 10, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A live multiplayer trivia game where users can bid for the subject of the next question☆29Jan 9, 2026Updated 8 months ago
- ☆20Dec 29, 2023Updated 2 years ago
- ☆12May 2, 2022Updated 4 years ago
- High-level, optionally asynchronous Rust bindings to llama.cpp☆251Jun 5, 2024Updated 2 years ago
- monodepth running in Android by ncnn☆23Oct 12, 2021Updated 4 years ago
- The Codec 2 speech codec, compiled to WASM using Emscripten.☆15Apr 27, 2023Updated 3 years ago
- Downsampling array of intervals☆26Dec 11, 2019Updated 6 years ago
- Proof-of-concept of global switching between numpy/jax/pytorch in a library.☆17Jun 18, 2024Updated 2 years ago
- LLM-powered lossless compression tool☆321Jun 16, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Simple ranking metrics for PyTorch on CPU or GPU☆15Nov 20, 2020Updated 5 years ago
- ☆12Feb 29, 2020Updated 6 years ago
- ☆34Jul 23, 2024Updated 2 years ago
- Llama3 Streaming Chat Sample☆22Apr 24, 2024Updated 2 years ago
- An implementation of Deepmind's Promptbreeder.☆23Dec 22, 2023Updated 2 years ago
- Decrypt multicast Verimatrix streams☆14Apr 21, 2022Updated 4 years ago
- segment-anything based mnn☆37Dec 13, 2023Updated 2 years ago
- ☆16Jul 11, 2025Updated last year
- LightNet is an optimized deep learning framework based on the popular darknet platform. It is optimized to create efficient and high-spee…☆37Sep 17, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICML 2022] Official implementation of "Score-Guided Intermediate Layer Optimization: Fast Langevin Mixing for Inverse Problems".☆12Jul 19, 2022Updated 4 years ago
- A well typed by construction kernel language for bidirectional programming☆14Jan 2, 2025Updated last year
- A friendly Zig launcher and toolchain manager.☆21Dec 2, 2025Updated 10 months ago
- This is a joint implementation of AdaShift optimizer, LGANs, and MaxGP.☆14Oct 7, 2020Updated 5 years ago
- This project is intended to build and deploy an SNPE model on Qualcomm Devices, which are having unsupported layers which are not part of…☆10Oct 4, 2021Updated 4 years ago
- A tiny, didactical implementation of LLAMA 3☆42Dec 2, 2024Updated last year
- Experimental UI☆53Mar 10, 2021Updated 5 years ago