A collection of experiments related to LLM inference with llama.cpp/mlx
☆41Aug 26, 2026Updated 2 weeks ago
Alternatives and similar repositories for llama-sandbox
Users that are interested in llama-sandbox are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Go language bindings for the ggwave C++ library☆14Apr 9, 2025Updated last year
- Testing LLM reasoning abilities with family relationship quizzes.☆62Jan 28, 2025Updated last year
- ☆31Dec 23, 2024Updated last year
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- Build tools for Enyo 2.6+☆15Nov 26, 2018Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- LLM plugin for interacting with llama-server models☆32May 28, 2025Updated last year
- Converts JSON-Schema to GBNF grammar to use with llama.cpp☆56Nov 27, 2023Updated 2 years ago
- Implementation for the PHM paper at ICLR'21☆12Mar 1, 2023Updated 3 years ago
- A C++17 single-file header-only wrapper for llama.cpp☆30Updated this week
- PERM GaussianKG☆10Nov 24, 2021Updated 4 years ago
- DINOv2 inference engine written in C/C++ using ggml and OpenCV.☆102May 6, 2025Updated last year
- GitHub Action to add reviewer(s) to a pull request.☆12Apr 23, 2024Updated 2 years ago
- An asdf plugin for juggling different versions of ffmpeg☆11Mar 10, 2026Updated 6 months ago
- TensorRT实现BiSeNetV1与BiSeNetV2部署☆20Apr 14, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆24Apr 10, 2024Updated 2 years ago
- A live multiplayer trivia game where users can bid for the subject of the next question☆29Jan 9, 2026Updated 8 months ago
- monodepth running in Android by ncnn☆23Oct 12, 2021Updated 4 years ago
- Examples of AI model running on the board, such as horizon/rockchip and so on.☆20Jul 10, 2023Updated 3 years ago
- Downsampling array of intervals☆26Dec 11, 2019Updated 6 years ago
- UI infrastructure for Enyo applications☆20Mar 26, 2018Updated 8 years ago
- This repo contains code for the paper "Psychologically-informed chain-of-thought prompts for metaphor understanding in large language mod…☆14Apr 28, 2023Updated 3 years ago
- LLM-powered lossless compression tool☆320Jun 16, 2026Updated 2 months ago
- ☆18Jun 16, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code for our ACL'23 paper on how to identify metaphor mappings with the help of GPT-3☆12May 21, 2025Updated last year
- Simple ranking metrics for PyTorch on CPU or GPU☆15Nov 20, 2020Updated 5 years ago
- ☆34Jul 23, 2024Updated 2 years ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆146Jul 9, 2024Updated 2 years ago
- experiment☆12Jan 1, 2023Updated 3 years ago
- segment-anything based mnn☆37Dec 13, 2023Updated 2 years ago
- ☆16Jul 11, 2025Updated last year
- Really, really lightweight javascript event emitting☆22Jan 24, 2013Updated 13 years ago
- LightNet is an optimized deep learning framework based on the popular darknet platform. It is optimized to create efficient and high-spee…☆37Sep 17, 2023Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A tool convert TensorRT engine/plan to a fake onnx☆41Nov 22, 2022Updated 3 years ago
- Bayesian scaling laws for in-context learning.☆16Mar 12, 2025Updated last year
- A well typed by construction kernel language for bidirectional programming☆14Jan 2, 2025Updated last year
- This is a joint implementation of AdaShift optimizer, LGANs, and MaxGP.☆14Oct 7, 2020Updated 5 years ago
- The most influential papers about distributed systems, databases, algorithms, and data structures☆13Jul 24, 2026Updated last month
- This project is intended to build and deploy an SNPE model on Qualcomm Devices, which are having unsupported layers which are not part of…☆10Oct 4, 2021Updated 4 years ago
- A command-line tool for Blockless☆17Oct 17, 2024Updated last year