A minimal CLI tool for piping anything into an LLM.
☆18Jan 1, 2026Updated 2 months ago
Alternatives and similar repositories for infer
Users that are interested in infer are comparing it to the libraries listed below
Sorting:
- a character-ai like UI for LLM☆10Dec 3, 2024Updated last year
- LLM backed Fantasy Tribe Game☆19Nov 21, 2024Updated last year
- Awesome LLM speech-to-speech models and frameworks☆40Nov 17, 2025Updated 3 months ago
- RP/Writing focused LLM frontend☆61Updated this week
- Writing Tools, Apple's AI-inspired app, enchants Windows, enhancing your pen with AI LLMs. One hotkey press, system-wide, fixes grammar, …☆27Jul 26, 2025Updated 7 months ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆30Feb 21, 2026Updated last week
- Text-to-Speech (TTS) engine for the Armenian language☆12Sep 29, 2024Updated last year
- LCM Drawing app☆12Dec 1, 2023Updated 2 years ago
- A blueprint for next-gen AI. Project Infinity uses a token-efficient, Codified Agent Protocol to create specialized, secure, and imaginat…☆25Oct 2, 2025Updated 5 months ago
- A desktop GUI for Flux 1.1 Pro built using DelphiFMX For Python☆11Oct 5, 2024Updated last year
- ☆15Apr 22, 2014Updated 11 years ago
- LlamaNet: Decentralized Inference Swarm for llama.cpp☆23Jan 18, 2026Updated last month
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolcha…☆79Feb 22, 2026Updated last week
- A free and open-source GUI tool that simplifies combining multiple code files into one, with automatic labeling and support for various p…☆14Jan 3, 2025Updated last year
- Kotlin library for Cortex.cpp a Local AI API Platform that is used to run and customize LLMs.☆10Apr 2, 2025Updated 11 months ago
- Cleanai (https://github.com/willmil11/cleanai) except I'm making it in c now. Fast and clean from the start this time :)☆17Updated this week
- A Python script to auto-detect and auto-crop a person in a image☆15Jan 15, 2024Updated 2 years ago
- ☆11Sep 18, 2023Updated 2 years ago
- Exploring better compiler architecture☆10Feb 24, 2026Updated last week
- No gimmick DoH stub resolver☆19Mar 22, 2023Updated 2 years ago
- An agentic runtime that enables secure, extensible and configurable AI automation from any model☆17Updated this week
- Inference slice of marian for bergamot's tiny11 models. Faster to compile, and wield. Fewer model-archs than bergamot-translator.☆13Oct 24, 2024Updated last year
- A Shiny-based demo showing how to use the igraph library of R to make impress.js/jmpress presentations☆11Oct 5, 2019Updated 6 years ago
- Gemtree Peter is a visual programming tool for Windows 95 and later. Peter is mainly focused on children, but also on professional use.☆15May 27, 2022Updated 3 years ago
- sherpa-onnx Go package for Windows☆13Feb 26, 2026Updated last week
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆21Feb 23, 2026Updated last week
- The Lily programming language ⚜☆10Jan 4, 2026Updated 2 months ago
- Yet another fork of DFL☆11Jul 19, 2016Updated 9 years ago
- ☆30Dec 12, 2025Updated 2 months ago
- ACE-Step: A Step Towards Music Generation Foundation Model☆49May 20, 2025Updated 9 months ago
- A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp☆16Feb 10, 2026Updated 3 weeks ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆10Sep 14, 2025Updated 5 months ago
- ☆15Apr 9, 2025Updated 10 months ago
- Inference deployment of the llama3☆11Apr 21, 2024Updated last year
- A universal adapter including zero-copy Python bindings for Philip Turner's metal flash attention library.☆23Dec 15, 2025Updated 2 months ago
- Yet another `llama.cpp` Rust wrapper☆12Jun 19, 2024Updated last year
- General-purpose programming language that compiles to efficient native binaries.☆10Aug 15, 2025Updated 6 months ago
- CLI tool to extract folder structure and file contents with a directory excluded possibility☆14Dec 30, 2025Updated 2 months ago
- Minimal web client for chatting and roleplay with AI characters☆26Aug 21, 2025Updated 6 months ago