EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
☆51Oct 6, 2024Updated last year
Alternatives and similar repositories for embeddedllm
Users that are interested in embeddedllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆94Updated this week
- Guichan is a C++ GUI library designed for games.☆14Oct 22, 2025Updated 5 months ago
- win32 native frontend for llama-cli☆12Nov 2, 2024Updated last year
- A CUDA implementation of the ZeroOut tensorflow custom op, just for fun☆11Feb 1, 2017Updated 9 years ago
- Stable Diffusion web UI on GPU AMD Radeon in Docker☆12Dec 21, 2025Updated 3 months ago
- ☆14Dec 24, 2024Updated last year
- CLI tool to support OpenAI fine tuning tasks.☆13Nov 1, 2023Updated 2 years ago
- Stable Diffusion v1.7.0 & v1.9.3 & v1.10.1 on RDNA2 RDNA3 AMD ROCm with Docker-compose☆13Nov 7, 2024Updated last year
- ☆15Mar 30, 2023Updated 2 years ago
- Collection of resources for responding to the Log4j set of vulnerabilities.☆11Feb 22, 2022Updated 4 years ago
- Enhancement in Multimodal Representation Learning.☆41Mar 15, 2024Updated 2 years ago
- DAMP: Dynamical Pose Estimation☆19Aug 11, 2021Updated 4 years ago
- Advanced and fast log explorer with support to JSON files and columns☆22Jan 11, 2026Updated 2 months ago
- Russian accentuator and IPA transcriber☆16Sep 10, 2024Updated last year
- Apache Chainsaw is a GUI log viewer☆22Mar 21, 2024Updated 2 years ago
- Modern utility library and typescript typings for building JSON Schema documents☆14Nov 28, 2025Updated 3 months ago
- Deep reinforcement learning in Minecraft using gym-minecraft and keras-rl.☆21Feb 6, 2018Updated 8 years ago
- ☆21Updated this week
- Quickly get custom prompt contexts☆14Jan 26, 2026Updated last month
- Yet Another (LLM) Web UI, made with Gemini☆12Dec 25, 2024Updated last year
- ☆19Aug 2, 2023Updated 2 years ago
- In-browser semantic search demo using EmbeddingGemma and Transformers.js. No server required.☆31Sep 7, 2025Updated 6 months ago
- Interact with filesystem in deployed Docker containers, via FUSE. Blazing fast :)☆28Updated this week
- I will be adding different kind of opensource data extraction tools code using python☆10Nov 15, 2024Updated last year
- OpenROAD Agent. This repository contain the model to train and testing the model using EDA Corpus dataset.☆22Jul 24, 2025Updated 8 months ago
- ☆24Dec 31, 2024Updated last year
- ☆14Jul 25, 2024Updated last year
- awesome templates for textgenertor obsidian plugin☆10Nov 28, 2023Updated 2 years ago
- THIS PROJECT HAS MOVED! Check the link or README!☆14May 9, 2025Updated 10 months ago
- AI Assistant☆20Feb 21, 2026Updated last month
- Browse Lance tables from your local machine in a simple web UI. No database to set up. Mount a folder and go.☆23Mar 16, 2026Updated last week
- ☆12Jan 20, 2024Updated 2 years ago
- ☆14Sep 25, 2024Updated last year
- Export Apple News saved articles to SQLite☆14Mar 16, 2023Updated 3 years ago
- ☆16May 15, 2025Updated 10 months ago
- Tools to measure latency for LLM in Amazon Bedrook☆22Jan 20, 2026Updated 2 months ago
- This repository demonstrates how to leverage OpenAI's GPT-4 models with JSON Strict Mode to extract structured data from web pages. It c…☆20Aug 14, 2024Updated last year
- ☆14Jan 2, 2026Updated 2 months ago
- ⚔️ [ICLR 2026] Official code of "Search Arena: Analyzing Search-Augmented LLMs".☆53Feb 23, 2026Updated last month