EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
☆54Oct 6, 2024Updated last year
Alternatives and similar repositories for embeddedllm
Users that are interested in embeddedllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆94Updated this week
- A typescript library to comunicate with Adguard home API☆12Mar 21, 2022Updated 4 years ago
- win32 native frontend for llama-cli☆14Nov 2, 2024Updated last year
- Stable Diffusion v1.7.0 & v1.9.3 & v1.10.1 on RDNA2 RDNA3 AMD ROCm with Docker-compose☆13Nov 7, 2024Updated last year
- An open-source framework designed to extend and maintain the ESCO taxonomy☆18Mar 12, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Dec 25, 2023Updated 2 years ago
- A collection of mixins extending HTMLElement with properties☆17Jan 7, 2023Updated 3 years ago
- The driver for LMCache core to run in vLLM☆69Feb 4, 2025Updated last year
- Inspect which frameworks and APIs are returned by LLMs☆10Dec 16, 2024Updated last year
- Interact with filesystem in deployed Docker containers, via FUSE. Blazing fast :)☆28May 9, 2026Updated 4 months ago
- Rust crate for some audio utilities☆32Jun 17, 2026Updated 3 months ago
- Wrapper for NVM for Windows that allows multiple GitBash windows and tabs to use different node versions☆17Mar 1, 2024Updated 2 years ago
- [Research] A draft of a nat traversal spec for use with the socket runtime.☆28Oct 25, 2022Updated 3 years ago
- 🔍 Dead-simple local file selector that preps your docs for LLM prompts, no cloud needed. Drop in your files, get perfectly formatted con…☆11Jan 11, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Attend - to what matters.☆17Feb 22, 2025Updated last year
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Oct 20, 2023Updated 2 years ago
- ☆14Jul 25, 2024Updated 2 years ago
- awesome templates for textgenertor obsidian plugin☆10Nov 28, 2023Updated 2 years ago
- A data extraction example showing how to get a pdf's content.☆12Feb 24, 2021Updated 5 years ago
- Financial data scraper for US governmental figures☆16Jun 1, 2023Updated 3 years ago
- The Code Converter App is a versatile tool that allows users to convert, debug, and analyze code written in various programming languages…☆15Aug 27, 2023Updated 3 years ago
- ☆16Dec 16, 2024Updated last year
- This is AutoGenDemo☆11Mar 12, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- leaked prompts of GPTs☆12Nov 29, 2023Updated 2 years ago
- IntelliDisk is an alternative Windows version to the famous Microsoft OneDrive!☆15Sep 13, 2026Updated last week
- Quickly get custom prompt contexts☆14May 29, 2026Updated 3 months ago
- Modern utility library and typescript typings for building JSON Schema documents☆14Nov 28, 2025Updated 9 months ago
- This project is concerned with my participating in the RuNNE competition https://github.com/dialogue-evaluation/RuNNE☆13Jun 28, 2023Updated 3 years ago
- Claude Code vs Codex Reddit Sentiment Dashboard☆17Jun 24, 2026Updated 2 months ago
- Ultimate Applocker Hardening Configuration Script.☆38Jul 26, 2024Updated 2 years ago
- A simple yet great spreadsheet app☆10Jun 18, 2025Updated last year
- ☆27Jul 26, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Universal DB Backup and Restore☆33Jan 26, 2026Updated 7 months ago
- Convert claude to chatgpt form api through Slack☆15Jun 7, 2023Updated 3 years ago
- Chat4GPT Experiments for Security☆11Mar 27, 2023Updated 3 years ago
- This project provides tools to convert Omnivore ZIP/JSON exports into a CSV format that can be imported into Raindrop.io.☆11Nov 6, 2024Updated last year
- Let AI generate prompts to keep you writing☆20Aug 25, 2024Updated 2 years ago
- ☆21Dec 22, 2024Updated last year
- Easy to use! Claude API Streamlit Version! Build your project upon this!☆12Aug 2, 2023Updated 3 years ago