EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
☆53Oct 6, 2024Updated 2 years ago
Alternatives and similar repositories for embeddedllm
Users that are interested in embeddedllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Apr 29, 2024Updated 2 years ago
- A typescript library to comunicate with Adguard home API☆12Mar 21, 2022Updated 4 years ago
- LLM powered local Search Engine☆31Apr 30, 2026Updated 6 months ago
- ☆11Mar 29, 2021Updated 5 years ago
- An open-source framework designed to extend and maintain the ESCO taxonomy☆19Mar 12, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for paper "TLEE: Temporal-wise and Layer-wise Early Exiting Network for Efficient Video Recognition on Edge Devices"☆11Oct 8, 2026Updated 3 weeks ago
- Neuron Activation☆28Nov 21, 2024Updated last year
- Research about dataflow architecture☆15Nov 30, 2023Updated 2 years ago
- Terminal AI agent powered by DeepSeek API☆16Jun 18, 2026Updated 4 months ago
- Audit of *.bank.in and parallel Indian financial TLDs (.fin.in, .insurance.in, .nbfc.in, .npci.in, .bank) — DNS resolution, HTTPS probe, …☆16Updated this week
- This is official code implementation of the <Rethinking the Stability-Plasticity Trade-off in Continual Learning from an Architectural Pe…☆11Jul 14, 2025Updated last year
- notepad++堆缓冲区溢出漏洞CVE-2023-40031 分析与复现☆15Sep 8, 2023Updated 3 years ago
- Yet Another (LLM) Web UI, made with Gemini☆12Dec 25, 2024Updated last year
- The official implementation of the DAC 2024 paper GQA-LUT☆26Dec 20, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- vision transformer; post-training quantization; model compression; ViT☆13Sep 1, 2026Updated 2 months ago
- [ICLR 2024 Spotlight] 🚀 The official repository of Self-Supervised Learning method "ROPIM", "Pre-training with Random Orthogonal Project…☆11Jan 15, 2025Updated last year
- Making AI Conversations Limitless, for now only for Claude.☆12Nov 24, 2024Updated last year
- The driver for LMCache core to run in vLLM☆71Feb 4, 2025Updated last year
- Learning Matchable Image Transformations☆13Sep 10, 2019Updated 7 years ago
- ☆14May 23, 2025Updated last year
- Attend - to what matters.☆16Feb 22, 2025Updated last year
- Python code translations for the book Collins, Travis F., Robin Getz, Di Pu, Alexander M. Wyglinski: Software-Defined Radio for Engineers☆16Mar 29, 2020Updated 6 years ago
- [FCCM 2025 Best Paper Nominee] AutoNTT: Automatic Architecture Design and Exploration for Number Theoretic Transform Acceleration on FPGA…☆14Jul 16, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Open-source NPU (Neural Processing Unit) for LLM inference - runs GPT-2, LLaMA, Mistral, Qwen2☆12Mar 15, 2026Updated 7 months ago
- ☆21Updated this week
- Rust crate for some audio utilities☆32Jun 17, 2026Updated 4 months ago
- ☆16Jul 5, 2025Updated last year
- c++ version of ViT☆13Nov 13, 2022Updated 3 years ago
- ☆15Aug 5, 2023Updated 3 years ago
- THIS PROJECT HAS MOVED! Check the link or README!☆14May 9, 2025Updated last year
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆86Sep 13, 2024Updated 2 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Oct 20, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Run Claude Code CLI in Docker - no local installation needed. Full MCP support, persistent sessions, and seamless host integration.☆15May 31, 2026Updated 5 months ago
- yet another scalar autograd engine - featuring complex numbers and fixed DAG☆26Mar 20, 2024Updated 2 years ago
- 📥 🎯 (1,4/4) an MLIR-based toolchain with Vitis HLS LLVM input/output targeting FPGAs.☆16Nov 15, 2022Updated 3 years ago
- ☆14Jan 20, 2024Updated 2 years ago
- ICIAP2022 - Learning Semantics for Visual Place Recognition through Multi-Scale Attention☆16May 10, 2022Updated 4 years ago
- This sample capsule shows how to include basic search in a capsule. The user can start with a simple utterance, such as "Find me some sho…☆12Apr 13, 2023Updated 3 years ago
- 🚀 Real-Time High-Level Synthesis (HLS) Projects for UltraScale+ FPGAs. Accelerated design pipelines, dataflow architectures, and low-lat…☆16Aug 2, 2026Updated 3 months ago