EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
☆53Oct 6, 2024Updated last year
Alternatives and similar repositories for embeddedllm
Users that are interested in embeddedllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆96Updated this week
- LLM powered local Search Engine☆32Apr 30, 2026Updated 3 months ago
- Low-rank Highway Networks☆13Mar 11, 2016Updated 10 years ago
- Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification☆10May 31, 2022Updated 4 years ago
- Stateful API logic for agentic applications using vLLM☆64Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Learning Matchable Image Transformations☆13Sep 10, 2019Updated 6 years ago
- Toy O☆16Sep 21, 2024Updated last year
- Enhancement in Multimodal Representation Learning.☆42May 5, 2026Updated 3 months ago
- DAMP: Dynamical Pose Estimation☆19Aug 11, 2021Updated 5 years ago
- Github for the NIPS 2020 paper "Learning outside the black-box: at the pursuit of interpretable models"☆14Sep 7, 2022Updated 3 years ago
- Speech recognition☆13Dec 27, 2014Updated 11 years ago
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆86Sep 13, 2024Updated last year
- Yet Another (LLM) Web UI, made with Gemini☆12Dec 25, 2024Updated last year
- ☆16Feb 1, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Rust crate for some audio utilities☆32Jun 17, 2026Updated last month
- 🔍 Dead-simple local file selector that preps your docs for LLM prompts, no cloud needed. Drop in your files, get perfectly formatted con…☆11Jan 11, 2025Updated last year
- Attend - to what matters.☆17Feb 22, 2025Updated last year
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Oct 20, 2023Updated 2 years ago
- awesome templates for textgenertor obsidian plugin☆10Nov 28, 2023Updated 2 years ago
- A data extraction example showing how to get a pdf's content.☆12Feb 24, 2021Updated 5 years ago
- Financial data scraper for US governmental figures☆16Jun 1, 2023Updated 3 years ago
- The Code Converter App is a versatile tool that allows users to convert, debug, and analyze code written in various programming languages…☆15Aug 27, 2023Updated 2 years ago
- Code repo for MathAgent☆21Dec 15, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆16Dec 16, 2024Updated last year
- This is AutoGenDemo☆11Mar 12, 2024Updated 2 years ago
- leaked prompts of GPTs☆12Nov 29, 2023Updated 2 years ago
- A free and open-source GUI tool that simplifies combining multiple code files into one, with automatic labeling and support for various p…☆15Jan 3, 2025Updated last year
- Quickly get custom prompt contexts☆14May 29, 2026Updated 2 months ago
- This project is concerned with my participating in the RuNNE competition https://github.com/dialogue-evaluation/RuNNE☆13Jun 28, 2023Updated 3 years ago
- Modern utility library and typescript typings for building JSON Schema documents☆14Nov 28, 2025Updated 8 months ago
- A Prompt Expander OpenAI-Based.☆14Nov 15, 2023Updated 2 years ago
- DLD: A Deep Learning Based Line Descriptor for Line Feature Matching☆18Nov 21, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Recaptured Screen Image Demoiréing. (TCSVT 2020)☆26Apr 8, 2021Updated 5 years ago
- [ICRA24] TSCM: A Teacher-Student Model for Vision Place Recognition Using Cross-Metric Knowledge Distillation☆19Sep 11, 2024Updated last year
- Claude Code vs Codex Reddit Sentiment Dashboard☆17Jun 24, 2026Updated last month
- ☆19Dec 22, 2020Updated 5 years ago
- Chat4GPT Experiments for Security☆11Mar 27, 2023Updated 3 years ago
- 一個Python ChatGPT TelegramBot快速建置平台。☆12Dec 27, 2022Updated 3 years ago
- LocalPlexity is a lite version of Perplexity aimed at 100% privacy and openness. Everything is done locally, in your browser, from search…☆21Aug 12, 2024Updated 2 years ago