EmbeddedLLM / embeddedllmLinks
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
☆40Updated 8 months ago
Alternatives and similar repositories for embeddedllm
Users that are interested in embeddedllm are comparing it to the libraries listed below
Sorting:
- Self-host LLMs with vLLM and BentoML☆123Updated this week
- ☆17Updated 10 months ago
- ⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed, efficiency, and scalability 🚀☆56Updated 2 weeks ago
- ☆62Updated 3 months ago
- Embed anything.☆28Updated last year
- ☆21Updated 7 months ago
- LLM reads a paper and produce a working prototype☆57Updated 2 months ago
- Own your AI, search the web with it🌐😎☆86Updated 5 months ago
- Code for paper https://arxiv.org/abs/2501.00522☆12Updated 2 months ago
- LLM as Interpreter for Natural Language Programming, Pseudo-code Programming and Flow Programming of AI Agents☆40Updated 11 months ago
- ☆45Updated 11 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆80Updated 3 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 7 months ago
- LLM inference in C/C++☆77Updated last week
- Example implementation of Iteration of Tought - Gives a star if you like the project☆41Updated 6 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆71Updated 8 months ago
- ☆12Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 5 months ago
- ☆76Updated 5 months ago
- ☆36Updated 4 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆61Updated 11 months ago
- ☆41Updated 6 months ago
- ☆50Updated this week
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆71Updated this week
- augini: AI-Powered Tabular Data Assistant☆30Updated 4 months ago
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆41Updated 4 months ago
- ☆41Updated 2 weeks ago
- ☆1Updated 11 months ago
- An intelligent code optimization system leveraging AI analysis, automated refactoring, and test generation. Built with DSPy and Gradio, i…☆20Updated 4 months ago
- Simple examples using Argilla tools to build AI☆53Updated 7 months ago