EmbeddedLLM / embeddedllmLinks
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
☆50Updated last year
Alternatives and similar repositories for embeddedllm
Users that are interested in embeddedllm are comparing it to the libraries listed below
Sorting:
- Self-host LLMs with vLLM and BentoML☆168Updated 2 weeks ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 9 months ago
- ☆39Updated last year
- A collection of all available inference solutions for the LLMs☆94Updated 11 months ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆85Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- Benchmark and optimize LLM inference across frameworks with ease☆161Updated 4 months ago
- GRDN.AI app for garden optimization☆69Updated 2 months ago
- Example implementation of Iteration of Tought - Gives a star if you like the project☆41Updated last year
- Nexusflow function call, tool use, and agent benchmarks.☆30Updated last year
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆108Updated last year
- ☆57Updated 2 weeks ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆90Updated last month
- ☆57Updated 11 months ago
- ☆67Updated 10 months ago
- Dynamic Metadata based RAG Framework☆78Updated 2 months ago
- Elasticsearch integration into LangChain☆73Updated this week
- ☆46Updated 2 years ago
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆139Updated 2 weeks ago
- ☆101Updated last year
- An agent to generate stunning images :)☆23Updated 8 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆92Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆84Updated last year
- Own your AI, search the web with it🌐😎☆94Updated last year
- ☆107Updated 3 months ago
- Simple examples using Argilla tools to build AI☆57Updated last year
- ☆68Updated last year
- ☆80Updated 4 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated 2 years ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆261Updated this week