EmbeddedLLM / embeddedllmLinks
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
☆50Updated last year
Alternatives and similar repositories for embeddedllm
Users that are interested in embeddedllm are comparing it to the libraries listed below
Sorting:
- Self-host LLMs with vLLM and BentoML☆168Updated 2 weeks ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 9 months ago
- ☆67Updated 10 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆90Updated last month
- Example implementation of Iteration of Tought - Gives a star if you like the project☆41Updated last year
- ☆39Updated last year
- Elasticsearch integration into LangChain☆73Updated this week
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆92Updated last year
- LLM reads a paper and produce a working prototype☆60Updated 9 months ago
- Simple examples using Argilla tools to build AI☆57Updated last year
- ☆80Updated 4 months ago
- Dynamic Metadata based RAG Framework☆78Updated 2 months ago
- Own your AI, search the web with it🌐😎☆94Updated last year
- ☆43Updated 2 months ago
- ⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed, efficiency, and scalability 🚀☆63Updated 2 weeks ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆108Updated last year
- Benchmarking the serving capabilities of vLLM☆59Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆84Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆261Updated this week
- Training setup for Langchain's Open Deep Research☆74Updated 5 months ago
- ☆57Updated 2 weeks ago
- ☆21Updated last year
- ☆101Updated last year
- ☆184Updated last week
- Benchmark and optimize LLM inference across frameworks with ease☆161Updated 4 months ago
- ☆46Updated 2 years ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆82Updated 11 months ago
- ☆26Updated last year
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆73Updated 3 months ago