EmbeddedLLM / embeddedllmLinks
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
☆43Updated last year
Alternatives and similar repositories for embeddedllm
Users that are interested in embeddedllm are comparing it to the libraries listed below
Sorting:
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆113Updated 7 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆88Updated this week
- Self-host LLMs with vLLM and BentoML☆157Updated this week
- ☆40Updated 11 months ago
- Own your AI, search the web with it🌐😎☆92Updated 10 months ago
- ☆64Updated 8 months ago
- LLM reads a paper and produce a working prototype☆58Updated 7 months ago
- Tutorial for building LLM router☆236Updated last year
- Example implementation of Iteration of Tought - Gives a star if you like the project☆41Updated 11 months ago
- ☆57Updated last week
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆107Updated 11 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 10 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated 11 months ago
- ☆43Updated 2 weeks ago
- Elasticsearch integration into LangChain☆66Updated last month
- ☆80Updated 2 weeks ago
- Automatic Prompt Optimization☆48Updated last year
- Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…☆76Updated last year
- ☆47Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆81Updated 9 months ago
- Dynamic Metadata based RAG Framework☆78Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- Training setup for Langchain's Open Deep Research☆72Updated 3 months ago
- ☆57Updated 9 months ago
- Official Repo for The Paper "Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems"☆58Updated 9 months ago
- ☆67Updated 5 months ago
- Nexusflow function call, tool use, and agent benchmarks.☆30Updated 11 months ago
- ☆79Updated last month
- ☆21Updated last year
- Simple examples using Argilla tools to build AI☆56Updated last year