EmbeddedLLM / embeddedllmLinks
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
☆42Updated 11 months ago
Alternatives and similar repositories for embeddedllm
Users that are interested in embeddedllm are comparing it to the libraries listed below
Sorting:
- Self-host LLMs with vLLM and BentoML☆149Updated last week
- ☆63Updated 5 months ago
- An Automatic Prompt Optimization Framework for Large Language Models☆117Updated last month
- Automatic Prompt Optimization☆42Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆86Updated last week
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 5 months ago
- ☆54Updated this week
- An AI Vision Language Model System for extracting structured knowledge graph information(JSON) from images of process diagrams☆29Updated 5 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆50Updated 11 months ago
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆105Updated 9 months ago
- ☆86Updated last month
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆92Updated 7 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 10 months ago
- ☆45Updated 4 months ago
- ☆40Updated 9 months ago
- ☆76Updated 6 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆95Updated this week
- Simple examples using Argilla tools to build AI☆55Updated 10 months ago
- Own your AI, search the web with it🌐😎☆89Updated 8 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated 10 months ago
- Unsloth Studio☆108Updated 5 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆64Updated last year
- LLM reads a paper and produce a working prototype☆56Updated 5 months ago
- Elasticsearch integration into LangChain☆59Updated 7 months ago
- Dynamic Metadata based RAG Framework☆75Updated last year
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆70Updated last year
- ☆231Updated 2 months ago
- CAMEL framework-based multi-agent system for task-driven and dynamic environments☆105Updated last year
- Example implementation of Iteration of Tought - Gives a star if you like the project☆43Updated 8 months ago
- ☆21Updated 10 months ago