MekkCyber / EdgeLLMLinks
Deploying large language models on edge
☆84Updated 4 months ago
Alternatives and similar repositories for EdgeLLM
Users that are interested in EdgeLLM are comparing it to the libraries listed below
Sorting:
- Self-host LLMs with vLLM and BentoML☆168Updated 2 weeks ago
- One click templates for inferencing Language Models☆228Updated 2 months ago
- Verifiers for LLM Reinforcement Learning☆81Updated 4 months ago
- ☆107Updated 3 months ago
- React Native binding of llama.cpp☆796Updated this week
- ☆181Updated 11 months ago
- Fast parallel LLM inference for MLX☆246Updated last year
- Own your AI, search the web with it🌐😎☆94Updated last year
- Luth is a state-of-the-art series of fine-tuned LLMs for French☆41Updated 3 months ago
- Collection of scripts and notebooks for OpenAI's latest GPT OSS models☆496Updated 5 months ago
- ☆135Updated last month
- Inference, Fine Tuning and many more recipes with Gemma family of models☆279Updated 6 months ago
- ☆129Updated 4 months ago
- From data to vector database effortlessly☆90Updated 8 months ago
- chrome & firefox extension to chat with webpages: local llms☆131Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆119Updated last year
- React Native binding of llama.cpp☆45Updated 2 weeks ago
- ☆159Updated 9 months ago
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆273Updated 3 months ago
- Utils for Unsloth https://github.com/unslothai/unsloth☆191Updated this week
- Unsloth Studio☆126Updated 10 months ago
- Finetune Llama-3-8b on the MathInstruct dataset☆115Updated last year
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆103Updated last year
- Routing on Random Forest (RoRF)☆239Updated last year
- ☆270Updated 7 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 9 months ago
- Together Open Deep Research☆358Updated 9 months ago
- On-device intelligence.☆394Updated 10 months ago
- A Lightweight Library for AI Observability☆255Updated 11 months ago
- 🤗 Benchmark Large Language Models Reliably On Your Data☆426Updated last month