MekkCyber / EdgeLLMLinks
Deploying large language models on edge
☆83Updated 3 months ago
Alternatives and similar repositories for EdgeLLM
Users that are interested in EdgeLLM are comparing it to the libraries listed below
Sorting:
- Fast parallel LLM inference for MLX☆243Updated last year
- Inference, Fine Tuning and many more recipes with Gemma family of models☆279Updated 6 months ago
- React Native binding of llama.cpp☆45Updated last week
- One click templates for inferencing Language Models☆227Updated 2 months ago
- React Native binding of llama.cpp☆794Updated this week
- chrome & firefox extension to chat with webpages: local llms☆131Updated last year
- Own your AI, search the web with it🌐😎☆94Updated last year
- ☆159Updated 9 months ago
- ☆242Updated 10 months ago
- ☆107Updated 3 months ago
- ☆181Updated 11 months ago
- ☆207Updated last year
- Run LLMs in the Browser with MLC / WebLLM ✨☆149Updated last year
- From data to vector database effortlessly☆90Updated 8 months ago
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆458Updated 5 months ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆85Updated 5 months ago
- ☆135Updated last month
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆273Updated 2 months ago
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆103Updated last year
- Verifiers for LLM Reinforcement Learning☆81Updated 4 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆282Updated this week
- Self-host LLMs with vLLM and BentoML☆167Updated last week
- Voice AI agent starter kit with Groq, Llama 4, and (optionally) Twilio☆73Updated 4 months ago
- Together Open Deep Research☆356Updated 9 months ago
- The code repository of the paper: Competition and Attraction Improve Model Fusion☆169Updated 5 months ago
- A pipecat bot demo implementation of a Spotify assistant for creating playlists☆19Updated 3 months ago
- On-device intelligence.☆394Updated 10 months ago
- Unsloth Studio☆125Updated 9 months ago
- Train Large Language Models on MLX.☆241Updated 2 weeks ago
- A simple Python program to implement the search-extract-summarize flow.☆276Updated 7 months ago