simonw / llm-mlcLinks
LLM plugin for running models using MLC
☆187Updated last year
Alternatives and similar repositories for llm-mlc
Users that are interested in llm-mlc are comparing it to the libraries listed below
Sorting:
- LLM plugin for running models using llama.cpp☆143Updated last year
- ☆135Updated last year
- Enforce structured output from LLMs 100% of the time☆249Updated 11 months ago
- Array-Inspired Pipeline Language☆119Updated last year
- LLM plugin providing access to Mistral models using the Mistral API☆183Updated 3 weeks ago
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆160Updated last year
- Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2☆86Updated last year
- CLI tool for running text through OpenAI Text to speech☆168Updated last year
- Support for MLX models in LLM☆185Updated last month
- ⛓️ build cognitive systems, pythonic☆336Updated 7 months ago
- For inferring and serving local LLMs using the MLX framework☆104Updated last year
- ☆114Updated last year
- Action library for AI Agent☆215Updated 2 months ago
- Create keyboard shortcuts for an LLM using OpenAI GPT, Ollama, HuggingFace with Automator on macOS.☆151Updated last year
- Your friendly terminal-based AI pair programmer☆41Updated 2 years ago
- Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…☆175Updated last year
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆152Updated last year
- Chat Markup Language conversation library☆55Updated last year
- Finetune llama2-70b and codellama on MacBook Air without quantization☆447Updated last year
- Train a language model to answer Slack messages as you.☆245Updated 2 months ago
- Save OpenAI API results to a SQLite database☆232Updated last year
- 🔍 Code entity retrieval "GPT action" for ChatGPT!☆111Updated last year
- Structured LLM APIs☆156Updated last year
- Embedding models from Jina AI☆60Updated last year
- Claudette is Claude's friend☆243Updated last week
- A simple wrapper for OpenAI to log input/outputs.☆105Updated last year
- Python notebook to run OpenAI's Whisper model with speaker identification☆80Updated 2 years ago
- CLI based natural language queries on local or remote data☆244Updated 3 months ago
- ⚡️🧪 Fast LLM Tool Calling Experimentation, big and smol☆146Updated 8 months ago
- GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…☆126Updated 3 weeks ago