simonw / llm-mlc
LLM plugin for running models using MLC
☆185Updated last year
Alternatives and similar repositories for llm-mlc:
Users that are interested in llm-mlc are comparing it to the libraries listed below
- LLM plugin for running models using llama.cpp☆143Updated last year
- LLM plugin providing access to Mistral models using the Mistral API☆173Updated last month
- Array-Inspired Pipeline Language☆119Updated last year
- ☆135Updated last year
- LLM plugin for interacting with the Claude 3 family of models☆292Updated 2 months ago
- For inferring and serving local LLMs using the MLX framework☆101Updated last year
- CLI tool for running text through OpenAI Text to speech☆165Updated last year
- LLM plugin for clustering embeddings☆74Updated last year
- Count and truncate text based on tokens☆328Updated 11 months ago
- Save OpenAI API results to a SQLite database☆232Updated last year
- LLM plugin providing access to models running on an Ollama server☆272Updated last week
- GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…☆122Updated last month
- ⛓️ build cognitive systems, pythonic☆333Updated 5 months ago
- Your friendly terminal-based AI pair programmer☆42Updated last year
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆159Updated last year
- A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX☆53Updated last year
- Execute IPython & Jupyter from the comforts of chat.openai.com☆77Updated 2 years ago
- ☆113Updated last year
- Convert a Claude.ai export to SQLite☆47Updated 5 months ago
- Support for MLX models in LLM☆109Updated 2 months ago
- Chat Markup Language conversation library☆55Updated last year
- Embedding models from Jina AI☆58Updated last year
- Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.☆437Updated 2 months ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆153Updated last year
- Create keyboard shortcuts for an LLM using OpenAI GPT, Ollama, HuggingFace with Automator on macOS.☆148Updated last year
- FastMLX is a high performance production ready API to host MLX models.☆289Updated last month
- A simple wrapper for OpenAI to log input/outputs.☆104Updated last year
- Structured LLM APIs☆156Updated last year
- smol-podcaster is your podcast production agent 🎙️☆337Updated 7 months ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆137Updated 2 years ago