simonw / llm-mlc
LLM plugin for running models using MLC
☆178Updated 5 months ago
Related projects: ⓘ
- LLM plugin for running models using llama.cpp☆138Updated 7 months ago
- ☆133Updated 9 months ago
- LLM plugin providing access to Mistral models using the Mistral API☆144Updated last month
- Array-Inspired Pipeline Language☆119Updated 10 months ago
- LLM plugin providing access to local Ollama models using HTTP API☆91Updated last month
- Concatenate a directory full of files into a single prompt for use with LLMs☆357Updated last week
- Count and truncate text based on tokens☆255Updated 4 months ago
- Action library for AI Agent☆187Updated this week
- LLM plugin for interacting with the Claude 3 family of models☆214Updated 2 weeks ago
- ☆111Updated 7 months ago
- Claudette is Claude's friend☆165Updated 3 weeks ago
- FastMLX is a high performance production ready API to host MLX models.☆163Updated last week
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆196Updated 2 weeks ago
- Enforce structured output from LLMs 100% of the time☆241Updated last month
- Save OpenAI API results to a SQLite database☆223Updated 5 months ago
- ☆112Updated 3 months ago
- For inferring and serving local LLMs using the MLX framework☆77Updated 5 months ago
- Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…☆169Updated 5 months ago
- ⛓️ build cognitive systems, pythonic☆321Updated 2 months ago
- AI API implementation for Mac which supports tool-calling & other structured LLM response generation (e.g. conform to JSON schema)☆86Updated last week
- Embedding models from Jina AI☆55Updated 8 months ago
- Create keyboard shortcuts for an LLM using OpenAI GPT, Ollama, HuggingFace with Automator on macOS.☆134Updated 6 months ago
- Structured LLM APIs☆154Updated last year
- Use LLM to generate and execute commands in your shell☆108Updated last week
- Plugin for LLM adding support for the GPT4All collection of models☆209Updated 4 months ago
- A simple wrapper for OpenAI to log input/outputs.☆101Updated last year
- Easily copy all relevant source files in a repository to clipboard. For use in LLM code understanding and generation workflows☆131Updated last week
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆152Updated last year
- Chat Markup Language conversation library☆53Updated 8 months ago
- Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2☆86Updated last year