simonw / llm-mlc
LLM plugin for running models using MLC
☆182Updated 10 months ago
Alternatives and similar repositories for llm-mlc:
Users that are interested in llm-mlc are comparing it to the libraries listed below
- LLM plugin for running models using llama.cpp☆140Updated last year
- ☆136Updated last year
- Array-Inspired Pipeline Language☆119Updated last year
- LLM plugin providing access to models running on an Ollama server☆219Updated last week
- LLM plugin providing access to Mistral models using the Mistral API☆159Updated last month
- Embedding models from Jina AI☆57Updated last year
- A program synthesis agent that autonomously fixes its output by running tests!☆446Updated 4 months ago
- Enforce structured output from LLMs 100% of the time☆245Updated 6 months ago
- Save OpenAI API results to a SQLite database☆228Updated 9 months ago
- LLM plugin for models hosted by OpenRouter☆93Updated last month
- Ask questions, let GPT do the SQL.☆132Updated last year
- Count and truncate text based on tokens☆288Updated 8 months ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆153Updated last year
- Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2☆87Updated last year
- ⛓️ build cognitive systems, pythonic☆329Updated 2 months ago
- ☆113Updated 11 months ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆131Updated 6 months ago
- Demos utilizing the ChatGPT API☆95Updated last year
- A simple wrapper for OpenAI to log input/outputs.☆103Updated last year
- Praetor is a lightweight finetuning data and prompt management tool☆64Updated 2 months ago
- OpenAI-compatible Python client that can call any LLM☆369Updated last year
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- LLM plugin for clustering embeddings☆66Updated 10 months ago
- run embeddings in MLX☆81Updated 4 months ago
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆157Updated last year
- CLI tool for running text through OpenAI Text to speech☆163Updated last year
- Wraps openai.ChatCompletion to produce pydantic model output via schema prompt and error feedback.☆54Updated last year
- Complex LLM Workflows from Simple JSON.☆290Updated last year
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆324Updated last year
- Structured LLM APIs☆155Updated last year