continuedev / ggml-server-exampleLinks
An example of running local models with GGML
☆38Updated last year
Alternatives and similar repositories for ggml-server-example
Users that are interested in ggml-server-example are comparing it to the libraries listed below
Sorting:
- Run language models on consumer hardware.☆25Updated last year
- Create chatbot and AI agent workflows with unified access.☆53Updated last month
- Easily create LLM automation/agent workflows☆59Updated last year
- No-messing-around sh client for llama.cpp's server☆30Updated 11 months ago
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆30Updated 11 months ago
- AutoNL - Natural Language Automation tool☆85Updated last year
- 🤖📝 A markdown editor powered by AI (Ollama)☆62Updated 8 months ago
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated 2 years ago
- jQuery, React and Streamlit applications written by LLMs☆16Updated last year
- ☆16Updated last year
- Host LLM via text-generation-inference☆15Updated last year
- ☆30Updated 10 months ago
- A microframework for creating simple AI agents.☆90Updated 11 months ago
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆30Updated last year
- Developer-oriented ChatGPT clone☆170Updated 3 months ago
- 🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup. Powered by Lan…☆156Updated 8 months ago
- Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.☆67Updated 9 months ago
- iauto is a low-code engine for building and deploying AI agents☆88Updated 7 months ago
- simplifies the process of creating and managing LLM workflows.☆106Updated 8 months ago
- Example of calling OpenRouter from a Streamit app☆99Updated last year
- ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints.☆88Updated last month
- ☆104Updated 10 months ago
- Complex RAG backend☆28Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆116Updated last year
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆37Updated 2 years ago
- Client-side toolkit for using large language models, including where self-hosted☆111Updated 7 months ago
- OpenAI chat client desktop app (Windows, MacOS, Linux)☆170Updated last year
- A simple Web / UI / App / Frontend to Ollama.☆84Updated 3 months ago
- Embedding models from Jina AI☆61Updated last year
- Code examples from the ChatGPT plugin documentation.☆57Updated 2 years ago