continuedev / ggml-server-exampleLinks
An example of running local models with GGML
☆39Updated 2 years ago
Alternatives and similar repositories for ggml-server-example
Users that are interested in ggml-server-example are comparing it to the libraries listed below
Sorting:
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆118Updated last year
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆29Updated last year
- Example of calling OpenRouter from a Streamit app☆102Updated 2 years ago
- A simple Web / UI / App / Frontend to Ollama.☆84Updated 9 months ago
- simplifies the process of creating and managing LLM workflows.☆113Updated last year
- Client-side toolkit for using large language models, including where self-hosted☆114Updated last month
- Complex RAG backend☆29Updated last year
- ☆112Updated last year
- CLI tool that generates commit messages from git changes, reviews code for quality issues, and provides debugging assistance. GitHub Acti…☆60Updated last month
- ☆57Updated 2 years ago
- Run language models on consumer hardware.☆27Updated 2 years ago
- A Function Calls Proxy for Groq, the fastest AI alive!☆207Updated last year
- ☆54Updated 2 years ago
- Easily create LLM automation/agent workflows☆60Updated last year
- ☆24Updated last year
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆30Updated last year
- ☆40Updated 2 years ago
- OpenAI-Assistant API integration with Speech Recognition and Eleven Labs TTS. User can choose name, description, model of assistant and …☆18Updated 2 years ago
- Link you Ollama models to LM-Studio☆151Updated last year
- AutoNL - Natural Language Automation tool☆86Updated last year
- ☆109Updated last year
- Chatbot assistant enabling GitHub repository interaction using LLMs with Retrieval Augmented Generation☆315Updated last year
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆38Updated 2 years ago
- 🔍 Code entity retrieval "GPT action" for ChatGPT!☆112Updated 2 years ago
- Local LLMs in One Line Of Code (thanks to llamafile)☆43Updated 2 years ago
- 🤖📝 A markdown editor powered by AI (Ollama)☆64Updated last year
- OpenAI chat client desktop app (Windows, MacOS, Linux)☆175Updated 2 years ago
- 🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup.☆165Updated last year
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆90Updated 2 years ago
- ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints.☆91Updated 2 weeks ago