continuedev / ggml-server-exampleLinks
An example of running local models with GGML
☆39Updated 2 years ago
Alternatives and similar repositories for ggml-server-example
Users that are interested in ggml-server-example are comparing it to the libraries listed below
Sorting:
- Client-side toolkit for using large language models, including where self-hosted☆113Updated this week
- A simple Web / UI / App / Frontend to Ollama.☆84Updated 7 months ago
- Example of calling OpenRouter from a Streamit app☆102Updated 2 years ago
- 🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup.☆164Updated last year
- Create chatbot and AI agent workflows with unified access.☆53Updated 2 weeks ago
- Easily create LLM automation/agent workflows☆60Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆119Updated last year
- Run language models on consumer hardware.☆27Updated 2 years ago
- 🔍 Code entity retrieval "GPT action" for ChatGPT!☆112Updated 2 years ago
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆29Updated last year
- Information on optimizing python libraries specifically for oobabooga to take advantage of Apple Silicon and Accelerate Framework.☆76Updated 9 months ago
- 🤖👨💻 Extension for attaching LocalAI instance to VSCode, LabLab Open Source AI Hackathon Submission☆51Updated 2 years ago
- automatically generate @openai plugins by specifying your API in markdown in smol-developer style☆118Updated 2 years ago
- Native gui to serveral AI services plus llama.cpp local AIs.☆117Updated last year
- ☆16Updated last year
- An Automated AI-Powered Prompt Optimization Framework☆206Updated last year
- 👩🏻🔬🧪SciTonic is a highly adaptive technical operator of agents that can produce complexe analyses on technical data with high perfor…☆53Updated 4 months ago
- Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.☆79Updated 2 years ago
- simplifies the process of creating and managing LLM workflows.☆112Updated last year
- ☆40Updated 2 years ago
- Python platform for working with LLMs☆40Updated last year
- My journey learning LangChain☆69Updated last year
- Code examples from the ChatGPT plugin documentation.☆57Updated 2 years ago
- A Function Calls Proxy for Groq, the fastest AI alive!☆205Updated last year
- 🤖📝 A markdown editor powered by AI (Ollama)☆64Updated last year
- ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints.☆89Updated this week
- CLI tool that generates commit messages from git changes, reviews code for quality issues, and provides debugging assistance. GitHub Acti…☆59Updated this week
- ☆32Updated last year
- Cody the coding ai assistant☆63Updated 8 months ago
- Host LLM via text-generation-inference☆16Updated last year