continuedev / ggml-server-exampleLinks
An example of running local models with GGML
β39Updated 2 years ago
Alternatives and similar repositories for ggml-server-example
Users that are interested in ggml-server-example are comparing it to the libraries listed below
Sorting:
- π¦ Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup.β165Updated last year
- ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints.β91Updated last week
- Client-side toolkit for using large language models, including where self-hostedβ115Updated this week
- β113Updated last year
- simplifies the process of creating and managing LLM workflows.β113Updated last year
- π©π»βπ¬π§ͺSciTonic is a highly adaptive technical operator of agents that can produce complexe analyses on technical data with high perforβ¦β53Updated 6 months ago
- A Function Calls Proxy for Groq, the fastest AI alive!β207Updated last year
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.β29Updated last year
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.β154Updated last year
- Run language models on consumer hardware.β27Updated 2 years ago
- Python library and CLI for AI toolsβ63Updated 2 years ago
- Distribute and run llamafile/LLMs with a single docker image.β74Updated 8 months ago
- π€π A markdown editor powered by AI (Ollama)β64Updated last year
- π Awesome list of resources about using and building AI software development systemsβ117Updated last year
- β49Updated 2 years ago
- Refact - Open-Source AI Agent, Code Generator & Chat for JavaScript, Python, TypeScript, Java, PHP, Go, and more.β172Updated 2 weeks ago
- automatically generate @openai plugins by specifying your API in markdown in smol-developer styleβ119Updated 2 years ago
- π Code entity retrieval "GPT action" for ChatGPT!β112Updated 2 years ago
- Open-source software engineerβ182Updated last year
- Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.β78Updated 2 years ago
- Build multi-model chatbots and agents from intent.β56Updated this week
- iauto is a low-code engine for building and deploying AI agentsβ92Updated last year
- Leveraging LLM to build Conversational UIsβ131Updated 10 months ago
- Your AI Peer Review Broβ91Updated last year
- "Just hoof it!" - A spotlight like interface to Ollamaβ63Updated last year
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.β165Updated 2 years ago
- β34Updated last year
- Web Application that can generate code and fix bugs and run using various LLM's (GPT,Gemini,PALM)β127Updated last year
- Information on optimizing python libraries specifically for oobabooga to take advantage of Apple Silicon and Accelerate Framework.β77Updated 11 months ago
- CodeWhisper: AI-Powered End-to-End Task Implementation & blazingly fast Codebase-to-LLM Context Bridgeβ98Updated last month