continuedev / ggml-server-example
An example of running local models with GGML
β39Updated last year
Alternatives and similar repositories for ggml-server-example:
Users that are interested in ggml-server-example are comparing it to the libraries listed below
- Run language models on consumer hardware.β25Updated last year
- π©π»βπ¬π§ͺSciTonic is a highly adaptive technical operator of agents that can produce complexe analyses on technical data with high perforβ¦β50Updated last year
- Hub for Open Source AGiXT Extensions, Chains, Prompts, and Agents.β17Updated last year
- Easily create LLM automation/agent workflowsβ58Updated 11 months ago
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.β31Updated 6 months ago
- "Just hoof it!" - A spotlight like interface to Ollamaβ57Updated 9 months ago
- Spark is an Auto-GPT alternative that uses LocalAI.β79Updated last year
- Local LLM inference & management server with built-in OpenAI APIβ31Updated 9 months ago
- A QT GUI for large language modelsβ28Updated last year
- Complex RAG backendβ28Updated 10 months ago
- A web-app to explore topics using LLM (less typing and more clicks)β66Updated last year
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easilyβ35Updated 9 months ago
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-tβ¦β29Updated 8 months ago
- AutoNL - Natural Language Automation toolβ85Updated 10 months ago
- Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.β79Updated last year
- Create chatbot and AI agent workflows with unified access.β39Updated this week
- Something similar to Apple Intelligence?β58Updated 6 months ago
- β49Updated last year
- Python library and CLI for AI toolsβ63Updated last year
- Example of calling OpenRouter from a Streamit appβ94Updated last year
- A guidance compatibility layer for llama-cpp-pythonβ34Updated last year
- β15Updated 10 months ago
- π€π A markdown editor powered by AI (Ollama)β56Updated 3 months ago
- πΈ The open framework for question answering fine-tuning LLMs on private dataβ69Updated last year
- LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to β¦β37Updated 5 months ago
- LLM Chat is an open-source serverless alternative to ChatGPT.β31Updated 4 months ago
- An API for VoiceCraft.β26Updated 7 months ago
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.β25Updated last year
- jQuery, React and Streamlit applications written by LLMsβ16Updated last year
- jemma & her ai agents that build softwareβ92Updated 8 months ago