continuedev / ggml-server-example
An example of running local models with GGML
☆39Updated last year
Alternatives and similar repositories for ggml-server-example
Users that are interested in ggml-server-example are comparing it to the libraries listed below
Sorting:
- Run language models on consumer hardware.☆25Updated last year
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆37Updated last year
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆31Updated 9 months ago
- Easily create LLM automation/agent workflows☆59Updated last year
- ☆16Updated last year
- ☆31Updated last year
- ☆28Updated 8 months ago
- Prompt Jinja2 templates for LLMs☆29Updated 4 months ago
- jQuery, React and Streamlit applications written by LLMs☆16Updated last year
- Neuroengine is a service to share LLMs in the form of a webchat and API.☆45Updated 6 months ago
- ☆41Updated 2 years ago
- AI Developer is an AI agent powered by GPT-4-Turbo that's using custom E2B Sandbox☆47Updated 3 months ago
- A web-app to explore topics using LLM (less typing and more clicks)☆66Updated last year
- Python library and CLI for AI tools☆63Updated last year
- AI system powered by large language models.☆32Updated this week
- ☆49Updated last year
- Complex RAG backend☆28Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated 11 months ago
- 🤖📝 A markdown editor powered by AI (Ollama)☆63Updated 6 months ago
- Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.☆78Updated last year
- "Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp …☆35Updated last year
- Host LLM via text-generation-inference☆15Updated last year
- "Just hoof it!" - A spotlight like interface to Ollama☆62Updated last year
- iauto is a low-code engine for building and deploying AI agents☆87Updated 5 months ago
- Hubcap is an autonomous AI agent in 25 lines of code: a small Autobot that you can't trust☆38Updated last year
- Spark is an Auto-GPT alternative that uses LocalAI.☆83Updated last year
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆29Updated 11 months ago
- AutoNL - Natural Language Automation tool☆85Updated last year
- Examples and guides for using the Steel API☆36Updated 2 weeks ago
- ☆54Updated last year