continuedev / ggml-server-exampleLinks
An example of running local models with GGML
☆39Updated last year
Alternatives and similar repositories for ggml-server-example
Users that are interested in ggml-server-example are comparing it to the libraries listed below
Sorting:
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆42Updated 3 weeks ago
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated 2 years ago
- Run language models on consumer hardware.☆25Updated last year
- Easily create LLM automation/agent workflows☆59Updated last year
- jQuery, React and Streamlit applications written by LLMs☆16Updated last year
- Local LLaMAs/Models in VSCode☆53Updated 2 years ago
- ☆49Updated 2 years ago
- ☆29Updated 9 months ago
- Visual Studio Code extension for WizardCoder☆148Updated last year
- Open Source LLM proxy that transparently captures and logs all interactions with LLM API☆58Updated last week
- ☆24Updated last year
- No-messing-around sh client for llama.cpp's server☆30Updated 10 months ago
- Complex RAG backend☆28Updated last year
- Chatroom app where messages are sent to GPT, Claude, Mistral, Together, Grok, Groq, Google, vLLM, Ollama & streamed to the frontend.☆40Updated this week
- Full Spectrum AI☆84Updated last year
- Create chatbot and AI agent workflows with unified access.☆52Updated 3 weeks ago
- 🤖📝 A markdown editor powered by AI (Ollama)☆62Updated 8 months ago
- Web UI for working with large language models☆33Updated last year
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆30Updated last year
- SynerGPT demonstrates the power of collaboration between two or more Large Language Models (LLMs) to efficiently solve complex problems a…☆23Updated last year
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆31Updated 11 months ago
- ☆16Updated last year
- Code examples from the ChatGPT plugin documentation.☆57Updated 2 years ago
- AI-powered tool for developers, simplifying coding tasks and improving workflow efficiency. 🤖☆57Updated 3 months ago
- Spark is an Auto-GPT alternative that uses LocalAI.☆83Updated last year
- The FunctionChain is a tool that simplifies and organizes the process of invoking OpenAI functions in your Node.js applications. With thi…☆55Updated last year
- ☆41Updated 2 years ago
- An awesome & curated list of best LLMOps tools for developers☆25Updated 2 years ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆37Updated 2 years ago
- Host LLM via text-generation-inference☆15Updated last year