continuedev / ggml-server-example
An example of running local models with GGML
☆39Updated last year
Alternatives and similar repositories for ggml-server-example:
Users that are interested in ggml-server-example are comparing it to the libraries listed below
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆37Updated last year
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆31Updated 9 months ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆36Updated last year
- Extract structured data from local or remote LLM models☆41Updated 10 months ago
- Example of calling OpenRouter from a Streamit app☆94Updated last year
- Easily create LLM automation/agent workflows☆59Updated last year
- Run language models on consumer hardware.☆25Updated last year
- Client-side toolkit for using large language models, including where self-hosted☆108Updated 5 months ago
- ☆16Updated last year
- jQuery, React and Streamlit applications written by LLMs☆16Updated last year
- Create chatbot and AI agent workflows with unified access.☆50Updated 3 weeks ago
- Host LLM via text-generation-inference☆15Updated last year
- 🤖📝 A markdown editor powered by AI (Ollama)☆63Updated 6 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated 11 months ago
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆25Updated last year
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated 10 months ago
- Open Source Embeddings Optimisation and Eval Framework for RAG/LLM Applications. Documentations at https://docs.vectorboard.ai/introducti…☆50Updated last year
- ☆11Updated last year
- ☆49Updated last year
- Spark is an Auto-GPT alternative that uses LocalAI.☆83Updated last year
- ☆26Updated 7 months ago
- No-messing-around sh client for llama.cpp's server☆31Updated 8 months ago
- Your Python AI Coder!☆33Updated last week
- OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabil…☆29Updated last year
- Something similar to Apple Intelligence?☆60Updated 9 months ago
- Run and save the code in Chat-GPT directly in your browser, Supports upto 70+ languages.☆40Updated 3 months ago
- A collection of ready to use ollama models☆16Updated last year
- Fill up the `model_list` field in your LiteLLM proxy configuration file☆10Updated 7 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆90Updated 9 months ago
- openai-functools: Simplified Generation of OpenAI Functions JSON Metadata for OpenAI Function Calling☆71Updated last month