Alternatives and similar repositories for collama:

Users that are interested in collama are comparing it to the libraries listed below

• mostlygeek / llama-swap
  transparent proxy server for llama.cpp's server to provide automatic model swapping
  ☆135Updated this week
• MindWorkAI / AI-Studio
  AI Studio is an independent app for utilizing LLM.
  ☆190Updated this week
• cognitivecomputations / dolphin-system-messages
  Dolphin System Messages
  ☆226Updated 3 months ago
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆203Updated this week
• 1runeberg / confichat
  Lightweight, standalone, multi-platform, and privacy focused local LLM chat interface with optional encryption
  ☆78Updated 2 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆150Updated this week
• fingerthief / minimal-chat
  MinimalChat is a lightweight, open-source chat application that allows you to interact with various large language models.
  ☆150Updated 5 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆460Updated 3 weeks ago
• lmstudio-ai / configs
  LM Studio JSON configuration file format and a collection of example config files.
  ☆189Updated 5 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆217Updated last month
• shadowfax92 / Fyin
  Open source alternative to Perplexity AI with ability to run locally
  ☆175Updated 3 months ago
• sammcj / ingest
  Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs
  ☆112Updated last month
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆69Updated this week
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆213Updated 3 months ago
• chigkim / Ollama-MMLU-Pro
  ☆73Updated 3 weeks ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆177Updated 8 months ago
• mudler / LocalAGI
  100% Local AGI with LocalAI
  ☆431Updated 6 months ago
• janhq / ichigo-demo
  ☆88Updated this week
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆68Updated 4 months ago
• RussellCanfield / wingman-ai
  An open-source VSCode extension, the AI coding assistant, integrates with Ollama, HuggingFace, OpenAI, and Anthropic.
  ☆170Updated this week
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆113Updated 7 months ago
• sammcj / llamalink
  Link you Ollama models to LM-Studio
  ☆118Updated 6 months ago
• matteoserva / GraphLLM
  ☆181Updated last month
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆155Updated last week
• AndrewVeee / nucleo-ai
  An AI assistant beyond the chat box.
  ☆317Updated 10 months ago
• RandomInternetPreson / Lucid_Autonomy
  An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…
  ☆103Updated 2 months ago
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆169Updated 3 months ago
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated 3 months ago
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆485Updated this week
• remichu-ai / gallama
  ☆121Updated this week