Alternatives and similar repositories for ggify:

Users that are interested in ggify are comparing it to the libraries listed below

• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆46Updated 2 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆67Updated last month
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆177Updated 8 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆66Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆30Updated 7 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆68Updated 3 months ago
• unslothai / unsloth-studio
  Unsloth Studio
  ☆48Updated 2 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆68Updated 4 months ago
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆111Updated last month
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆166Updated 8 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆46Updated 3 months ago
• gradion-ai / freeact
  freeact is a lightweight library for code-action based agents
  ☆50Updated this week
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆245Updated 11 months ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆73Updated 11 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆218Updated last month
• TC-Zheng / ActuosusAI
  AI management tool
  ☆112Updated 2 months ago
• cognitivecomputations / kraken
  ☆65Updated 7 months ago
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆23Updated last year
• LeonEricsson / llmcontext
  Pressure testing the context window of open LLMs
  ☆22Updated 4 months ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆101Updated 8 months ago
• rgbkrk / chatlab
  ⚡️🧪 Fast LLM Tool Calling Experimentation, big and smol
  ☆141Updated 3 months ago
• distantmagic / llmops-handbook
  Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…
  ☆58Updated 5 months ago
• cognitivecomputations / OpenChatML
  ☆151Updated 6 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆116Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆49Updated 8 months ago
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆90Updated 9 months ago
• nydasco / jen-ai
  A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.
  ☆43Updated 11 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆69Updated this week