akx / ggify

Related projects: ⓘ

• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆72Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆30Updated 5 months ago
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆46Updated 11 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆119Updated this week
• abetlen / ggml-python
  Python bindings for ggml
  ☆125Updated 2 weeks ago
• cpldcpu / MisguidedAttention
  A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information
  ☆51Updated this week
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆55Updated 8 months ago
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆116Updated last week
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆52Updated 11 months ago
• dottxt-ai / prompts
  A prompting library
  ☆83Updated last week
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆35Updated last year
• cognitivecomputations / kraken
  ☆64Updated 3 months ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆54Updated 2 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆68Updated last week
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆48Updated 9 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆109Updated 3 months ago
• ialacol / text-inference-batcher
  A high performance batching router optimises max throughput for text inference workload
  ☆15Updated last year
• gradsflow / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆55Updated 2 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆58Updated 2 weeks ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆68Updated 7 months ago
• bhimrazy / chat-with-phi-3-vision
  Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…
  ☆25Updated last week
• EdwardDali / erag
  an AI interaction tool with RAG hybrid search, conversation context, web content processing and structured data analysis with LLM / GPT
  ☆79Updated this week
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆36Updated 7 months ago
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆19Updated 2 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆36Updated 7 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆157Updated last week
• runpod-workers / worker-faster_whisper
  🎧 | RunPod worker of the faster-whisper model for Serverless Endpoint.
  ☆64Updated last month
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆62Updated this week
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆173Updated 11 months ago