abgulati / kosmos-2_5-containerizedLinks
Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-script based invocation make it difficult to use for application development. Here, it has been containerized and made available via an API, greatly enhancing its ease-of-use.
☆62Updated 10 months ago
Alternatives and similar repositories for kosmos-2_5-containerized
Users that are interested in kosmos-2_5-containerized are comparing it to the libraries listed below
Sorting:
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆134Updated this week
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 8 months ago
- A fast batching API to serve LLM models☆181Updated last year
- ☆28Updated 8 months ago
- ☆129Updated last month
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆72Updated 8 months ago
- ☆90Updated 5 months ago
- ☆75Updated 2 weeks ago
- AI management tool☆116Updated 6 months ago
- Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)☆52Updated 7 months ago
- A flexible, adaptive classification system for dynamic text classification☆199Updated 3 weeks ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 8 months ago
- Guide on text completion large language model fine-tuning, including example scripts and training data acquiring.☆75Updated 3 months ago
- ☆48Updated 3 months ago
- Convert URLs into LLM-friendly markdown chunks☆64Updated 9 months ago
- Easily view and modify JSON datasets for large language models☆75Updated 2 weeks ago
- ☆128Updated last month
- A simple experiment on letting two local LLM have a conversation about anything!☆110Updated 11 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆153Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- ☆17Updated 5 months ago
- Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…☆65Updated 9 months ago
- ☆114Updated 5 months ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆45Updated last year
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆65Updated this week
- ☆204Updated last year
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆84Updated 5 months ago
- Blue-text Bot AI. Uses Ollama + AppleScript☆50Updated last year
- Gradio based tool to run opensource LLM models directly from Huggingface☆91Updated 11 months ago
- ☆66Updated last year