danielgross / ggml-k8sLinks
Run GGML models with Kubernetes.
☆172Updated last year
Alternatives and similar repositories for ggml-k8s
Users that are interested in ggml-k8s are comparing it to the libraries listed below
Sorting:
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆187Updated last year
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆151Updated last year
- run embeddings in MLX☆89Updated 8 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- ☆89Updated 8 months ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated last year
- run paligemma in real time☆131Updated last year
- An HTTP serving framework by Banana☆99Updated last year
- Chat Markup Language conversation library☆55Updated last year
- An mlx project to train a base model on your whatsapp chats using (Q)Lora finetuning☆166Updated last year
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- A feed of trending repos/models from GitHub, Replicate, HuggingFace, and Reddit.☆132Updated 8 months ago
- ☆134Updated last year
- Foyle is a copilot to help developers deploy and operate their applications.☆129Updated 2 months ago
- Full finetuning of large language models without large memory requirements☆93Updated last year
- Simple Transformer in Jax☆137Updated 11 months ago
- A miniature version of Modal☆20Updated 11 months ago
- Command-line script for inferencing from models such as falcon-7b-instruct☆74Updated 2 years ago
- Demo of AI chatbot that predicts user message to generate response quickly.☆101Updated last year
- Cerule - A Tiny Mighty Vision Model☆66Updated 8 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.☆143Updated last week
- papers.day☆92Updated last year
- Fluid Database☆114Updated 8 months ago
- Logging and caching superpowers for the openai sdk☆105Updated last year
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆59Updated last year
- ☆98Updated last year
- ☆143Updated 2 years ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆76Updated last month
- LLaVA server (llama.cpp).☆179Updated last year