containers / ramalamaLinks
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
☆2,237Updated this week
Alternatives and similar repositories for ramalama
Users that are interested in ramalama are comparing it to the libraries listed below
Sorting:
- Reliable model swapping for any local OpenAI compatible server - llama.cpp, vllm, etc☆1,730Updated this week
- Boot and upgrade via container images☆1,578Updated this week
- InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data…☆1,372Updated this week
- the terminal client for Ollama☆2,219Updated last week
- Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPU…☆1,488Updated last week
- Work with LLMs on a local environment using containers☆259Updated this week
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙☆1,337Updated last week
- A powerful document AI question-answering tool that connects to your local Ollama models. Create, manage, and interact with RAG systems f…☆1,079Updated 2 months ago
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆2,105Updated 3 weeks ago
- VS Code extension for LLM-assisted code/text completion☆1,001Updated last week
- A container for deploying bootable container images.☆374Updated this week
- Generate Podman Quadlet files from a Podman command, compose file, or existing object☆1,115Updated 11 months ago
- An external provider for Llama Stack allowing for the use of RamaLama for inference.☆20Updated last week
- Support for bootable OS containers (bootc) and generating disk images☆461Updated this week
- ☆374Updated last week
- Examples for building and running LLM services and applications locally with Podman☆178Updated 2 months ago
- CodeGate: Security, Workspaces and Multiplexing for AI Agentic Frameworks☆707Updated 4 months ago
- Go manage your Ollama models☆1,494Updated 3 weeks ago
- 📖 Runbooks that run☆1,863Updated this week
- Podman desktop companion☆1,573Updated last week
- Tool for interactive command line environments on Linux☆3,053Updated last month
- Run LLM Agents on Ryzen AI PCs in Minutes☆668Updated this week
- ☆227Updated last week
- AI-Powered, Non-Intrusive Terminal Assistant☆1,227Updated this week
- Taxonomy tree that will allow you to create models tuned with your data☆285Updated last month
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆844Updated 6 months ago
- Artificial Neural Engine Machine Learning Library☆1,211Updated last month
- Red Hat Enterprise Linux AI -- Developer Preview☆166Updated last year
- Local AI API Platform☆2,758Updated 3 months ago
- An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifac…☆1,210Updated last week