monk1337 / auto-ollama
run ollama & gguf easily with a single command
☆49Updated 9 months ago
Alternatives and similar repositories for auto-ollama:
Users that are interested in auto-ollama are comparing it to the libraries listed below
- ☆24Updated last month
- Local LLM inference & management server with built-in OpenAI API☆31Updated 10 months ago
- entropix style sampling + GUI☆25Updated 4 months ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 6 months ago
- ☆16Updated 2 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆56Updated 3 months ago
- Complex RAG backend☆28Updated 11 months ago
- Text generation in Python, as easy as possible☆55Updated this week
- Something similar to Apple Intelligence?☆59Updated 8 months ago
- Easily view and modify JSON datasets for large language models☆71Updated last week
- Let's create synthetic textbooks together :)☆73Updated last year
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆72Updated 2 months ago
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆21Updated 2 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆58Updated 6 months ago
- Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.☆41Updated 5 months ago
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆26Updated last month
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆12Updated last year
- ☆124Updated this week
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆37Updated 2 weeks ago
- ☆21Updated 4 months ago
- A pipeline parallel training script for LLMs.☆128Updated last month
- Experimental sampler to make LLMs more creative☆30Updated last year
- ☆65Updated 9 months ago
- ☆111Updated 2 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆69Updated 6 months ago
- 5X faster 60% less memory QLoRA finetuning☆21Updated 9 months ago
- ☆39Updated last year
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.☆20Updated last week