sammcj / moa
Mixture-of-Ollamas
☆25Updated last month
Related projects: ⓘ
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆59Updated this week
- This project is a reverse-engineered version of Figma's tone changer. It uses Groq's Llama-3-8b for high-speed inference and to adjust th…☆86Updated last month
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆85Updated this week
- ☆37Updated 2 months ago
- Local LLM inference & management server with built-in OpenAI API☆30Updated 5 months ago
- ☆101Updated 6 months ago
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆68Updated 3 weeks ago
- automatically quant GGUF models☆119Updated this week
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆101Updated 2 months ago
- Something similar to Apple Intelligence?☆54Updated 2 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆84Updated 2 months ago
- A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information☆51Updated this week
- A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to…☆133Updated last week
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated last month
- Easily view and modify JSON datasets for large language models☆55Updated this week
- ☆95Updated this week
- A pipeline parallel training script for LLMs.☆79Updated last month
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆41Updated last month
- run ollama & gguf easily with a single command☆46Updated 4 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆109Updated 3 months ago
- ☆29Updated 4 months ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3☆33Updated last week
- idea: https://github.com/nyxkrage/ebook-groupchat/☆77Updated last month
- Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…☆44Updated last month
- A simple light terminal style chat app that lets you use connect to your local llama.cpp server☆27Updated 2 months ago
- All the world is a play, we are but actors in it.☆46Updated 2 months ago
- A frontend for creative writing with LLMs☆102Updated 2 months ago
- Eternal is an experimental platform for machine learning models and workflows.☆36Updated last month
- multi1: create o1-like reasoning chains with multiple AI providers (and locally)☆64Updated this week
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆46Updated last month