leafspark / AutoGGUF
automatically quant GGUF models
☆119Updated this week
Related projects: ⓘ
- multi1: create o1-like reasoning chains with multiple AI providers (and locally)☆64Updated this week
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆157Updated this week
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆101Updated 2 months ago
- run ollama & gguf easily with a single command☆46Updated 4 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆84Updated 2 months ago
- ☆101Updated 5 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆77Updated last month
- Easily view and modify JSON datasets for large language models☆55Updated this week
- ☆95Updated this week
- All the world is a play, we are but actors in it.☆46Updated 2 months ago
- ☆144Updated 2 months ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated last month
- Scripts to create your own moe models using mlx☆86Updated 6 months ago
- an AI interaction tool with RAG hybrid search, conversation context, web content processing and structured data analysis with LLM / GPT☆79Updated this week
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆109Updated 3 months ago
- ☆64Updated 3 months ago
- A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to…☆133Updated this week
- A python package for developing AI applications with local LLMs.☆137Updated 2 months ago
- ☆86Updated 2 weeks ago
- Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…☆44Updated last month
- A simple experiment on letting two local LLM have a conversation about anything!☆81Updated 2 months ago
- Low-Rank adapter extraction for fine-tuned transformers model☆154Updated 4 months ago
- Efficient visual programming for AI language models☆288Updated last week
- Experimental LLM Inference UX to aid in creative writing☆81Updated 2 months ago
- Something similar to Apple Intelligence?☆54Updated 2 months ago
- An unsupervised model merging algorithm for Transformers-based language models.☆96Updated 4 months ago
- A memory framework for Large Language Models and Agents.☆157Updated last month
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆68Updated 3 weeks ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆68Updated last week
- ☆34Updated this week