unixwzrd / oobabooga-macOS
Information on optimizing python libraries specifically for oobabooga to take advantage of Apple Silicon and Accelerate Framework.
☆69Updated 2 months ago
Alternatives and similar repositories for oobabooga-macOS:
Users that are interested in oobabooga-macOS are comparing it to the libraries listed below
- AutoNL - Natural Language Automation tool☆85Updated 10 months ago
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆72Updated last year
- A macOS version of the oobabooga gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA…☆24Updated 2 months ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆43Updated last year
- For inferring and serving local LLMs using the MLX framework☆91Updated 10 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆90Updated 7 months ago
- An Extension for oobabooga/text-generation-webui☆36Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆101Updated 6 months ago
- Client-side toolkit for using large language models, including where self-hosted☆104Updated 2 months ago
- Easily create LLM automation/agent workflows☆58Updated 11 months ago
- An API for VoiceCraft.☆26Updated 7 months ago
- Experimental LLM Inference UX to aid in creative writing☆111Updated last month
- A simple updated colab doc that will allow you to run the Ooba Booga Text-Generation-Webui for free with just a few lines of codes.☆23Updated 4 months ago
- This code implements a Local LLM Selector from the list of Local Installed Ollama LLMs for your specific user Query☆101Updated last year
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- SmartGPT is a Node.js webpage implementation of a dynamic prompting system, inspired by [AI Explained](https://www.youtube.com/@ai-explai…☆64Updated 9 months ago
- Very basic framework for parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT. Architecture …☆36Updated this week
- This project aims to combine the latest LLMs, Multi-Step Asynchronous Function Calling, Natural Language Processing, and Text-to-Speech.☆37Updated 9 months ago
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆29Updated 8 months ago
- Traing PRO extension for oobabooga WebUI - recent dev version☆48Updated last week
- Locally running LLM with internet access☆93Updated 3 months ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆36Updated last year
- ☆55Updated last year
- Run language models on consumer hardware.☆25Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 5 months ago
- A QT GUI for large language models☆28Updated last year
- ☆41Updated last year
- Falcon40B and 7B (Instruct) with streaming, top-k, and beam search☆40Updated last year
- run ollama & gguf easily with a single command☆49Updated 8 months ago