Leikoe / torch_to_ggml
convert a saved pytorch model to gguf and generate as much corresponding ggml c code as possible
☆13Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for torch_to_ggml
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated 7 months ago
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆16Updated 5 months ago
- Simple, Fast, Parallel Huggingface GGML model downloader written in python☆24Updated last year
- A QT GUI for large language models☆24Updated 10 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆35Updated 2 weeks ago
- ☆17Updated 2 weeks ago
- A repository to store helpful information and emerging insights in regard to LLMs☆20Updated last year
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆28Updated 3 months ago
- Creates an index of images, queries a local LLM and adds tags to the image metadata☆63Updated 3 weeks ago
- An API for VoiceCraft.☆26Updated 4 months ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆42Updated 9 months ago
- Mistral7B playing DOOM☆27Updated 7 months ago
- Text generation in Python, as easy as possible☆42Updated this week
- ☆15Updated 8 months ago
- AirLLM 70B inference with single 4GB GPU☆12Updated 3 months ago
- A discord bot to stay up to date with Hugging Face Daily Papers.☆15Updated 7 months ago
- A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.☆22Updated last year
- LLM backed Fantasy Tribe Game☆17Updated this week
- Experimental sampler to make LLMs more creative☆30Updated last year
- ☆16Updated last year
- This public GitHub repository contains code for a fully self-hosted, on-premise transcription solution.☆39Updated 2 weeks ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆27Updated this week
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆19Updated 9 months ago
- ☆25Updated 2 months ago
- The official Python library for Formulaic☆14Updated 6 months ago
- Text-to-Music Generation with Rectified Flow Transformer☆45Updated 2 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆87Updated 4 months ago
- Loader extension for tabbyAPI in SillyTavern☆21Updated 3 months ago
- ☆21Updated 3 months ago