Leikoe / torch_to_ggml
convert a saved pytorch model to gguf and generate as much corresponding ggml c code as possible
☆14Updated last year
Alternatives and similar repositories for torch_to_ggml:
Users that are interested in torch_to_ggml are comparing it to the libraries listed below
- Yet Another (LLM) Web UI, made with Gemini☆11Updated 4 months ago
- ☆19Updated last month
- Simple, Fast, Parallel Huggingface GGML model downloader written in python☆24Updated last year
- ☆24Updated 3 months ago
- AirLLM 70B inference with single 4GB GPU☆12Updated 8 months ago
- Implementation of 'Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis', in MLX☆17Updated 5 months ago
- Easily convert HuggingFace models to GGUF-format for llama.cpp☆21Updated 8 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆56Updated 4 months ago
- Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS (E2 TTS) in MLX☆27Updated 6 months ago
- Cog wrapper for collabora/WhisperSpeech☆24Updated last year
- A QT GUI for large language models☆32Updated last year
- Whisper Speaker Identification (WSI), a cutting-edge model for multilingual speaker identification.☆14Updated last month
- Public reports detailing responses to sets of prompts by Large Language Models.☆30Updated 3 months ago
- Build HTML artefacts with Ollama☆11Updated 4 months ago
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆12Updated last year
- Open TTS models, built for streaming on the edge☆39Updated last month
- Real-time end-to-end singing voice convertion☆21Updated 5 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated last week
- Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in MLX☆20Updated 6 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆43Updated last year
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆77Updated 4 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆19Updated 6 months ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆22Updated 10 months ago
- Prompt Jinja2 templates for LLMs☆29Updated 3 months ago
- ☆27Updated last year
- Experimental sampler to make LLMs more creative☆30Updated last year
- Generate audio datasets for training Text-To-Speech models, through smart audio splitting with silence detection, and transcription using…☆28Updated last year
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆23Updated 3 weeks ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆11Updated last year
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year