Leikoe / torch_to_ggml
convert a saved pytorch model to gguf and generate as much corresponding ggml c code as possible
☆13Updated last year
Alternatives and similar repositories for torch_to_ggml:
Users that are interested in torch_to_ggml are comparing it to the libraries listed below
- Public reports detailing responses to sets of prompts by Large Language Models.☆29Updated 2 months ago
- Implementation of 'Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis', in MLX☆16Updated 4 months ago
- Large-Language-Model to Machine Interface project.☆17Updated last year
- Yet Another (LLM) Web UI, made with Gemini☆11Updated 2 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆28Updated last week
- A QT GUI for large language models☆30Updated last year
- The official Python library for Formulaic☆17Updated 10 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆16Updated 4 months ago
- ☆27Updated 6 months ago
- Trying to deconstruct RWKV in understandable terms☆14Updated last year
- Build HTML artefacts with Ollama☆11Updated 2 months ago
- Easily convert HuggingFace models to GGUF-format for llama.cpp☆21Updated 7 months ago
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆44Updated last year
- Experimental sampler to make LLMs more creative☆30Updated last year
- Experiments with BitNet inference on CPU☆53Updated 11 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated 11 months ago
- jQuery, React and Streamlit applications written by LLMs☆16Updated last year
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆29Updated 9 months ago
- AirLLM 70B inference with single 4GB GPU☆12Updated 6 months ago
- Convert your PDFs into audiobooks effortlessly. Features intelligent text extraction, customizable text-to-speech settings, and efficient…☆48Updated 3 weeks ago
- ☆24Updated last month
- Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS (E2 TTS) in MLX☆26Updated 4 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆56Updated 3 months ago
- Merge LLM that are split in to parts☆26Updated last year
- Simple, Fast, Parallel Huggingface GGML model downloader written in python☆24Updated last year
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆15Updated 10 months ago
- Prompt Jinja2 templates for LLMs☆29Updated 2 months ago
- A forest of autonomous agents.☆19Updated last month
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆22Updated 8 months ago
- Web Interface for Vision Language Models Including InternVLM2☆17Updated 7 months ago