Alternatives and similar repositories for torch_to_ggml

Users that are interested in torch_to_ggml are comparing it to the libraries listed below

• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated 2 years ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 6 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated 2 years ago
• revdotcom / reverb-self-hosted
  This public GitHub repository contains code for a fully self-hosted, on-premise transcription solution.
  ☆53Updated last year
• JosefAlbers / e2tts-mlx
  Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS (E2 TTS) in MLX
  ☆29Updated last year
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated 2 years ago
• fishiatee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated last year
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆44Updated last year
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆30Updated last year
• lucasnewman / e2-tts-mlx
  Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in MLX
  ☆21Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated 2 years ago
• laelhalawani / gguf_modeldb
  A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…
  ☆12Updated 2 years ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated last year
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆45Updated 2 years ago
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆38Updated 2 years ago
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆97Updated 6 months ago
• FarFetchd / sleepyllama
  an auto-sleeping and -waking framework around llama.cpp
  ☆12Updated 11 months ago
• Algomancer / The-Daily-Train
  Training Models Daily
  ☆17Updated 2 years ago
• QuixiAI / kraken
  ☆68Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆32Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• shinomakoi / AI-Messenger
  A QT GUI for large language models
  ☆39Updated 2 years ago
• wavify-labs / wavify-sdks
  fast state-of-the-art speech models and a runtime that runs anywhere 💥
  ☆57Updated 7 months ago
• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆29Updated 10 months ago
• RobViren / kokovoicelab
  A cli app for experimenting with kokoro voice creating and mixing using the available voices to interpolate new ones
  ☆37Updated 11 months ago
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• zenforic / csm-multi
  Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…
  ☆25Updated 9 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆47Updated 2 months ago
• sammcj / vlm-ui
  Web Interface for Vision Language Models Including InternVLM2
  ☆25Updated last year