Alternatives and similar repositories for remove-refusals-with-transformers

Users that are interested in remove-refusals-with-transformers are comparing it to the libraries listed below

• FailSpy / abliterator
  Simple Python library/structure to ablate features in LLMs which are supported by TransformerLens
  ☆569Updated last year
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,129Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,605Updated this week
• nlzy / vllm-gfx906
  vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆370Updated last month
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆114Updated 2 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆626Updated 2 weeks ago
• city96 / ComfyUI-GGUF
  GGUF Quantization support for native ComfyUI models
  ☆3,270Updated 3 weeks ago
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆261Updated 11 months ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,647Updated 3 weeks ago
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆169Updated 5 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆240Updated last month
• QuixiAI / dolphin-system-messages
  Dolphin System Messages
  ☆381Updated 11 months ago
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆694Updated last month
• SystemPanic / vllm-windows
  A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
  ☆304Updated 2 months ago
• jplhughes / bon-jailbreaking
  Code release for Best-of-N Jailbreaking
  ☆553Updated last year
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆295Updated 2 months ago
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆798Updated last week
• edwko / OuteTTS
  Interface for OuteTTS models.
  ☆1,421Updated 7 months ago
• mostlygeek / llama-swap
  Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
  ☆2,374Updated this week
• fagenorn / handcrafted-persona-engine
  An AI-powered interactive avatar engine using Live2D, LLM, ASR, TTS, and RVC. Ideal for VTubing, streaming, and virtual assistant applica…
  ☆999Updated 3 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆513Updated last year
• AUGMXNT / deccp
  Evaling and unaligning Chinese LLM censorship
  ☆73Updated 9 months ago
• jim-plus / llm-abliteration
  Make abliterated models with transformers, easy and fast
  ☆116Updated 2 weeks ago
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆333Updated last month
• XiongjieDai / GPU-Benchmarks-on-LLM-Inference
  Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?
  ☆1,877Updated last year
• HiDream-ai / HiDream-I1
  ☆2,498Updated 6 months ago
• e-p-armstrong / augmentoolkit
  Create Custom LLMs
  ☆1,806Updated 3 months ago
• ace-step / ACE-Step
  ACE-Step: A Step Towards Music Generation Foundation Model
  ☆3,873Updated 2 weeks ago
• bodaay / HuggingFaceModelDownloader
  Simple go utility to download HuggingFace Models and Datasets
  ☆874Updated last week
• nunchaku-ai / nunchaku
  [ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models
  ☆3,673Updated this week