Alternatives and similar repositories for remove-refusals-with-transformers

Users that are interested in remove-refusals-with-transformers are comparing it to the libraries listed below

• FailSpy / abliterator
  Simple Python library/structure to ablate features in LLMs which are supported by TransformerLens
  ☆495Updated last year
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,020Updated this week
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆83Updated 3 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆964Updated 2 weeks ago
• nlzy / vllm-gfx906
  vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆150Updated last month
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆1,138Updated last week
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆622Updated 6 months ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,502Updated this week
• e-p-armstrong / augmentoolkit
  Create Custom LLMs
  ☆1,700Updated 3 weeks ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆466Updated this week
• fagenorn / handcrafted-persona-engine
  An AI-powered interactive avatar engine using Live2D, LLM, ASR, TTS, and RVC. Ideal for VTubing, streaming, and virtual assistant applica…
  ☆870Updated 3 months ago
• AUGMXNT / deccp
  Evaling and unaligning Chinese LLM censorship
  ☆64Updated 3 months ago
• dCaples / AutoDidact
  Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.
  ☆652Updated 4 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆158Updated last year
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆505Updated 6 months ago
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆250Updated this week
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆249Updated 5 months ago
• bodaay / HuggingFaceModelDownloader
  Simple go utility to download HuggingFace Models and Datasets
  ☆711Updated 9 months ago
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆108Updated 2 months ago
• edwko / OuteTTS
  Interface for OuteTTS models.
  ☆1,346Updated last month
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆314Updated 4 months ago
• lechmazur / writing
  This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…
  ☆276Updated this week
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆260Updated 5 months ago
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆670Updated this week
• QuixiAI / dolphin-system-messages
  Dolphin System Messages
  ☆340Updated 5 months ago
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,537Updated 4 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆189Updated 2 weeks ago
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆476Updated last week
• jd-3d / SOLOBench
  ☆133Updated 3 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆190Updated last week