Sumandora / remove-refusals-with-transformersLinks
Implements harmful/harmless refusal removal using pure HF Transformers
☆852Updated 11 months ago
Alternatives and similar repositories for remove-refusals-with-transformers
Users that are interested in remove-refusals-with-transformers are comparing it to the libraries listed below
Sorting:
- Simple Python library/structure to ablate features in LLMs which are supported by TransformerLens☆474Updated 11 months ago
- Evaling and unaligning Chinese LLM censorship☆63Updated last month
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆969Updated this week
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆614Updated last week
- Make abliterated models with transformers, easy and fast☆71Updated last month
- ☆89Updated 2 months ago
- Dolphin System Messages☆311Updated 3 months ago
- An AI-powered interactive avatar engine using Live2D, LLM, ASR, TTS, and RVC. Ideal for VTubing, streaming, and virtual assistant applica…☆764Updated last month
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆385Updated this week
- Large-scale LLM inference engine☆1,440Updated last week
- llama.cpp fork with additional SOTA quants and improved performance☆519Updated this week
- Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.☆1,469Updated 3 months ago
- A Fast TTS Engine☆506Updated 4 months ago
- A proxy server for multiple ollama instances with Key security☆436Updated last month
- automatically quant GGUF models☆181Updated this week
- A benchmark for emotional intelligence in large language models☆302Updated 10 months ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆63Updated last week
- A multimodal, function calling powered LLM webui.☆214Updated 8 months ago
- Model swapping for llama.cpp (or any local OpenAPI compatible server)☆848Updated last week
- The Fastest Way to Fine-Tune LLMs Locally☆300Updated 2 months ago
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆351Updated 7 months ago
- This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…☆227Updated last week
- Go manage your Ollama models☆1,124Updated 2 weeks ago
- run DeepSeek-R1 GGUFs on KTransformers☆234Updated 3 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆153Updated last year
- ☆198Updated 3 weeks ago
- Efficient visual programming for AI language models☆362Updated 3 weeks ago
- Web UI for ExLlamaV2☆495Updated 4 months ago
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆217Updated last month
- Fork of the Triton language and compiler for Windows support and easy installation☆1,010Updated last week