FailSpy / abliteratorLinks
Simple Python library/structure to ablate features in LLMs which are supported by TransformerLens
☆565Updated last year
Alternatives and similar repositories for abliterator
Users that are interested in abliterator are comparing it to the libraries listed below
Sorting:
- ☆337Updated 6 months ago
- A benchmark for emotional intelligence in large language models☆398Updated last year
- This is our own implementation of 'Layer Selective Rank Reduction'☆240Updated last year
- Web UI for ExLlamaV2☆513Updated last year
- A library for making RepE control vectors☆682Updated 4 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆165Updated last year
- A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information☆456Updated 6 months ago
- A fast batching API to serve LLM models☆189Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆180Updated last year
- function calling-based LLM agents☆289Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆615Updated 11 months ago
- A multimodal, function calling powered LLM webui.☆216Updated last year
- A library for easily merging multiple LLM experts, and efficiently train the merged LLM.☆505Updated last year
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆626Updated 2 weeks ago
- Large-scale LLM inference engine☆1,647Updated 2 weeks ago
- Merge Transformers language models by use of gradient parameters.☆213Updated last year
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,121Updated 2 weeks ago
- Fast parallel LLM inference for MLX☆246Updated last year
- Make abliterated models with transformers, easy and fast☆114Updated 2 months ago
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆261Updated last year
- Stop messing around with finicky sampling parameters and just use DRµGS!☆360Updated last year
- ☆209Updated last month
- Implements harmful/harmless refusal removal using pure HF Transformers☆1,485Updated 2 months ago
- ☆1,193Updated last month
- A trivial programmatic Llama 3 jailbreak. Sorry Zuck!☆567Updated last year
- automatically quant GGUF models☆219Updated last month
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆401Updated 2 weeks ago
- Automatically evaluate your LLMs in Google Colab☆685Updated last year
- Visualize the intermediate output of Mistral 7B☆384Updated last year
- Customizable implementation of the self-instruct paper.☆1,049Updated last year