jim-plus / llm-abliterationLinks
Make abliterated models with transformers, easy and fast
☆86Updated this week
Alternatives and similar repositories for llm-abliteration
Users that are interested in llm-abliteration are comparing it to the libraries listed below
Sorting:
- ☆108Updated 3 months ago
- Test your local LLMs on the AIME problems☆31Updated 6 months ago
- ☆134Updated 7 months ago
- Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…☆68Updated this week
- automatically quant GGUF models☆218Updated last month
- Deploy Apollo HF space locally☆40Updated last year
- Writing Extension for Text Generation WebUI☆64Updated 4 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆47Updated last month
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆79Updated last week
- Make abliterated models with transformers, easy and fast☆107Updated last week
- ☆296Updated last month
- AI management tool☆121Updated last year
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆597Updated this week
- ☆334Updated 4 months ago
- Orpheus Chat WebUI☆75Updated 8 months ago
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆29Updated 7 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆86Updated last year
- REAP: Router-weighted Expert Activation Pruning for SMoE compression☆145Updated last week
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆81Updated last week
- ☆51Updated 10 months ago
- A pipeline parallel training script for LLMs.☆164Updated 7 months ago
- Sparse Inferencing for transformer based LLMs☆215Updated 4 months ago
- Game Companion AI is an advanced application designed to enhance the gaming experience by providing real-time analysis and interpretation…☆53Updated last year
- Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools☆112Updated 5 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆165Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆53Updated last year
- ☆210Updated 3 months ago
- ☆83Updated 9 months ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆154Updated last week
- Easily view and modify JSON datasets for large language models☆84Updated 7 months ago