EGjoni / DRUGS
Stop messing around with finicky sampling parameters and just use DRµGS!
☆349Updated 10 months ago
Alternatives and similar repositories for DRUGS:
Users that are interested in DRUGS are comparing it to the libraries listed below
- A library for making RepE control vectors☆579Updated 3 months ago
- Visualize the intermediate output of Mistral 7B☆357Updated 3 months ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆170Updated this week
- This is our own implementation of 'Layer Selective Rank Reduction'☆235Updated 11 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- ☆284Updated 2 weeks ago
- Low-Rank adapter extraction for fine-tuned transformers models☆171Updated 11 months ago
- An implementation of bucketMul LLM inference☆216Updated 9 months ago
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆204Updated 5 months ago
- Mistral7B playing DOOM☆131Updated 9 months ago
- ☆412Updated last year
- The repository for the code of the UltraFastBERT paper☆518Updated last year
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆607Updated last month
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆112Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆710Updated last year
- Run GGML models with Kubernetes.☆173Updated last year
- Full finetuning of large language models without large memory requirements☆94Updated last year
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 6 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript☆576Updated 9 months ago
- a curated list of data for reasoning ai☆134Updated 8 months ago
- GPT-2 small trained on phi-like data☆66Updated last year
- ☆153Updated 9 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- ☆118Updated 8 months ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆153Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆233Updated 2 months ago
- A fast batching API to serve LLM models☆182Updated 11 months ago
- Constrained Decoding for LLMs against JSON Schema☆326Updated last year
- A multimodal, function calling powered LLM webui.☆214Updated 7 months ago