dvruette / concept-guidanceLinks
Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vectors that control the behavior of LLMs at inference time.
☆21Updated last year
Alternatives and similar repositories for concept-guidance
Users that are interested in concept-guidance are comparing it to the libraries listed below
Sorting:
- Latent Diffusion Language Models☆69Updated last year
- Multi-Domain Expert Learning☆67Updated last year
- ☆55Updated last year
- ☆38Updated last year
- Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22☆66Updated 2 years ago
- ☆25Updated 7 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆131Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆38Updated 2 months ago
- ☆49Updated last year
- Simple GRPO scripts and configurations.☆59Updated 6 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated last year
- Official repo for Learning to Reason for Long-Form Story Generation☆68Updated 4 months ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- Simple repository for training small reasoning models☆37Updated 6 months ago
- Sparse and discrete interpretability tool for neural networks☆63Updated last year
- Code repository for the c-BTM paper☆107Updated last year
- Experiments for efforts to train a new and improved t5☆76Updated last year
- ☆39Updated last year
- ☆121Updated 6 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 4 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆109Updated 4 months ago
- ☆82Updated last year
- LLM training in simple, raw C/CUDA☆15Updated 8 months ago
- Measuring the situational awareness of language models☆38Updated last year
- ☆31Updated 4 months ago
- ☆53Updated last year
- Token Omission Via Attention☆128Updated 10 months ago
- A repository for research on medium sized language models.☆78Updated last year
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆44Updated last year