valine / NeuralFlowLinks
Visualize the intermediate output of Mistral 7B
☆367Updated 5 months ago
Alternatives and similar repositories for NeuralFlow
Users that are interested in NeuralFlow are comparing it to the libraries listed below
Sorting:
- The repository for the code of the UltraFastBERT paper☆516Updated last year
- Stop messing around with finicky sampling parameters and just use DRµGS!☆349Updated last year
- This is our own implementation of 'Layer Selective Rank Reduction'☆239Updated last year
- A bagel, with everything.☆321Updated last year
- A library for making RepE control vectors☆613Updated 5 months ago
- a curated list of data for reasoning ai☆136Updated 10 months ago
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆616Updated 3 months ago
- a small code base for training large models☆301Updated last month
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆311Updated 8 months ago
- Finetune llama2-70b and codellama on MacBook Air without quantization☆447Updated last year
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆239Updated 4 months ago
- ☆541Updated 7 months ago
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆206Updated 7 months ago
- Open weights language model from Google DeepMind, based on Griffin.☆641Updated 3 weeks ago
- ☆124Updated 2 months ago
- Full finetuning of large language models without large memory requirements☆94Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆173Updated last year
- Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…☆345Updated 10 months ago
- LLM Analytics☆668Updated 8 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆285Updated 3 weeks ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers☆423Updated last year
- Inference code for Persimmon-8B☆415Updated last year
- Mistral7B playing DOOM☆132Updated 11 months ago
- ☆447Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- A compact LLM pretrained in 9 days by using high quality data☆314Updated 2 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆198Updated 11 months ago
- ☆542Updated 10 months ago