Interpreting Residual Stream Directions by Scaling Activation Inversion
This paper introduces Maximally-Activating Example Metamodels to map residual stream directions in language models directly to text exemplars.
This paper introduces Maximally-Activating Example Metamodels to map residual stream directions in language models directly to text exemplars.