← NLA experimentsNatural Language Autoencoders · follow-up series
S3·c
SAE on the reconstruction residuals
Encode r = h − ĥ over the 1000-vector substrate: which features does the text channel systematically drop? Answer: the SAE can't be asked — read the sanity gate.
- substrate
- 1000 gold + exp-011 AR reconstructions
- sae
- gemma-scope-2 L40 16k l0=60
- control
- norm-matched Gaussian noise
Status —Cell E hasn't run yet.