Excited about this collaboration!
We share some insights on why linear probes don't generalize under the linear representation hypothesis and expand on why SAEs are still not enough for compositional OOD generalization under superposition/overcompleteness. 👇