Sparse Autoencoders

I did not get the result I wanted from my first serious mechanistic interpretability attempt. Probably the best thing that could have happened. I started with an attractive idea: take sparse …

The field of mechanistic interpretability has matured rapidly over the past two years, transitioning from an academic curiosity to a critical component of AI safety research. As large language models …