Yeesh, if the “AI safety folks” are celebrating this, they’re easily impressed.
The big revelation seems to be that neurons that appear to recognize more than one thing (e.g. cars and cats) are actually just recognizing a common feature between those two things (in this case, a certain “V” shape).
And… yeah? Obviously? That’s long been our understanding of how neurons work. It’s nice to have confirmation, but I don’t see how this makes LLMs (or any other large convolutional network) any more “transparent”.
Yeesh, if the “AI safety folks” are celebrating this, they’re easily impressed.
The big revelation seems to be that neurons that appear to recognize more than one thing (e.g. cars and cats) are actually just recognizing a common feature between those two things (in this case, a certain “V” shape).
And… yeah? Obviously? That’s long been our understanding of how neurons work. It’s nice to have confirmation, but I don’t see how this makes LLMs (or any other large convolutional network) any more “transparent”.