The Right Answer, the Wrong Direction
Transformers know the answer but can't say it. A geometric readout bottleneck explains why and how to fix it.
Independent Researcher | gpgabriel25
An unaffiliated independent researcher using his limited resources to try to find out of the box solutions to random and sometimes useful questions
Transformers know the answer but can't say it. A geometric readout bottleneck explains why and how to fix it.
A library I made to ensure fair comparisons for a study, which may be useful for other people
The first post, more so an informal explanation of the concepts, why I made this, and the general goals