Exetools

Exetools (https://forum.exetools.com/index.php)
-   General Discussion (https://forum.exetools.com/forumdisplay.php?f=2)
-   -   [Blog post] The spider on the tip of your tongue (https://forum.exetools.com/showthread.php?t=21695)

Gyrus 07-21-2026 16:33

[Blog post] The spider on the tip of your tongue
 
Quote:

Ask Claude how many legs the animal that spins webs has, and it answers eight. The word “spider” appears nowhere in the question and nowhere in the reply. But midway through the model's processing, researchers at Anthropic found it anyway, held internally as a word the model was preparing to use. Swap that one internal word for “ant” and the model, everything else untouched, answers six legs.

This is stranger than it first sounds. Nobody typed “spider” anywhere in this exchange. Nobody trained the model to hold a private noun in reserve before answering a question about legs. The word turns up anyway, mid-process, doing exactly the job a word does in your own head when you are one step from saying it out loud.

That experiment comes from a paper Anthropic published on July 6th 2026, and the reason it counts as a landmark reflects one aspect of modern AI that most people have never absorbed. Nobody knows how these systems work. Not the critics, and not, in any detailed mechanical sense, the companies that build them. The new research shrinks that ignorance in a specific way. It found, inside Claude, a small working memory made of unspoken words, which Anthropic calls the J-space. Outsiders can read it mid-task, and overwriting an entry changes what the model does next.
..
https://iain.so/the-spider-on-the-tip-of-your-tongue

chants 07-21-2026 18:43

I mean, this is precisely how a model trained to predict the next toen with attention layers and thinking modes would be expected to work when the training data is full of such strong patterns. I would be more surprised knowing the transformer architecture that it did not work this way.


All times are GMT +8. The time now is 14:16.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2026, vBulletin Solutions, Inc.
Always Your Best Friend: Aaron, JMI, ahmadmansoor, ZeNiX