BDH-CQ: IN-CONTEXT LEARNING WITH RECURRENT LATENT REASONING [R]
![BDH-CQ: IN-CONTEXT LEARNING WITH RECURRENT LATENT REASONING [R]](/_next/image?url=https%3A%2F%2Fexternal-preview.redd.it%2Fq3evP6JeDpAC2MdSQHWYxnCYTqbJkElIQsLFqVSdkss.png%3Fwidth%3D640%26crop%3Dsmart%26auto%3Dwebp%26s%3Dde730fbf7ecace6df0036b21470c16a2d4feacfb&w=3840&q=75)
| We introduce BDH-CQ, a reasoning system that brings these capabilities together. Demonstrations of a previously unseen task update recurrent memory; the query is then solved through iterative computation in a high-dimensional latent workspace. Intermediate reasoning states are not decoded into language. BDH-CQ makes memory, adaptation, and inference part of the same computational fabric. Inputs presented at inference time continuously update the model’s recurrent memory; the model then solves a query through iterative computation in a high-dimensional latent space, without verbalizing its intermediate reasoning. Neither task identifiers nor evaluation-task demonstration pairs participate in training, and no parameters are updated at inference time. A 150M-parameter configuration reaches 29.5% pass@2 on ARC-AGI-1 at a computed $0.00070 per task, breaking through the previously reported cost–accuracy Pareto frontier. [link] [comments] |
Want to read more?
Check out the full article on the original site