Discussion about this post

User's avatar
Oleg  Alexandrov's avatar

"You need reasoning machinery that can compose primitives into novel behaviors and inspect its own intermediate steps, rather than producing answers from opaque single-pass inference"

This is what Claude Code does in practice, at some level. Instead of starting with an internal reasoning engine it can reflect on, it starts with whatever is available in a given domain. It expresses its thinking either in a programming language, a shell script, or in some language as in law or medical field, then diligently builds and/or executes that as dictated by the application.

It is eerily similar to how people do things. We do not have a reasoning engine in our heads. We have to painstakingly write things down, ponder on them, run our recipes, carefully observe intermediate outcomes, tweak our recipes, rerun them, till eventually we go somewhere.

Emphasis on internal rigor rather than haphazard adaptable heuristics have been big problems for AI in the past. I am not sure what the future holds.

No posts

Ready for more?