From Hebb, Hopfield, and Associatron to Atra Rediscovering Associative Memory for First-Person Autonomy
From Hebb, Hopfield, and Associatron to Atra Rediscovering Associative Memory for First-Person Autonomy Atra did not appear suddenly. For me, Atra has gradually emerged through a long path: Hebb, Hopfield networks, Associatron, non-monotonic associative memory, and finally the need for first-person autonomy. Atra is not simply an AI agent. It is not a system where an LLM gives commands to a robot. It is not a model designed only to improve classification accuracy by using correct labels. What I am trying to study with Atra is a way to extend associative memory toward first-person autonomy. To explain why, I first need to look back at the flow from Hebb to Hopfield and Associatron. Then I need to explain why non-monotonicity, difference, carry, and dream-like slack become necessary. Hebb's idea One starting point is Hebb's idea. In simple terms, it can be described as follows: Things that are active together become connected. A familiar form of this idea can be written as: Del...