Evaluation of Internal Models in Autonomous Learning

Smith, Simon C.; Herrmann, J. Michael

Abstract

Internal models (IMs) can represent relations between sensors and actuators in natural and artificial agents. In autonomous robots, the adaptation of IMs and the adaptation of the behavior are interdependent processes which have been studied under paradigms for self-organization of behavior such as homeokinesis. We compare the effect of various types of IMs on the generation of behavior in order to evaluate model quality across different behaviors. The considered IMs differ in the degree of flexibility and expressivity related to, respectively, learning speed and structural complexity of the model. We show that the different IMs generate different error characteristics which in turn lead to variations of the self-generated behavior of the robot. Due to the tradeoff between error minimization and complexity of the explored environment, we compare the models in the sense of Pareto optimality. Among the linear and nonlinear models that we analyze, echo-state networks achieve a particularly high performance which we explain as a result of the combination of fast learning and complex internal dynamics. More generally, we provide evidence that Pareto optimization is preferable in autonomous learning as it allows that a special solution can be negotiated in any particular environment.

• Journal Article Type: Article
• Acceptance Date: Jul 31, 2018
• Online Publication Date: Aug 22, 2018
• Publication Date: 2019-12
• Deposit Date: Jul 11, 2023
• Journal: IEEE Transactions on Cognitive and Developmental Systems
• Print ISSN: 2379-8920
• Electronic ISSN: 2379-8939
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 11
• Issue: 4
• Pages: 463-472
• DOI: https://doi.org/10.1109/tcds.2018.2865999
• Keywords: Autonomous robot, homeokinesis, internal model (IM), prediction error, time-loop error