Martin Biehl
Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action Loop
Biehl, Martin; Guckelsberger, Christian; Salge, Christoph; Smith, Simón C.; Polani, Daniel
Authors
Christian Guckelsberger
Christoph Salge
Simón C. Smith
Daniel Polani
Abstract
Active inference is an ambitious theory that treats perception, inference, and action selection of autonomous agents under the heading of a single principle. It suggests biologically plausible explanations for many cognitive phenomena, including consciousness. In active inference, action selection is driven by an objective function that evaluates possible future actions with respect to current, inferred beliefs about the world. Active inference at its core is independent from extrinsic rewards, resulting in a high level of robustness across e.g., different environments or agent morphologies. In the literature, paradigms that share this independence have been summarized under the notion of intrinsic motivations. In general and in contrast to active inference, these models of motivation come without a commitment to particular inference and action selection mechanisms. In this article, we study if the inference and action selection machinery of active inference can also be used by alternatives to the originally included intrinsic motivation. The perception-action loop explicitly relates inference and action selection to the environment and agent memory, and is consequently used as foundation for our analysis. We reconstruct the active inference approach, locate the original formulation within, and show how alternative intrinsic motivations can be used while keeping many of the original features intact. Furthermore, we illustrate the connection to universal reinforcement learning by means of our formalism. Active inference research may profit from comparisons of the dynamics induced by alternative intrinsic motivations. Research on intrinsic motivations may profit from an additional way to implement intrinsically motivated agents that also share the biological plausibility of active inference.
Citation
Biehl, M., Guckelsberger, C., Salge, C., Smith, S. C., & Polani, D. (2018). Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action Loop. Frontiers in Neurorobotics, 12, https://doi.org/10.3389/fnbot.2018.00045
Journal Article Type | Article |
---|---|
Acceptance Date | Jul 2, 2018 |
Online Publication Date | Aug 30, 2018 |
Publication Date | 2018 |
Deposit Date | Mar 3, 2023 |
Publicly Available Date | Mar 3, 2023 |
Journal | Frontiers in Neurorobotics |
Electronic ISSN | 1662-5218 |
Publisher | Frontiers Media |
Peer Reviewed | Peer Reviewed |
Volume | 12 |
DOI | https://doi.org/10.3389/fnbot.2018.00045 |
Keywords | intrinsic motivation, free energy principle, active inference, predictive information, empowerment, perception-action loop, universal reinforcement learning, variational inference |
Files
Expanding The Active Inference Landscape: More Intrinsic Motivations In The Perception-Action Loop
(1.4 Mb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by/4.0/
You might also like
The DIAMOND Model: Deep Recurrent Neural Networks for Self-Organizing Robot Control
(2020)
Journal Article
Semi-supervised learning from demonstration through program synthesis: An inspection robot case study
(2020)
Presentation / Conference Contribution
Quality-Diversity Optimisation on a Physical Robot Through Dynamics-Aware and Reset-Free Learning
(2023)
Presentation / Conference Contribution
Online Damage Recovery for Physical Robots with Hierarchical Quality-Diversity
(2023)
Journal Article
Benchmarking Quality-Diversity Algorithms on Neuroevolution for Reinforcement Learning
(2022)
Presentation / Conference Contribution
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2025
Advanced Search