Adversarial Large-scale Root Gap Inpainting

Chen, Hao; Giuffrida, Mario Valerio; Doerner, Peter; Tsaftaris, Sotirios A

Abstract

Root imaging of a growing plant in a non-invasive, affordable , and effective way remains challenging. One approach is to image roots by growing them in a rhizobox, a soil-filled transparent container, imaging them with digital cameras, and segmenting root from soil background. However , due to soil occlusion and the fact that digital imaging is a 2D projection of a 3D object, gaps are present on the segmentation masks, which may hinder the extraction of finely grained root system architecture (RSA) traits. Herein, we develop an image inpainting technique to recover gaps from disconnected root segments. We train a patch-based deep fully convolutional network using a supervised loss but also use adversarial mechanisms at patch and whole root level. We use Policy Gradient method, to endow the model with large-scale whole root view during training. We train our model using synthetic root data. In our experiments, we show that using adversarial mechanisms at local and whole-root level we obtain a 72% improvement in performance on recovering gaps of real chickpea data when using only patch-level supervision.

Citation

Chen, H., Giuffrida, M. V., Doerner, P., & Tsaftaris, S. A. (2019, June). Adversarial Large-scale Root Gap Inpainting. Presented at Computer Vision Foundation 2019, Long Beach, CA, US

• Presentation Conference Type: Conference Paper (published)
• Conference Name: Computer Vision Foundation 2019
• Start Date: Jun 16, 2019
• End Date: Jun 20, 2019
• Acceptance Date: Apr 3, 2019
• Online Publication Date: Jun 1, 2019
• Publication Date: Jun 1, 2019
• Deposit Date: Sep 24, 2019
• Publicly Available Date: Sep 24, 2019
• Public URL: http://researchrepository.napier.ac.uk/Output/2160984
• Publisher URL: http://openaccess.thecvf.com/content_CVPRW_2019/html/CVPPP/Chen_Adversarial_Large-Scale_Root_Gap_Inpainting_CVPRW_2019_paper.html