Towards a visualization of deep neural networks for rough line images

Abstract

Low dose scanning electron microscope (SEM) images are an attractive option to estimate the roughness of nanos- tructures. We recently proposed two deep convolutional neural network (CNN) architectures named “LineNet” to simultaneously perform denoising and edge estimation on rough line SEM images. In this paper we consider multiple visualization tools to improve our understanding of LineNet1; one of these techniques is new to the visualization of denoising CNNs. We use the resulting insights from these visualizations to motivate a study of two variations of LineNet1 with fewer neural network layers. Furthermore, although in classification CNNs edge detection is commonly believed to happen early in the network, the visualization techniques suggest that important aspects of edge detection in LineNet1 occur late in the network.