20 Aug 2020

PUBLICATION NOTICE: Understanding State-of-the-Art Material Classification through Deep Visualization

Abstract: Neural networks (NNs) excel at solving several complex, non-linear problems in the area of supervised learning. A prominent application of these networks is image classification. Numerous improvements over the last few decades have improved the capability of these image classifiers. However, neural networks are still a black-box for solving image classification and other sophisticated tasks. A number of experiments conducted look into exactly how neural networks solve these complex problems. This paper dismantles the neural network solution, incorporating convolution layers, of a specific material classifier. Several techniques are utilized to investigate the solution to this problem. These techniques look at specifically which pixels contribute to the decision made by the NN as well as a look at each neuron’s contribution to the decision. The purpose of this investigation is to understand the decision-making process of the NN and to use this knowledge to suggest improvements to the material classification algorithm.

20 Aug 2020

PUBLICATION NOTICE: Understanding State-of-the-Art Material Classification through Deep Visualization

Abstract: Neural networks (NNs) excel at solving several complex, non-linear problems in the area of supervised learning. A prominent application of these networks is image classification. Numerous improvements over the last few decades have improved the capability of these image classifiers. However, neural networks are still a black-box for solving image classification and other sophisticated tasks. A number of experiments conducted look into exactly how neural networks solve these complex problems. This paper dismantles the neural network solution, incorporating convolution layers, of a specific material classifier. Several techniques are utilized to investigate the solution to this problem. These techniques look at specifically which pixels contribute to the decision made by the NN as well as a look at each neuron’s contribution to the decision. The purpose of this investigation is to understand the decision-making process of the NN and to use this knowledge to suggest improvements to the material classification algorithm.

23 Apr 2020

PUBLICATION NOTICE: Use of Convolutional Neural Networks for Semantic Image Segmentation Across Different Computing Systems

ABSTRACT: The advent of powerful computing platforms coupled with deep learning architectures have resulted in novel approaches to tackle many traditional computer vision problems in order to automate the interpretation of large and complex geospatial data. Such tasks are particularly important as data are widely available and UAS are increasingly being used. This document presents a workflow that leverages the use of CNNs and GPUs to automate pixel-wise segmentation of UAS imagery for faster image processing. GPU-based computing and parallelization is explored on multi-core GPUs to reduce development time, mitigate the need for extensive model training, and facilitate exploitation of mission critical information. VGG-16 model training times are compared among different systems (single, virtual, multi-GPUs) to investigate each platform’s capabilities. CNN results show a precision accuracy of 88% when applied to ground truth data. Coupling the VGG-16 model with GPU-accelerated processing and parallelizing across multiple GPUs decreases model training time while preserving accuracy. This signifies that GPU memory and cores available within a system are critical components in terms of preprocessing and processing speed. This workflow can be leveraged for future segmentation efforts, serve as a baseline to benchmark future CNN, and efficiently support critical image processing tasks for the Military.