Research paper accepted by Mechanical Systems and Signal Processing
On top of machine learning (ML) models, uncertainty quantification (UQ) functions as an essential layer of safety assurance that could lead to more principled decision making by enabling sound risk assessment and management. The safety and reliability improvement of ML models empowered by UQ has the potential to significantly facilitate the broad adoption of ML solutions in high-stakes decision settings, such as healthcare, manufacturing, and aviation, to name a few. In this tutorial, we aim to provide a holistic lens on emerging UQ methods for ML models with a particular focus on neural networks and the applications of these UQ methods in tackling engineering design as well as prognostics and health management problems. Toward this goal, we start with a comprehensive classification of uncertainty types, sources, and causes pertaining to UQ of ML models. Next, we provide a tutorial-style description of several state-of-the-art UQ methods: Gaussian process regression, Bayesian neural network, neural network ensemble, and deterministic UQ methods focusing on spectral-normalized neural Gaussian process. Established upon the mathematical formulations, we subsequently examine the soundness of these UQ methods quantitatively and qualitatively (by a toy regression example) to examine their strengths and shortcomings from different dimensions. Then, we review quantitative metrics commonly used to assess the quality of predictive uncertainty in classification and regression problems. Afterward, we discuss the increasingly important role of UQ of ML models in solving challenging problems in engineering design and health prognostics. Two case studies with source codes available on GitHub are used to demonstrate these UQ methods and compare their performance in the life prediction of lithium-ion batteries at the early stage (case study 1) and the remaining useful life prediction of turbofan engines (case study 2).
Dr. Xiaoge Zhang delivered an online talk on “A Tutorial on Uncertainty Quantification of Neural Network and Its Application for Reliable Detection of Steel Wire Rope Defects” at University of Tennessee, Knoxville (UTK)
This talk provides a holistic lens on emerging uncertainty quantification (UQ) methods for ML models with a particular focus on neural networks and gives a tutorial-style description of several state-of-the-art UQ methods: Gaussian process regression, Bayesian neural network, neural network ensemble, and deterministic UQ methods focusing on spectral-normalized neural Gaussian process (SNGP). Established upon the mathematical formulations, we subsequently examine the soundness of these UQ methods quantitatively and qualitatively (by a toy regression example) to examine their strengths and shortcomings from different dimensions. Based on the findings of the comparison, we exploit the advantages of SNGP in UQ and develop an uncertainty-aware deep neural network to detect the defects of steel wire rope. Computational experiments and comparisons with state-of-the-art models suggest that the principled uncertainty quantified by SNGP not only substantially enhances the prediction performance, but also provides an essential layer of protection for neural network against out-of-distribution data.
Prof. Indranil Bose gave a talk on “Toward a Cognitive Understanding of Mobile Augmented Reality”
Augmented Reality (AR) has become increasingly popular in different areas of application and is transforming the way mobile commerce is conducted through mobile apps. It imbibes the sensory experience of local presence during online browsing. We investigate the impact of AR-based presentation on sales rank of products using data from Amazon AR View. This is followed by our investigation of the impact of AR on perceived diagnosticity, perceived risk, perceived cognitive load, and emotion of users. Using a mixed-method approach, we find that the use of AR on a mobile app significantly improves sales rank, enhances perceived diagnosticity, and reduces perceived risk. These effects are greater for technology products. Additionally, we find that AR significantly increases perceived cognitive load for non-technology products. We capture various touch movements, such as pan, pinch, and rotate as well as touch pressure, in consumers’ AR interactions and find that they significantly impact the generated emotion. Our research contributes to the literature on mobile commerce and provides directions on when to use the AR interface for product presentation and how to assess consumers’ reactions to it.
