Frontiers in Big Data (Jun 2022)

A Methodology for Evaluating Operator Usage of Machine Learning Recommendations for Power Grid Contingency Analysis

  • John Wenskovitch,
  • Brett Jefferson,
  • Alexander Anderson,
  • Jessica Baweja,
  • Danielle Ciesielski,
  • Corey Fallon

DOI
https://doi.org/10.3389/fdata.2022.897295
Journal volume & issue
Vol. 5

Abstract

Read online

This work presents the application of a methodology to measure domain expert trust and workload, elicit feedback, and understand the technological usability and impact when a machine learning assistant is introduced into contingency analysis for real-time power grid simulation. The goal of this framework is to rapidly collect and analyze a broad variety of human factors data in order to accelerate the development and evaluation loop for deploying machine learning applications. We describe our methodology and analysis, and we discuss insights gained from a pilot participant about the current usability state of an early technology readiness level (TRL) artificial neural network (ANN) recommender.

Keywords