Description
In this paper, we present an architecture and a formal framework to be used for systematic benchmarking of
monitoring and diagnostic systems and for producing comparable performance assessments of different diagnostic
technologies. The framework defines a number of standardized specifications, which include a fault catalog, a library of modular test scenarios, and a common protocol for gathering and processing diagnostic data. At the center of the framework are 13
benchmarking metric definitions. The calculation of metrics is
illustrated on a probabilistic model-based diagnosis algorithm
utilizing Bayesian reasoning techniques. The diagnosed system is
a real-world electrical power system, namely the Advanced
Diagnostics and Prognostics Testbed (ADAPT) developed and
located at the NASA Ames Research Center. The proposed
benchmarking approach shows how to generate realistic
diagnostic data sets for large-scale, complex engineering systems,
and how the generated experimental data can be used to enable
“apples to apples” assessments of the effectiveness of different
diagnostic and monitoring algorithms.
Resources
| Name | Format | Description | Link |
|---|---|---|---|
| 2008PHM_Kurtoglu_FrameworkForBenchmarkingDiagnosis.pdf | 2008PHM_Kurtoglu_FrameworkForBenchmarkingDiagnosis.pdf | Open resource | |
| View this dataset's processing history | HTML | NASA Ocean Color Web - Processing History | Open resource |
| View this dataset's algorithm theoretical basis document | HTML | NASA Ocean Color Web - Algorithm Description Documentation | Open resource |
| View this dataset's data citation policy | HTML | NASA Ocean Color Web - Data Citation Policy | Open resource |
| Download this dataset through a directory map | HTML | NASA Ocean Color Web - Data Distribution Site | Open resource |
| Use OPeNDAP to access the dataset's data | HTML | OB.DAAC OPeNDAP Site for Sentinel-3A OLCI Standard Mapped Image (SMI) Product | Open resource |