本資料は2021年9月2日に社内共有資料として展開していたものをWEBページ向けにリニューアルした内容になります。
■Today’s topic

■Problems in testing of machine learning

■Some techniques for software tests

■Problems in test for machine learning model



■Methods of Adversarial Attacks

■Intermediate Summary

■What is the metamorphic test?


■Examples of metamorphic test


■Formulation

■Application of metamorphic test

■Metamorphic test in ML model

■Other examples of metamorphic test



■What is neuron coverage?


■How to create the high NC test data?

■Application of neuron coverage


■Is neuron coverage meaningful?




■Minimal adversarial distortion

■Lower bound of adversarial minimum distortion



■Other techniques to find the lower bound

■Can we check the assertion directly?

■Formal verification

■Application of formal verification


■Summary of four testing method

■Practical viewpoint

■References


