本資料は2021年9月2日に社内共有資料として展開していたものをWEBページ向けにリニューアルした内容になります。
■Today’s topic
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_01.jpg)
■Problems in testing of machine learning
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_02.jpg)
■Some techniques for software tests
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_03.jpg)
■Problems in test for machine learning model
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_04.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_05.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_06.jpg)
■Methods of Adversarial Attacks
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_07.jpg)
■Intermediate Summary
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_08.jpg)
■What is the metamorphic test?
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_09.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_10.jpg)
■Examples of metamorphic test
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_11.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_12.jpg)
■Formulation
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_13.jpg)
■Application of metamorphic test
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_14.jpg)
■Metamorphic test in ML model
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_15.jpg)
■Other examples of metamorphic test
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_16.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_17.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_18.jpg)
■What is neuron coverage?
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_19.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_20.jpg)
■How to create the high NC test data?
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_21.jpg)
■Application of neuron coverage
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_22.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_23.jpg)
■Is neuron coverage meaningful?
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_24.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_25.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_26.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_27.jpg)
■Minimal adversarial distortion
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_28.jpg)
■Lower bound of adversarial minimum distortion
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_29.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_30.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_31.jpg)
■Other techniques to find the lower bound
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_32.jpg)
■Can we check the assertion directly?
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_33.jpg)
■Formal verification
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_34.jpg)
■Application of formal verification
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_35.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_36.jpg)
■Summary of four testing method
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_37.jpg)
■Practical viewpoint
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_38.jpg)
■References
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_39.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_40.jpg)
![](https://arithmer.blog/wp-content/uploads/2022/01/NS20210902_41.jpg)