機械学習モデルの品質保証

本資料は2021年9月2日に社内共有資料として展開していたものをWEBページ向けにリニューアルした内容になります。

■Today’s topic

■Problems in testing of machine learning

■Some techniques for software tests

■Problems in test for machine learning model

■Methods of Adversarial Attacks

■Intermediate Summary

■What is the metamorphic test?

■Examples of metamorphic test

■Formulation

■Application of metamorphic test

■Metamorphic test in ML model

■Other examples of metamorphic test

■What is neuron coverage?

■How to create the high NC test data?

■Application of neuron coverage

■Is neuron coverage meaningful?

■Minimal adversarial distortion

■Lower bound of adversarial minimum distortion

■Other techniques to find the lower bound

■Can we check the assertion directly?

■Formal verification

■Application of formal verification

■Summary of four testing method

■Practical viewpoint

■References

■ダウンロード

機械学習モデルの品質保証.pdf