|
Available: https://en.wikipedia.org/wiki/Machine_learning
|
|
X. Y. Xie, J. W. K. Ho, C. Murphy, G. Kaiser, B. W. Xu, and T. Y. Chen, "Testing and validating machine learning classifiers by metamorphic testing," Journal of Systems and Software, vol. 84, pp. 544-558, Apr 2011.
|
|
Available: https://en.wikipedia.org/wiki/Test_oracle#cite_note-2
|
|
S. Nakajima and H. N. Bui, "Dataset Coverage for Testing Machine Learning Computer Programs," in 2016 23rd Asia-Pacific Software Engineering Conference, A. Potanin, G. C. Murphy, S. Reeves, and J. Dietrich, Eds., ed New York: Ieee, 2016, pp. 297-304.
|
|
K. Pei, Y. Cao, J. Yang, and S. Jana, "DeepXplore: Automated Whitebox Testing of Deep Learning Systems," pp. 1-18, 2017.
|
|
Available: https://en.wikipedia.org/wiki/Naive_Bayes_classifier
|
|
Available: https://en.wikipedia.org/wiki/Deep_learning
|
|
W. E. Howden, "Theoretical and Empirical Studies of Program Testing," IEEE Trans.softw.eng, vol. 4, pp. 305-311, 1978.
|
|
E. T. Barr, M. Harman, P. Mcminn, M. Shahbaz, and S. Yoo, "The Oracle Problem in Software Testing: A Survey," IEEE Transactions on Software Engineering, vol. 41, pp. 507-525, 2015.
|
|
D. Peters and D. L. Parnas, "Generating a test oracle from program documentation:work in progress," in International Symposium on Software Testing and Analysis, 1994, pp. 58-65.
|
|
P. Lin, J. Thangarajah, Z. Zhang, and T. Miller, "Model-Based Test Oracle Generation for Automated Unit Testing of Agent Systems," IEEE Transactions on Software Engineering, vol. 39, pp. 1230-1244, 2013.
|
|
J. Mayer and R. Guderlei, "Test Oracles Using Statistical Methods," in Testing of Component-Based Systems and Software Quality, Proceedings of Soqua, 2004, pp. 179-189.
|
|
A. Avizienis, "The N-Version Approach to Fault-Tolerant Software," IEEE Trans.softw.eng, vol. 11, pp. 1491-1501, 1985.
|
|
T. Y. Chen, S. C. Cheung, and S. M. Yiu, "Metamorphic testing: a new approach for generating next test cases," 1998.
|
|
Z. Q. Zhou, "Metamorphic testing: A review of challenges and opportunities," Acm Computing Surveys, 2018.
|
|
Y. Tian, K. Pei, S. Jana, and B. Ray, "DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars," 2017.
|
|
Available: https://en.wikipedia.org/wiki/Corner_case
|
|
Available: https://en.wikipedia.org/wiki/Code_coverage
|
|
G. J. Myers and C. Sandler, The Art of Software Testing: Wiley, 1979.
|
|
S. Godboley, G. S. Prashanth, D. P. Mohapatro, and B. Majhi, "Increase in Modified Condition/Decision Coverage using program code transformer," in Advance Computing Conference, 2013, pp. 1400-1407.
|
|
K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," Computer Science, 2014.
|
|
K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," in Computer Vision and Pattern Recognition, 2016, pp. 770-778.
|
|
C. Murphy, G. E. Kaiser, L. Hu, and L. Wu, "Properties of Machine Learning Applications for Use in Metamorphic Testing," Department of Computer Science Columbia University, pp. 867-872, 2008.
|
|
W. B. Langdon, S. Yoo, and M. Harman, "Inferring automatic test oracles," in Ieee/acm International Workshop on Search-Based Software Testing, 2017, pp. 5-6.
|
|
N. Sahavechaphan and K. Claypool, "XSnippet: mining For sample code," in ACM Sigplan Conference on Object-Oriented Programming Systems, Languages, and Applications, 2006, pp. 413-430.
|
|
P. G. Bishop, D. G. Esp, M. Barnes, P. Humphreys, G. Dahll, and J. Lahti, "PODS — A project on diverse software," IEEE Transactions on Software Engineering, vol. SE-12, pp. 929-940, 2012.
|
|
S. Bajracharya and C. Lopes, "Mining search topics from a code search engine usage log," in IEEE International Working Conference on Mining Software Repositories, 2010, pp. 111-120.
|
|
Y. Cao, Z. Q. Zhou, and T. Y. Chen, "On the Correlation between the Effectiveness of Metamorphic Relations and Dissimilarities of Test Case Executions," in International Conference on Quality Software, 2013, pp. 153-162.
|
|
T. Y. Chen, D. H. Huang, T. H. Tse, and Z. Q. Zhou, "Case Studies on the Selection of Useful Relations in Metamorphic Testing," 2004.
|
|
T. Y. Chen, P. L. Poon, and X. Xie, "METRIC: METamorphic Relation Identification based on the Category-choice framework ☆," Journal of Systems & Software, vol. 116, p. 0000, 2016.
|
|
H. Liu, F. C. Kuo, D. Towey, and T. Y. Chen, "How Effectively Does Metamorphic Testing Alleviate the Oracle Problem?," IEEE Transactions on Software Engineering, vol. 40, pp. 4-22, 2014.
|
|
H. Liu, X. Liu, and T. Y. Chen, "A New Method for Constructing Metamorphic Relations," in International Conference on Quality Software, 2012, pp. 59-68.
|
|
J. Mayer and R. Guderlei, "An Empirical Study on the Selection of Good Metamorphic Relations," in Computer Software and Applications Conference, 2006. COMPSAC '06. International, 2006, pp. 475-484.
|
|
C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, et al., "Intriguing properties of neural networks," Computer Science, 2013.
|
|
X. Xu, X. Chen, C. Liu, A. Rohrbach, T. Darell, and D. Song, "Can you fool AI with adversarial examples on a visual Turing test?," 2017.
|
|
Z. Zhao, D. Dua, and S. Singh, "Generating Natural Adversarial Examples," 2017.
|
|
L. Metz, B. Poole, D. Pfau, and J. Sohldickstein, "Unrolled Generative Adversarial Networks," 2017.
|
|
N. Carlini and D. Wagner, "Towards Evaluating the Robustness of Neural Networks," pp. 39-57, 2016.
|
|
O. Bastani, Y. Ioannou, L. Lampropoulos, D. Vytiniotis, A. Nori, and A. Criminisi, "Measuring Neural Net Robustness with Constraints," 2016.
|
|
K. Chalupka, P. Perona, and F. Eberhardt, "Visual Causal Feature Learning," Computer Science, 2015.
|
|
I. J. Goodfellow, J. Shlens, and C. Szegedy, "Explaining and Harnessing Adversarial Examples," Computer Science, 2014.
|
|
X. Huang, M. Kwiatkowska, S. Wang, and M. Wu, "Safety Verification of Deep Neural Networks," 2016.
|
|
U. Shaham, Y. Yamada, and S. Negahban, "Understanding Adversarial Training: Increasing Local Stability of Neural Nets through Robust Optimization," Computer Science, 2015.
|
|
S. Baluja and I. Fischer, "Adversarial Transformation Networks: Learning to Generate Adversarial Examples," 2017.
|
|
A. Kurakin, I. Goodfellow, and S. Bengio, "Adversarial Machine Learning at Scale," 2016.
|
|
J. Edvardsson, "A Survey on Automatic Test Data Generation," 1999.
|
|
F. Corno, E. Snchez, M. S. Reorda, and G. Squillero, "Automatic Test Program Generation: A Case Study," IEEE Design & Test, vol. 21, pp. 102-109, 2004.
|
|
R. A. Demillo and A. J. Offutt, "Constraint-based automatic test data generation," IEEE Trans.softw.eng, vol. 17, pp. 900-910, 1991.
|
|
C. Nebut, F. Fleurey, Y. L. Traon, and J. M. Jezequel, "Automatic Test Generation: A Use Case Driven Approach," IEEE Transactions on Software Engineering, vol. 32, pp. 140-155, 2006.
|