.. .. Dspot,

. .. , 120 7.1.3 Automatic Test Amplification For Behavioral Changes Detection, p.120

. .. Short-term-perspectives,

.. .. Long-term-perspectives,

. .. Correctness, Contents 6.1 Study of Program

. .. Methods,

.. .. Repair,

.. .. Conclusion,

, I expose 3 transversal contributions that I made during my thesis. Thanks to the expertise that I developed during my thesis, I worked with my researchers colleagues on side topics

, ? The first transversal contribution studies the correctness of program under runtime perturbations in Section 6.1. This work has been done during my master degree

, ? The second transversal contribution studies the pseudo-tested methods Section 6

, ? The third transversal contribution studies patches' overfitting in test-based repair techniques in Section 6

, 119 7.1.2 Automatic Test Amplification For Mutation Score, Contents

. .. Short-term-perspectives,

. .. Long-term-perspectives, 126 unit test amplification algorithm, implemented in a mature tool called DSpot. DSpot aims at improving existing test methods with respect to a given test-criterion such as branch coverage

, It amplifies the input of the original test method by applying specific code transformation on the input part of the test method

, It removes existing assertions and generates new ones, based on observations done during execution on the state of the programs

, DSpot will keep only amplified test methods that cover branches that were not covered before. DSpot has been developed in Java, for Java programs. However, the whole technique remains applicable for all programming languages, CONCUR 2004 -Concurrency Theory, pp.35-48, 2004.

M. ]-uri-alon, O. Zilberstein, E. Levy, and . Yahav, Learning Distributed Representations of Code. CoRR, vol.2, 2018.

T. Apiwattanapong, R. Santelices, P. Kumar-chittimalli, A. Orso, and M. J. Harrold, Matrix: Maintenance-oriented testing requirements identifier and examiner, Testing: Academic and Industrial Conference-Practice And Research Techniques, 2006. TAIC PART 2006. Proceedings, pp.137-146, 2006.

B. Baudry, F. Fleurey, J. Jézéquel, and Y. L. Traon, Automatic Test Cases Optimization Using a Bacteriological Adaptation Model: Application to .NET Components, Proceedings of the 17th IEEE International Conference on Automated Software Engineering, ASE '02, p.29, 2002.

B. Baudry, F. Fleurey, J. Jézéquel, and Y. L. Traon, Automatic Test Cases Optimization: a Bacteriologic Algorithm, IEEE Software, vol.22, issue.2, pp.76-82, 2005.

B. Baudry, F. Fleurey, J. Jézéquel, L. Traon, and Y. , From Genetic to Bacteriological Algorithms for Mutation-Based Testing. Software, Testing, Verification & Reliability journal (STVR), vol.15, pp.73-96, 2005.

B. Baudry, F. Fleurey, and Y. L. Traon, Improving Test Suites for Efficient Fault Localization, Proceedings of the 28th International Conference on Software Engineering, ICSE '06, vol.16, pp.82-91, 2006.
URL : https://hal.archives-ouvertes.fr/inria-00542783

R. Bavishi, M. Pradel, and K. Sen, Context2Name: A Deep Learning-Based Approach to Infer Natural Variable Names from Usage Contexts, 2018.

. Corr, , vol.123, 2018.

K. Beck, Test-driven development: by example. Addison-Wesley Professional, 2003.

M. Beller, G. Gousios, A. Panichella, and A. Zaidman, When, how, and why developers (do not) test in their IDEs, Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering (ESEC/FSE), pp.179-190, 2015.

M. Beller, G. Gousios, and A. Zaidman, How (Much) Do Developers Test?, Proceedings of the 37th IEEE/ACM International Conference on Software Engineering (ICSE), pp.559-562, 2015.

M. Beller, G. Gousios, and A. Zaidman, TravisTorrent: Synthesizing Travis CI and GitHub for Full-Stack Research on Continuous Integration, Proceedings of the 14th working conference on mining software repositories, vol.50, 2017.

M. Beller, G. Gousios, A. Panichella, S. Proksch, S. Amann et al., Developer Testing in The IDE: Patterns, Beliefs, And Behavior, IEEE Transactions on Software Engineering, vol.45, issue.3, pp.261-284, 2019.

M. Stephen, R. Blackburn, C. Garner, A. M. Hoffmann, K. S. Khang et al., The DaCapo Benchmarks: Java Benchmarking Development and Analysis, Proceedings of the 21st Annual ACM SIGPLAN Conference on Object-oriented Programming Systems, Languages, and Applications, OOPSLA '06, p.24, 2006.

R. Bloem, R. Koenighofer, F. Röck, and M. Tautschnig, Automating test-suite augmentation, 14th International Conference on, vol.16, p.12, 2014.

M. Böhme, C. Bruno, S. Oliveira, and A. Roychoudhury, Regression tests to expose change interaction errors, Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering, pp.334-344, 2013.

M. Böhme and A. Roychoudhury, Corebench: Studying complexity of regression errors, Proceedings of the 2014 International Symposium on Software Testing and Analysis, vol.32, pp.105-115, 2014.

P. Brereton, B. A. Kitchenham, D. Budgen, M. Turner, and M. Khalil, Lessons from applying the systematic literature review process within the software engineering domain, Journal of Systems and Software, vol.80, issue.4, pp.571-583, 2007.

A. Carzaniga, A. Goffi, A. Gorla, A. Mattavelli, and M. Pezzè, Cross-checking Oracles from Intrinsic Software Redundancy, Proceedings of the 36th International Conference on Software Engineering, ICSE 2014, pp.931-942, 2014.

H. Coles, T. Laurent, C. Henard, M. Papadakis, and A. Ventresque, PIT: A Practical Mutation Testing Tool for Java (Demo), Proceedings of the 25th International Symposium on Software Testing and Analysis, ISSTA 2016, vol.108, pp.449-452, 2016.

M. Harris and . Cooper, Synthesizing research: A guide for literature reviews, Sage, vol.2, 1998.

L. Benoit-cornu, M. Seinturier, and . Monperrus, Exception handling analysis and transformation using fault injection: Study of resilience against unanticipated exceptions, Information and Software Technology, vol.57, pp.66-76, 2015.

V. Dallmeier, N. Knopp, C. Mallon, S. Hack, and A. Zeller, Generating Test Cases for Specification Mining, Proceedings of the 19th International Symposium on Software Testing and Analysis, ISSTA '10, pp.85-96, 2010.

B. Danglot, P. Preux, B. Baudry, and M. Monperrus, Correctness attraction: a study of stability of software behavior under runtime perturbation, Empirical Software Engineering, vol.23, issue.4, pp.2086-2119, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01378523

B. Danglot, M. Monperrus, W. Rudametkin, and B. Baudry, Andy Zaidman, Martin Monperrus and Benoit Baudry. A Snowballing Literature Study on Test Amplification, Journal of Systems and Software, p.110398, 2019.

B. Danglot, O. L. Vera-pérez, B. Baudry, and M. Monperrus, Automatic test improvement with DSpot: a study with ten mature opensource projects, Empirical Software Engineering, vol.77, 2019.
URL : https://hal.archives-ouvertes.fr/hal-01923575

B. Daniel, V. Jagannath, D. Dig, and D. Marinov, ReAssert: Suggesting Repairs for Broken Unit Tests, IEEE/ACM International Conference on Automated Software Engineering, vol.98, pp.433-444, 2009.

B. Daniel, V. Jagannath, D. Dig, and D. Marinov, ReAssert: Suggesting Repairs for Broken Unit Tests, IEEE/ACM International Conference on Automated Software Engineering, vol.28, p.27, 2009.

, On the cruelty of really teaching computing science, Communications of The ACM -CACM, vol.32, 1989.

V. Silva, D. Kroening, and G. Weissenbacher, A Survey of Automated Techniques for Formal Software Verification, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol.27, issue.7, pp.1165-1178, 2008.

M. Paul, S. Duvall, A. Matyas, and . Glover, Continuous integration: improving software quality and reducing risk. Pearson Education, p.71, 2007.

, A Survey on Automatic Test Data Generation, vol.35, 2002.

J. Falleri, F. Morandat, X. Blanc, M. Martinez, and M. Monperrus, Fine-grained and Accurate Source Code Differencing, Proceedings of the International Conference on Automated Software Engineering, p.76, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01054552

L. Lu-fang, G. Dou, and . Xu, PERFBLOWER: Quickly Detecting Memory-Related Performance Problems via Amplification, LIPIcs-Leibniz International Proceedings in Informatics, vol.37, 2015.

M. Fowler and M. Foemmel, Continuous integration, vol.122, p.71, 2006.

G. Fraser and A. Arcuri, EvoSuite: automatic test suite generation for object-oriented software, Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, ESEC/FSE '11, pp.416-419, 2011.

G. Fraser and A. Arcuri, Evosuite: automatic test suite generation for object-oriented software, Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, vol.32, pp.416-419, 2011.

G. Fraser and A. Zeller, Generating parameterized unit tests, Proceedings of the 2011 International Symposium on Software Testing and Analysis, vol.16, pp.364-374, 2011.

G. Fraser, M. Staats, and P. Mcminn, Andrea Arcuri and Frank Padberg. Does Automated Unit Test Generation Really Help Software Testers? A Controlled Empirical Study, ACM Transactions on Software Engineering and Methodology (TOSEM), vol.24, issue.4, p.23, 2015.

C. Le-goues, T. Nguyen, S. Forrest, and W. Weimer, GenProg: A Generic Method for Automatic Software Repair, IEEE Trans. Software Eng, vol.38, issue.1, p.112, 2012.

D. Hamlet and J. Voas, Faults on its sleeve: amplifying software reliability testing, ACM SIGSOFT Software Engineeri ng Notes, vol.18, issue.3, pp.89-98, 1993.

M. Harder, J. Mellen, and M. D. Ernst, Improving Test Suites via Operational Abstraction, Proc. of the Int. Conf. on Software Engineering (ICSE), vol.16, p.13, 2003.

C. William and . Hetzel, The complete guide to software testing. QED Information Sciences, p.132, 1988.

M. Hilton, T. Tunnell, and K. Huang, Darko Marinov and Danny Dig. Usage, Costs, and Benefits of Continuous Integration in Open-source Projects, Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering, ASE 2016, p.71, 2016.

M. Hilton, J. Bell, and D. Marinov, A large-scale study of test coverage evolution, Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE), pp.53-63, 2018.

M. Hilton, J. Bell, and D. Marinov, A Large-scale Study of Test Coverage Evolution, Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering, ASE 2018, p.77, 2018.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand, Experiments of the Effectiveness of Dataflow-and Controlflow-based Test Adequacy Criteria, Proceedings of the 16th International Conference on Software Engineering, ICSE '94, p.18, 1994.

S. Jalali and C. Wohlin, Systematic literature studies: database searches vs. backward snowballing, Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement, pp.29-38

P. Joshi, K. Sen, and M. Shlimovich, Predictive Testing: Amplifying the Effectiveness of Software Testing, Proc. of the ESEC/FSE: Companion Papers, ESEC-FSE companion '07, pp.561-564, 2007.

R. Just, D. Jalali, and M. D. Ernst, Defects4J: A database of existing faults to enable controlled testing studies for Java programs, Proceedings of the International Symposium on Software Testing and Analysis (ISSTA), p.115, 2014.

B. Kitchenham, Procedures for performing systematic reviews, vol.9, 2004.

A. Leung, M. Gupta, Y. Agarwal, R. Gupta, R. Jhala et al., Verifying GPU kernels by test amplification, ACM SIGPLAN Notices, vol.47, issue.6, pp.383-394, 2012.

X. Li and D. Yeung, Application-Level Correctness and its Impact on Fault Tolerance, IEEE 13th International Symposium on High Performance Computer Architecture, p.102, 2007.

F. Long, P. Amidon, and M. Rinard, Automatic inference of code transforms for patch generation, Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, vol.112, pp.727-739, 2017.

L. Madeyski, Test-driven development: An empirical evaluation of agile practice, 2010.

D. Paul, C. Marinescu, and . Cadar, KATCH: high-coverage testing of software patches. page 235, 2013.

S. Madhuri-r-marri, T. Thummalapenta, N. Xie, J. Tillmann, and . De-halleux, Retrofitting unit tests for parameterized unit testing, vol.16, p.11, 2010.

P. Mcminn, Search-based software test data generation: a survey. Software Testing, Verification and Reliability, vol.14, pp.105-156, 2004.

S. Mechtaev, J. Yi, and A. Roychoudhury, Angelix: Scalable Multiline Program Patch Synthesis via Symbolic Analysis, Proceedings of the 38th International Conference on Software Engineering, ICSE '16, p.112, 2016.

M. Amin-milani-fard, A. Mirzaaghaei, and . Mesbah, Leveraging existing tests in automated test generation for web applications, Proceedings of the 29th ACM/IEEE international conference on Automated software engineering, pp.67-78, 2014.

M. Mirzaaghaei, F. Pastore, and M. Pezze, Supporting test suite evolution through test case adaptation, Software Testing, Verification and Validation (ICST), vol.29, pp.231-240, 2012.

M. Mirzaaghaei, F. Pastore, and M. Pezzè, Automatic test case evolution, Software Testing, Verification and Reliability, vol.24, issue.5, pp.386-411, 2014.

T. Mouelhi, Y. L. Traon, and B. Baudry, Transforming and selecting functional test cases for security policy testing, Software Testing Verification and Validation, 2009. ICST'09. International Conference on, pp.171-180, 2009.
URL : https://hal.archives-ouvertes.fr/inria-00538390

H. Duong-thien-nguyen, D. Qi, A. Roychoudhury, and S. Chandra, SemFix: Program Repair via Semantic Analysis, Proceedings of the 2013 International Conference on Software Engineering, ICSE '13, p.112, 2013.

R. Niedermayr, E. Juergens, and S. Wagner, Will my tests tell me if I break this code?, Proceedings of the International Workshop on Continuous Software Evolution and Delivery, pp.23-29, 2016.

J. Thomas, M. J. Ostrand, and . Balcer, The category-partition method for specifying and generating fuctional tests, Communications of the ACM, vol.31, issue.6, pp.676-686, 1988.

C. Pacheco and M. D. Ernst, Eclat: Automatic generation and classification of test inputs, ECOOP 2005 -Object-Oriented Programming, 19th European Conference, pp.504-527, 2005.

C. Pacheco, D. Michael, and . Ernst, Eclat: Automatic generation and classification of test inputs, Proceedings of the 19th European conference on Object-Oriented Programming, pp.504-527, 2005.

H. Palikareva, T. Kuchta, and C. Cadar, Shadow of a doubt: testing for divergences between software versions, Proceedings of the 38th International Conference on Software Engineering, pp.1181-1192, 2016.

F. Palomb and A. Zaidman, The Smell of Fear: On the Relation between Test Smells and Flaky Tests, p.22

F. Palomba and A. Zaidman, Does Refactoring of Test Smells Induce Fixing Flaky Tests, 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME), p.22, 2017.

M. Patrick and Y. Jia, KD-ART: Should we intensify or diversify tests to kill mutants?, Information and Software Technology, vol.81, p.12, 2017.

R. Pawlak, M. Monperrus, N. Petitprez, C. Noguera, and L. Seinturier, Spoon: A Library for Implementing Analyses and Transformations of, Java Source Code. Software: Practice and Experience, vol.46, pp.1155-1179, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01078532

Y. Pei, C. A. Furia, M. Nordio, Y. Wei, B. Meyer et al., Automated Fixing of Programs with Contracts, IEEE Transactions on Software Engineering, vol.40, issue.5, p.112, 2014.

R. ]-kai-petersen, S. Feldt, M. Mujtaba, and . Mattsson, Systematic Mapping Studies in Software Engineering, EASE, vol.8, pp.68-77, 2008.

M. Pezze, K. Rubinov, and J. Wuttke, Generating effective integration test cases from unit ones, Software Testing, Verification and Validation (ICST), vol.29, p.13, 2013.

D. Qi, A. Roychoudhury, and Z. Liang, Test generation to expose changes in evolving programs, Proceedings of the IEEE/ACM international conference on Automated software engineering, pp.397-406, 2010.

M. Rinard, C. Cadar, and . Huu-hai-nguyen, Exploring the Acceptability Envelope, Companion to the 20th Annual ACM SIGPLAN Conference on Object-oriented Programming, Systems, Languages, and Applications, OOP-SLA '05, p.102, 2005.

J. Rö?ler, G. Fraser, A. Zeller, and A. Orso, Isolating failure causes through test case generation, Proceedings of the 2012 International Symposium on Software Testing and Analysis, vol.16, pp.309-319, 2012.

J. Roche, Adopting DevOps Practices in Quality Assurance, Commun. ACM, vol.56, 2013.

M. José, G. Rojas, A. Fraser, and . Arcuri, Seeding strategies in search-based unit test generation. Software Testing, Verification and Reliability, vol.26, pp.366-401, 2016.

C. Rosen, B. Grawi, and E. Shihab, Commit Guru: Analytics and Risk Prediction of Software Commits, Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2015, p.124, 2015.

D. Saff, D. Michael, and . Ernst, An experimental evaluation of continuous testing during development, ACM SIGSOFT Software Engineering Notes, vol.29, p.74, 2004.

R. Santelices, P. Kumar-chittimalli, T. Apiwattanapong, A. Orso, and M. J. Harrold, Test-suite augmentation for evolving software, 23rd IEEE/ACM International Conference on, pp.218-227, 2008.

R. Santelices and M. J. Harrold, Applying aggressive propagation-based strategies for testing changes, IEEE Fourth International Conference on Software Testing, Verification and Validation, pp.11-20, 2011.

, Software-artifact Infrastructure Repository, vol.32, pp.2017-2022

K. Edward, . Smith, T. Earl, C. L. Barr, Y. Goues et al., Is the cure worse than the disease? overfitting in automated program repair, Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, p.112, 2015.

N. Tillmann and W. Schulte, Unit tests reloaded: Parameterized unit testing with symbolic execution, IEEE software, vol.23, issue.4, p.11, 2006.

P. Tonella, Evolutionary Testing of Classes, Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA '04, pp.119-128, 2004.

S. Urli, Z. Yu, L. Seinturier, and M. Monperrus, How to Design a Program Repair Bot? Insights from the Repairnator Project, 40th International Conference on Software Engineering, p.126, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01691496

O. L. Vera-pérez, M. Monperrus, and B. Baudry, Descartes: A PITest Engine to Detect Pseudo-Tested Methods, Proceedings of the 2018 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE '18), p.108, 2018.

O. L. Vera-pérez, B. Danglot, M. Monperrus, and B. Baudry, A comprehensive study of pseudo-tested methods. Empirical Software Engineering, vol.102, 2018.

M. Jeffrey, . Voas, W. Keith, and . Miller, Software testability: The new verification, IEEE software, vol.12, issue.3, pp.17-28, 1995.

H. Wang, X. Guan, Q. Zheng, T. Liu, C. Shen et al., Directed test suite augmentation via exploiting program dependency, Proceedings of the 6th International Workshop on Constraints in Software Testing, Verification, and Analysis, pp.1-6, 2014.

. ]-claes-wohlin, Guidelines for Snowballing in Systematic Literature Studies and a Replication in Software Engineering, Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, vol.9, p.38, 2014.

T. Xie, Augmenting Automatically Generated Unit-test Suites with Regression Oracle Checking, Proceedings of the 20th European Conference on Object-Oriented Programming, pp.380-403, 2006.

Z. Xu and G. Rothermel, Directed test suite augmentation, Software Engineering Conference, 2009. APSEC'09, pp.406-413

, IEEE, vol.22, p.16, 2009.

Z. Xu, B. Myra, G. Cohen, and . Rothermel, Factors affecting the use of genetic algorithms in test suite augmentation, Proceedings of the 12th annual conference on Genetic and evolutionary computation, vol.29, pp.1365-1372, 2010.

Z. Xu, Y. Kim, and M. Kim, Gregg Rothermel and Myra B Cohen. Directed test suite augmentation: techniques and tradeoffs, Proceedings of the eighteenth ACM SIGSOFT international symposium on Foundations of software engineering, vol.29, pp.257-266, 2010.

Z. Xu, Y. Kim, M. Kim, and G. Rothermel, A hybrid directed test suite augmentation technique, Software Reliability Engineering (IS-Bibliography SRE), pp.150-159, 2011.

Z. Xu, Y. Kim, M. Kim, B. Myra, G. Cohen et al., Directed test suite augmentation: an empirical investigation. Software Testing, Verification and Reliability, vol.25, pp.77-114, 2015.

J. Xuan and M. Monperrus, Test case purification for improving fault localization, Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, vol.29, pp.52-63, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01061911

J. Xuan, X. Xie, and M. Monperrus, Crash Reproduction via Test Case Mutation: Let Existing Test Cases Help, Proceedings of the, p.10, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01172102

, Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2015, vol.16, p.15, 2015.

J. Xuan, B. Cornu, M. Martinez, B. Baudry, L. Seinturier et al., Automatic Test Code Refactoring to Improve Dynamic Analysis. Information and Software Technology, vol.76, pp.65-80, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01309004

J. Xuan, M. Martinez, F. Demarco, M. Clément, S. Lamelas et al., Nopol: Automatic Repair of Conditional Statement Bugs in Java Programs, IEEE Transactions on Software Engineering, vol.115, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01285008

J. Xuan, M. Martinez, F. Demarco, M. Clement, S. L. Marcote et al., Nopol: Automatic repair of conditional statement bugs in java programs, IEEE Transactions on Software Engineering, vol.43, issue.1, pp.34-55, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01285008

S. Yoo and M. Harman, Test data regeneration: generating new test data from existing test data. Software Testing, Verification and Reliability, vol.22, p.11, 2012.

H. Yoshida, S. Tokumoto, R. Mukul, I. Prasad, T. Ghosh et al., FSX: Fine-grained Incremental Unit Test Generation for C/C++ Programs, Proceedings of the 25th International Symposium on Software Testing and Analysis, 2016.

, Mutation-oriented Test Data Augmentation for GUI Software Fault Localization, Inf. Softw. Technol, vol.55, issue.12, pp.2076-2098, 2013.

Z. Yu, M. Martinez, and B. Danglot, Thomas Durieux and Martin Monperrus. Alleviating patch overfitting with automatic test generation: a study of feasibility and effectiveness for the Nopol repair system, Empirical Software Engineering, vol.24, p.102, 2019.

A. Zaidman, B. Van-rompaey, S. Demeyer, and A. Van-deursen, Mining Software Repositories to Study Co-Evolution of Production & Test Code, First International Conference on Software Testing, Verification, and Validation (ICST), vol.16, pp.220-229, 2008.

A. Zaidman, B. Van-rompaey, A. Van-deursen, and S. Demeyer, Studying the co-evolution of production and test code in open source and industrial developer test processes through repository mining, Empirical Software Engineering, vol.16, issue.3, pp.325-364, 2011.

P. Zhang and S. Elbaum, Amplifying tests to validate exception handling code, Proc. of Int. Conf. on Software Engineering (ICSE), vol.10, pp.595-605, 2012.

P. Zhang and S. G. Elbaum, Amplifying Tests to Validate Exception Handling Code: An Extended Study in the Mobile Application Domain, 2014.

, ACM Trans. Softw. Eng. Methodol, vol.23, issue.4, pp.1-32, 2014.

J. Zhang, Y. Lou, L. Zhang, D. Hao, L. Zhang et al., Isomorphic Regression Testing: Executing Uncovered Branches Without Test Augmentation, Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2016, vol.29, pp.883-894, 2016.