id	summary	reporter	owner	description	type	status	priority	milestone	component	version	resolution	keywords	cc
651	Reconcile results of IDL and rose versions of Test Folder on IT-PP-06	Ian Culverwell	Ian Culverwell	"There is a small difference between the results of the old IDL test folder and the new rose-based one when they run test IT-PP-06, which tests the new WOPT code on fours standard profiles.  The difference is small, but it is big enough that the rose-based system exceeds the thresholds for 'CASE_12' (a 'Challenging, Cat 3 case: 0.1 < max (−dN/dr) ≤ 0.157).
E.g. gfortran at ROPP9.1:

'''IDL'''
{{{
   Found absolute mean difference, mean absolute difference and max difference between input and output refrac for CASE_12_ref1d:   5 -  19km:   0.925 /   1.152 /   3.208 %
}}}
[[Image(IT-PP-06_gfortran_linux_IDL.png)]]

'''ROSE'''
{{{
   Found absolute mean difference, mean absolute difference and max difference between input and output refrac for CASE_12_ref1d:   5 -  19km:   0.021 /   1.553 /   6.459 %

IDL it_pp_06 Error: (8) Mean absolute deviations between input and output refrac exceed 1.5% above 5km.

IDL it_pp_06 Error: (9) Max absolute deviations between input and output refrac exceed 4.0% above 5km.
}}}

[[Image(IT-PP-06_gfortran_linux_ROSE.png)]]

The picture is confused because the rose test folder doesn't (yet) process the results of the runs or generate its own graphics, so the 'ROSE' data above have been generated by passing the results of the rose test folder through the later, processing steps of the IDL code.

Note, however, that if the rose-generated executables used in this test (namely, '''ropp_pp_wopt_tool''', '''ropp2ropp''' and '''ropp_pp_invert_tool''') are used in the full IDL code, then the results match the IDL results.  So there must be some subtlety of the rose code that means its results are not the same as you get when you (think you) run the same code via IDL.  I suspect some sort of ancillary file difference.  We could compare the results step-by-step.

By the way, both are better than the ROPP9.0 results, especially at lower levels, for example:
{{{
Found absolute mean difference, mean absolute difference and max difference between input and output refrac for CASE_12_ref1d: 5 - 19km: 0.925 / 1.152 / 3.208 %
}}}
[[Image(IT-PP-06_gfortran_linux_ROPP90.png)]]

"	task	closed	normal	9.1	Test folder	9.0	fixed	IT-PP-06