Opened 14 years ago

Closed 12 years ago

#217 closed defect (fixed)

Check OCC/ROPP, Invert/ROPP test height output scales

Reported by: Huw Lewis Owned by: Huw Lewis
Priority: normal Milestone: 5.0
Component: ropp_pp Version: 4.0
Keywords: Cc:

Description

Tests IT-PP-02, IT-PP-03, IT-PP-04 and IT-PP-05 present comparisons of height scales produced by GRAS NRT data (IT-PP-02) or OCC (IT-PP-03, IT-PP-04, IT-PP-05). The ropp_test codes suggest that results are plotted as %s. (ropp-occ)/ropp

For IT-PP-03, IT-PP-04, IT-PP-05, the height differences are constant with height. Why is this?

For IT-PP-02, the height differences are up to 4% at the surface. Why is this?

See also #157.

Attachments (5)

it_pp_02_plot.gif (70.8 KB ) - added by Ian Culverwell 14 years ago.
it_pp_02_plot.gif
it_pp_03_plot.gif (74.9 KB ) - added by Ian Culverwell 14 years ago.
it_pp_03_plot.gif
it_pp_04_plot.gif (78.0 KB ) - added by Ian Culverwell 14 years ago.
it_pp_04_plot.gif
it_pp_05_plot.gif (77.7 KB ) - added by Ian Culverwell 14 years ago.
it_pp_05_plot.gif
it_pp_05_plot_new.gif (80.6 KB ) - added by Ian Culverwell 13 years ago.
it_pp_05_plot_new.gif

Download all attachments as: .zip

Change history (9)

by Ian Culverwell, 14 years ago

Attachment: it_pp_02_plot.gif added

it_pp_02_plot.gif

by Ian Culverwell, 14 years ago

Attachment: it_pp_03_plot.gif added

it_pp_03_plot.gif

by Ian Culverwell, 14 years ago

Attachment: it_pp_04_plot.gif added

it_pp_04_plot.gif

by Ian Culverwell, 14 years ago

Attachment: it_pp_05_plot.gif added

it_pp_05_plot.gif

comment:1 by Ian Culverwell, 14 years ago

All these tests have problems.

IT-PP-02 (Invert(?) vs ROPP on GRAS SAF NRT data) has decent bangle profiles, but an almost constant offset between the geopotential heights (of around 20m for profile 1): it_pp_02_plot.gif

IT-PP-03 (OCC vs ROPP on CHAMP data) has decent bangle profiles, but this time the offset in GPH increases linearly with altitude (at around -1m/km for profile 1): it_pp_03_plot.gif

IT-PP-04 (OCC vs ROPP on COSMIC data) has decent bangle profiles, but again the offset in GPH increases linearly with altitude (at around 0.2m/km for profile 1): it_pp_04_plot.gif

IT-PP-05 (OCC vs ROPP on GRAS RS data) has very poor (~5-10% different) bangle profiles, but, for variety, the GPHs agree pretty closely: it_pp_05_plot.gif

Obviously these different problems are likely to have different solutions. For the worst one, IT-PP-05, it's pretty obviously a configuration/metadata issue. For the others, it looks more subtle.

by Ian Culverwell, 13 years ago

Attachment: it_pp_05_plot_new.gif added

it_pp_05_plot_new.gif

comment:2 by Ian Culverwell, 13 years ago

Kjartan Kinch (DMI) has investigated the sensitivity of the IT-PP-05 results to the co-ordinate system used in OCC. By changing from ECI to ECEF 4 out of the 5 profiles changed and gave an almost perfect match to the ROPP bangles: it_pp_05_plot_new.gif

The 1/5 profile where changing the co-ordinate system has no effect, and therefore no improvement ion before, is the bottom on above. I've tried changing the input parameters to ROPP, to no avail. Kjartan wonders whether the source (phase delay) data might be different in the two cases, and I think this is likely the case. We need to compare.

Quite why the co-ordinate system might have this strong an effect in OCC is unclear, and Michael Gorbunov is looking at it. For our purposes, it suffices to show that the two codes can agree in a large number of cases.

comment:3 by Ian Culverwell, 13 years ago

Component: ROPP (all)Preproc

comment:4 by Ian Culverwell, 12 years ago

Resolution: fixed
Status: newclosed

It was agreed at the ROM-SAF Steering Group Meeting on 13th Nov 2012 that we could abandon OCC as the reference for ROPP, and use ROPP6.0 instead. Eventually, this will be superseded by a later release, but the reference doesn't always need to be the latest release. Closing the ticket as a result.

Note: See TracTickets for help on using tickets.