Opened 14 years ago

Last modified 13 years ago

#228 closed defect

Inconsistent precision in MSIS_coeff.nc file — at Initial version

Reported by: Ian Culverwell Owned by:
Priority: normal Milestone: 5.0
Component: ropp_pp Version: 4.1
Keywords: MSIS Cc:

Description

Kjartan Kinch (DMI) discovered that these coefficients are being held at different precision in OCC (8 decimal places, from ascii file) and ROPP (read in from ascii file as single precision, then promoted to double precision before being written out to netCDF file).

By reading them in as DP in ropp_pp/msis_bangle/MSIS_ascii2netcdf.pro we obtain a netcdf file at equivalent precision.

ba_Ac0(1, 1, 1) from ropp_pp/data/dabcs01.asc:

0.32796969E+02

ba_Ac0(1, 1, 1) from original ropp_pp/data/MSIS_coeff.nc:

3.27969703674316406250e+01

ba_Ac0(1, 1, 1) from final ropp_pp/data/MSIS_coeff.nc:

3.27969689999999971519e+01

Change history (0)

Note: See TracTickets for help on using tickets.