⇐ ⇒

[CF-metadata] Is "psu" a valid cf unit?

From: Lowry, Roy K. <rkl>
Date: Wed, 19 Jul 2017 11:12:16 +0000

Dear Martin,

Just a point of information from an observational perspective. In shelf seas with estuarine plumes salinities well below 30 - I've come across <20 in the North Sea off the Humber - are possible. In water bodies such as the Mediterranean seabed brines salinities can hit 50.

Measurement precision of salinity is no more than 6 significant figures, which is comfortably within IEEE single precision.

Cheers, Roy.

-----Original Message-----
From: martin.juckes at stfc.ac.uk [mailto:martin.juckes at stfc.ac.uk]
Sent: 19 July 2017 10:39
To: durack1 at llnl.gov; alison.pamment at stfc.ac.uk; v.balaji at noaa.gov
Cc: cf-metadata at cgd.ucar.edu; Lowry, Roy K. <rkl at bodc.ac.uk>; stephen.griffies at noaa.gov; gokhan at ucar.edu; simon.marsland at csiro.au
Subject: RE: [CF-metadata] Is "psu" a valid cf unit?

Hello All,

This appears to have stirred up quite a lot.

I think Balaji is raising a point that has not been picked up: if we have a physical quantity which varies in a small range around 35, then reporting the full value (e.g. 35.346) is going to give less precision than reporting an anomaly (e.g 0.34689). I think this issue of precision can be covered by the use of scale_factor and add_offset as described in section 8.1 of the CF Convention, which states that the units declared in the units attribute should be for the "unpacked" data .. i.e. the data values after the scaling and offset have been inverted to get back the full value. There is a possible confusion when the user community actually want to use the scaled and offset version in their applications, rather than treating it as a purely technical thing going on inside the NetCDF library. In CMIP5, models reported near surface salinity with values in the range 0 to 66, so it doesn't look as if there is a case for scaling there. Some models reported values a factor of 1000 smaller, so there is a need for cle
arer communication -- but I don't think that needs to be addressed by CF: for the CMIP6 data request I can address this by setting an "ok_min_mean_abs" value (a CMIP term ... with no CF meaning) of 28.

I'm afraid I don't understand Paul's point. It looks as though the idea of psu as salinity units has been discussed by the CF list, the UNIDATA issue tracker, and various oceanography standards bodies and there is a broad and clear consensus across all these places that psu should not be treated as a unit of measure.

regards,
Martin

________________________________
From: Durack, Paul J. [durack1 at llnl.gov]
Sent: 18 July 2017 23:38
To: Pamment, Alison (STFC,RAL,RALSP)
Cc: cf-metadata at cgd.ucar.edu; Juckes, Martin (STFC,RAL,RALSP); v.balaji at noaa.gov; rkl at bodc.ac.uk; Stephen Griffies - NOAA Federal; Gokhan Danabasoglu; simon.marsland at csiro.au
Subject: Re: [CF-metadata] Is "psu" a valid cf unit?

Hi folks, I'll chime in here.

There are two issues, labeling salinity in models (which is the focus of much of this thread) and observed quantities, which should both be considered when standardizing the standard_name definitions and units.

For a trip down memory lane, "salinity" has been discussed repeatedly in the CF-list since back to at least 2009 (see http://mailman.cgd.ucar.edu/pipermail/cf-metadata/2009/047515.html). In 2011, I proposed a number of new names that brought the CF names up-to-date with TEOS-10 (see http://mailman.cgd.ucar.edu/pipermail/cf-metadata/2011/055094.html). For those interested, search for "salinity" on http://cfconventions.org/Data/cf-standard-names/45/build/cf-standard-name-table.html, with a particular focus on the names "sea_surface_salinity", "sea_water_absolute_salinity", "sea_water_cox_salinity", "sea_water_knudsen_salinity" and "sea_water_practical_salinity" and take a look at the descriptions for each. The reasons all these names were included was more for history than utility, as the evolution of observed "salinity" needs to be captured somewhere. It also provided all the required salinity "boxes" in the case that older data were digitized.

The "state of the art" oceanographic guidelines (which are very observationally-focused) are documented in the TEOS-10 manual (for interested folks the description of Absolute Salinity is a good place to start: http://teos-10.org/pubs/Getting_Started.pdf#page=7). In this document, the summary (spoiler alert) is to maintain consistency with historical databases, observed salinity will continue to be measured (using conductivity) on the Practical Salinity Scale 1978 (abbreviated to PSS-78). The "unit" PSU is strongly encouraged to be dropped (as Martin pointed out below with the Millero, 1993 ref), this is also repeated in the TEOS-10 supporting documentation. I note that PSS-78, based on conductivity measurements has a valid range of 2 to 42.

For models, things are considerably simpler. No model (that I know of) has implemented Absolute Salinity, as to do so it would need to consider many more tracer fields that are not particularly well observationally constrained, and Absolute Salinity is affected by uncertain chemical and biological processes. A point to note here is that all ocean models are originally initialized from an observational estimate, and most of these are related somehow to one or more versions of the World Ocean Atlas (1994 to 2013v2), which have always been stored as a "unitless" quantity on the PSS-78 (with values ranging from 5 to 40). I would also note that most CMIP5 contributing models provided data in the range 2-42 (with units of 1e-3, the "unit" prior to changes in 2015), however one modeling center took this "unit" literally and provided scaled data in the range 0.002-0.042. I do not believe that there are any range limitations for modeled salinity, and have seen values in excess of 50 in CMIP5, with models variously re
porting "psu" and "1" as salinity "units".

For all these reasons, it is useful to revisit salinity units. As Sean noted below, I attempted to get "salinity" recognized by the UDUNITS package back in 2014 (https://github.com/Unidata/UDUNITS-2/issues/27), at this time my request was rejected, and I was pointed to "Physical Quantity" packages as the solution. We have implemented a "units" convertor in CMOR (https://github.com/PCMDI/cmor/issues/12) that attempts to get around these issues, but it would be my preference that UDUNITS handled this. It would be great if the weight of CF/CMIP could be added to my existing issue (see github link at the top of this para) so the issue can be revisited.

For CMIP6, I think the label "PSS-78" would be appropriate, however I defer to other folks who may have a different perspective (I have cc'd Steve, Gokhan and Simon as the Ocean Model Development Panel contacts to this chain).

Cheers, and happy to hear other perspectives.

P

From: CF-metadata <cf-metadata-bounces at cgd.ucar.edu> on behalf of V Balaji - NOAA Affiliate <v.balaji at noaa.gov>
Date: Tuesday, July 18, 2017 at 7:00 AM
To: "Lowry, Roy K." <rkl at bodc.ac.uk>
Cc: "cf-metadata at cgd.ucar.edu" <cf-metadata at cgd.ucar.edu>, "martin.juckes at stfc.ac.uk" <martin.juckes at stfc.ac.uk>
Subject: Re: [CF-metadata] Is "psu" a valid cf unit?

Oh sorry, Roy. I assumed one was without -35 and /1000

From: CF-metadata <cf-metadata-bounces at cgd.ucar.edu> on behalf of "alison.pamment at stfc.ac.uk" <alison.pamment at stfc.ac.uk>
Date: Tuesday, July 18, 2017 at 6:56 AM
To: "rkl at bodc.ac.uk" <rkl at bodc.ac.uk>, "v.balaji at noaa.gov" <v.balaji at noaa.gov>
Cc: "cf-metadata at cgd.ucar.edu" <cf-metadata at cgd.ucar.edu>, "martin.juckes at stfc.ac.uk" <martin.juckes at stfc.ac.uk>
Subject: Re: [CF-metadata] Is "psu" a valid cf unit?

Dear Balaji, Roy, Martin

I agree completely with what Roy is saying - that labelling something as psu or dimensionless in the units string should have no bearing whatsoever on the storage precision of the numerical value.

However, regarding the scaling, the CF standard name table currently lists the units of practical salinity as "1". Up to and including version 28 of the standard name table we had the units of sea_water_practical_salinity and change_over_time_in_sea_water_practical_salinity listed as "1e-3" which is still a dimensionless number, but scaled. There are two things to say about this:

  1. This change was only made after considerable debate on the CF mailing list in 2015, starting with http://mailman.cgd.ucar.edu/pipermail/cf-metadata/2015/058205.html;
  2. Although the decision was taken to change the scaling in the canonical units to "1", this does not in any way prevent 1e-3 being used in individual data files, if that helps with storage precision, because the two differ only by a scale factor and are in all other aspects equivalent.



Therefore, I don't see the need to have "psu" as a unit in UDunits. It's a matter for the data provider to choose the scaling in his or her data files. Martin is correct that "psu" is not a unit - it refers to a dimensionless number on a calibrated scale.



Best wishes,

Alison

------
Alison Pamment Tel: +44 1235 778065
Centre for Environmental Data Analysis Email: alison.pamment at stfc.ac.uk<mailto:J.A.Pamment at rl.ac.uk>
STFC Rutherford Appleton Laboratory
R25, 2.22
Harwell Campus, Didcot, OX11 0QX, U.K.

On 7/18/17, 6:50 AM, "CF-metadata on behalf of martin.juckes at stfc.ac.uk" <cf-metadata-bounces at cgd.ucar.edu on behalf of martin.juckes at stfc.ac.uk> wrote:

    Hello All,

    After some hunting, I found a copy of a letter from Frank Millero (1993 - "What is PSU") ( http://www.marbef.org/wiki/Salinity_sensors -- box on right) which is adamant that PSU is not a unit and the "Joint Panel on Oceanographic Tables and Standards" has made this clear in their definition of the international equation of state.

    There is perhaps a parallel here with "Decibel", which is accepted by cf-python and rejected by Udunits. There has been discussion on unidata pages, the outcome of which, I think, is that Decibel is a reference to a methodolgy used to arrive at a non-dimensional number, not a unit of measure.

    The CF Standard Name list now has distinct standard names for salinities defined by different algorithms (e.g. sea_water_practical_salinity, sea_water_cox_salinity).

    One compromise might be to add some recognised standard methodological keywords and define a way of placing them in NetCDF files,

    regards,
    Martin


From: CF-metadata [mailto:cf-metadata-bounces at cgd.ucar.edu] On Behalf Of Lowry, Roy K.
Sent: 18 July 2017 14:37
To: V. Balaji - NOAA Affiliate
Cc: cf-metadata at cgd.ucar.edu; Juckes, Martin (STFC,RAL,RALSP)
Subject: Re: [CF-metadata] Is "psu" a valid cf unit?


Dear Balaji,



I think there are some crossed wires here. The dimensionless Practical Salinity and a Practical Salinity in PSU are exact numeric equivalents. The only difference is the name that's given to the unit of measure - that's why to make this crystal clear CF includes the scaling factor of 10^-3. So I don't think that this can affect storage precision.



Cheers, Roy.



Please note that I partially retired on 01/11/2015. I am now only working 7.5 hours a week and can only guarantee e-mail response on Wednesdays, my day in the office. All vocabulary queries should be sent to enquiries at bodc.ac.uk<mailto:enquiries at bodc.ac.uk>. Please also use this e-mail if your requirement is urgent.

On 7/18/17, 6:35 AM, "CF-metadata on behalf of Sean Arms" <cf-metadata-bounces at cgd.ucar.edu on behalf of sarms at ucar.edu> wrote:

    There was a github issue opened on UDUNITS2 a few years back (still
    open, btw) regarding the support for PSU in the package:

    https://github.com/Unidata/UDUNITS-2/issues/27

    An interesting point is made regarding units and physical quantities.

    Sean

________________________________
From: V. Balaji - NOAA Affiliate <v.balaji at noaa.gov<mailto:v.balaji at noaa.gov>>
Sent: 18 July 2017 14:12
To: Lowry, Roy K.
Cc: martin.juckes at stfc.ac.uk<mailto:martin.juckes at stfc.ac.uk>; cf-metadata at cgd.ucar.edu<mailto:cf-metadata at cgd.ucar.edu>; d.c.hassell at reading.ac.uk<mailto:d.c.hassell at reading.ac.uk>; r.s.hatcher at reading.ac.uk<mailto:r.s.hatcher at reading.ac.uk>
Subject: Re: [CF-metadata] Is "psu" a valid cf unit?

The ocean modeling community is adamant that they will continue to use PSUs for salinity: it's this unit, rather than its SI or dimensionless equivalent, that gives the maximum digits of precision in a floating-point representation of salinity.

It's a valid concern, and CF should perhaps reconsider, with a new discussion giving weight to the views of modelers as well as physical oceanographers.

Thanks,

On 7/18/17, 6:11 AM, "CF-metadata on behalf of martin.juckes at stfc.ac.uk" <cf-metadata-bounces at cgd.ucar.edu on behalf of martin.juckes at stfc.ac.uk> wrote:

    Thanks Roy,

    David, Ros: do you accept Roy's answer? If so, cf-python and the cf-checker should presumably be updated to flag "psu" as an invalid unit?

    regards,
    Martin


Lowry, Roy K. writes:

> Hello Martin,
>
>
> This topic has been debated at length in CF. To cut a long story short, the term 'Practical Salinity Unit' was coined when the 1978 Practical Salinity scale was devised. However, the term fell out of favour with the physical oceanographic community whose current recommended practice is that Practical Salinity - a ratio - should be a dimensionless number. CF followed this recommendation and so PSU is not a part of CF.
>
>
> Have a dig around in the mailing list archive if you want to find out more.
>
>
> Cheers, Roy.
>
>
> Please note that I partially retired on 01/11/2015. I am now only working 7.5 hours a week and can only guarantee e-mail response on Wednesdays, my day in the office. All vocabulary queries should be sent to enquiries at bodc.ac.uk<mailto:enquiries at bodc.ac.uk>. Please also use this e-mail if your requirement is urgent.
>
>
> ________________________________
> From: CF-metadata <cf-metadata-bounces at cgd.ucar.edu<mailto:cf-metadata-bounces at cgd.ucar.edu>> on behalf of martin.juckes at stfc.ac.uk<mailto:martin.juckes at stfc.ac.uk> <martin.juckes at stfc.ac.uk<mailto:martin.juckes at stfc.ac.uk>>
> Sent: 18 July 2017 13:43
> To: cf-metadata at cgd.ucar.edu<mailto:cf-metadata at cgd.ucar.edu>; d.c.hassell at reading.ac.uk<mailto:d.c.hassell at reading.ac.uk>; r.s.hatcher at reading.ac.uk<mailto:r.s.hatcher at reading.ac.uk>
> Subject: [CF-metadata] Is "psu" a valid cf unit?
>
> Hello David, all,
>
> Is "psu" a valus CF unit? It is not in Udunits, but it is added in cf-python as a unit alias and also appears to be accpeted by the cf-checker. I can't see any mention of it in the CF Convention document: the latter only lists level, layer, and sigma_level permitted departures from Udunits,
>
> regards,
> Martin
>
> _______________________________________________
> CF-metadata mailing list
> CF-metadata at cgd.ucar.edu<mailto:CF-metadata at cgd.ucar.edu>
> http://mailman.cgd.ucar.edu/mailman/listinfo/cf-metadata
CF-metadata Info Page - University Corporation for ...<http://mailman.cgd.ucar.edu/mailman/listinfo/cf-metadata>
mailman.cgd.ucar.edu
This is an unmoderated list for discussions about interpretation, clarification, and proposals for extensions or change to the CF conventions.



> CF-metadata Info Page - University Corporation for ...<http://mailman.cgd.ucar.edu/mailman/listinfo/cf-metadata>
CF-metadata Info Page - University Corporation for ...<http://mailman.cgd.ucar.edu/mailman/listinfo/cf-metadata>
mailman.cgd.ucar.edu
This is an unmoderated list for discussions about interpretation, clarification, and proposals for extensions or change to the CF conventions.



> mailman.cgd.ucar.edu
> This is an unmoderated list for discussions about interpretation, clarification, and proposals for extensions or change to the CF conventions.
>
>
>
> ________________________________
> This message (and any attachments) is for the recipient only. NERC is subject to the Freedom of Information Act 2000 and the contents of this email and any reply you make may be disclosed by NERC unless it is exempt from release under the Act. Any material supplied to NERC may be stored in an electronic records management system.
> ________________________________
>

--
V. Balaji                               Office:  +1-609-452-6516
Head, Modeling Systems Group, GFDL      Mobile:  +1-917-273-9824
Princeton University                    Email: v.balaji at noaa.gov<mailto:v.balaji at noaa.gov>
https://www.gfdl.noaa.gov/v-balaji-homepage
v-balaji-homepage - Geophysical Fluid Dynamics Laboratory<https://www.gfdl.noaa.gov/v-balaji-homepage>
www.gfdl.noaa.gov<http://www.gfdl.noaa.gov>
Bio Dr. V. Balaji is affiliated with Princeton University's Cooperative Institute on Climate Sciences. He has headed the Modeling Systems Group at NOAA's Geophysical ...
________________________________
This message (and any attachments) is for the recipient only. NERC is subject to the Freedom of Information Act 2000 and the contents of this email and any reply you make may be disclosed by NERC unless it is exempt from release under the Act. Any material supplied to NERC may be stored in an electronic records management system.
________________________________
________________________________
 This message (and any attachments) is for the recipient only. NERC is subject to the Freedom of Information Act 2000 and the contents of this email and any reply you make may be disclosed by NERC unless it is exempt from release under the Act. Any material supplied to NERC may be stored in an electronic records management system.
________________________________
Received on Wed Jul 19 2017 - 05:12:16 BST

This archive was generated by hypermail 2.3.0 : Tue Sep 13 2022 - 23:02:42 BST

⇐ ⇒