⇐ ⇒

[CF-metadata] machine-accessible CF compliance checker?

From: John Caron <caron>
Date: Thu, 01 Mar 2012 08:49:56 -0700

Hi all:

If the checker can read from opendap, then putting the files on an
opendap server might be helpful, in
that only the metadata is read instead of the entire file.

There are a few difference among servers (Hyrax, TDS, GDS, etc) but im
pretty sure this would work for
netcdf files well enough for the checker's needs. could be worth finding
out.

john

On 2/29/2012 7:55 AM, Bentley, Philip wrote:
> Hi Stephen,
>
> I may well be wrong, but I suspect that one of the reasons - perhaps the
> main reason - why folks would like access to a stand-alone cfchecker
> utility is the large size of their netcdf files. (It's certainly the
> reason we use a local version.)
>
> As you know only too well (from CMIP5), most of the netcdf files we're
> dealing with these days run into the high 100s of MB or low GBs. It's
> not really practical to upload such files in order to perform a CF
> compliance check. At least not on more than a few files.
>
> I wonder, therefore, if a possible solution is to develop an alternative
> checker utility that operates not on the netcdf file itself, but rather
> on the header info output by the ncdump -h command. Generating and
> uploading those would be trivial by comparison.
>
> Off the top of my head (and having given it almost zero thought!) the
> only test that I can think of which examines the actual data values is
> the check for coord vars being monotonic. But I suspect there are others
> I'm unaware of.
>
> If nothing else, such a utility might have some value as a 'first pass'
> checker.
>
> Any mileage in this? Apologies if it's already done the rounds!
>
> Regards,
> Phil
>
>
>> -----Original Message-----
>> From: cf-metadata-bounces at cgd.ucar.edu
>> [mailto:cf-metadata-bounces at cgd.ucar.edu] On Behalf Of
>> stephen.pascoe at stfc.ac.uk
>> Sent: 29 February 2012 11:39
>> To: christopher.s.lynnes at nasa.gov; cf-metadata at cgd.ucar.edu
>> Subject: Re: [CF-metadata] machine-accessible CF compliance checker?
>>
>> Hi Christopher,
>>
>> Are you looking for a way to run the cfchecker locally or
>> submit checking requests to one of the websites in a script?
>>
>> I think both would be possible with a little help. The
>> cfchecker is now available on the Python Package Index at
>> http://pypi.python.org/pypi/cfchecker. It needs a little
>> help to work out of the box -- you need to configure UDUNITS
>> and the location of several CF XML files. It's on my
>> long-term TODO list to make this configuration easier.
>>
>> Also the CF-checker at BADC and NCAS-CMS has a very simple
>> HTTP interface that could be scripted.
>>
>> Cheers,
>> Stephen.
>>
>> ---
>> Stephen Pascoe +44 (0)1235 445980
>> Centre of Environmental Data Archival
>> STFC Rutherford Appleton Laboratory, Harwell Oxford, Didcot
>> OX11 0QX, UK
>>
>>
>> -----Original Message-----
>> From: cf-metadata-bounces at cgd.ucar.edu
>> [mailto:cf-metadata-bounces at cgd.ucar.edu] On Behalf Of
>> Lynnes, Christopher S. (GSFC-6102)
>> Sent: 28 February 2012 16:03
>> To: cf-metadata at cgd.ucar.edu
>> Subject: [CF-metadata] machine-accessible CF compliance checker?
>>
>> I know about the web sites where you use a form to upload
>> files to check CF compliance, but is there a service
>> somewhere that can be accessed by a script?
>> --
>> Dr. Christopher Lynnes NASA/GSFC, Code 610.2 phone:
>> 301-614-5185
>>
>>
>> _______________________________________________
>> CF-metadata mailing list
>> CF-metadata at cgd.ucar.edu
>> http://mailman.cgd.ucar.edu/mailman/listinfo/cf-metadata
>> --
>> Scanned by iCritical.
>> _______________________________________________
>> CF-metadata mailing list
>> CF-metadata at cgd.ucar.edu
>> http://mailman.cgd.ucar.edu/mailman/listinfo/cf-metadata
>>
> _______________________________________________
> CF-metadata mailing list
> CF-metadata at cgd.ucar.edu
> http://mailman.cgd.ucar.edu/mailman/listinfo/cf-metadata
Received on Thu Mar 01 2012 - 08:49:56 GMT

This archive was generated by hypermail 2.3.0 : Tue Sep 13 2022 - 23:02:41 BST

⇐ ⇒