⇐ ⇒

[CF-metadata] Update on ncdismember (+CFchecker) for hierarchical files

From: stephen.pascoe at stfc.ac.uk <stephen.pascoe>
Date: Wed, 15 Jan 2014 15:04:03 +0000

It's great to hear there is another checker in active development. The one based on cdat was developed some time ago and could really do with an update. We would like to replace cdat entirely at some point and replace with python-netCDF4. It's a pitty that both of our packages are called cfchecker though :-). In the UK "cfchecker" is synonymous with the code available through the CF Trac site and available as a web service at the BADC and University of Reading.

When we have time we will take a look at your package, and particularly the test suite to see if we can draw both test suites together. This would allow us to identify gaps in either tool and hopefully move towards a single way forward.

Stephen.

On 13 Jan 2014, at 16:48, Charlie Zender wrote:

> Hello Stephen,
>
> ncdismember uses the cfchecker code developed by Michael Decker and
> Martin Schultz and distributed at https://bitbucket.org/mde_/cfchecker
> ncdismember makes no changes to that code. Is that the same as yours?
>
> The ncdismember script is at http://nco.sf.net/nco.html#ncdismember
> The part involving CFChecker is very straightforward.
> We would welcome any changes that improve the user experience.
>
> Are there multiple codes named "CFChecker"?
> We'd be happy to accept a patch that allows ncdismember to use more
> than one "CFChecker", or to exploit other options of the checker.
> AFAICT we currently use all the options except the one that allows
> explicit specifications of which tests to perform.
>
> Charlie
>
> Le 13/01/2014 01:42, stephen.pascoe at stfc.ac.uk a ?crit :
>> Hi Charlie,
>>
>> I'm interested in how you are using the CFChecker code. Are you using the code form the CF SVN [1] or the packaging I maintain based on the same codebase [2], or is this independent code? Have you applied any patches to the version you use in ncdismember? It would be good to keep any improvements to the code in the main line.
>>
>> Thanks,
>> Stephen.
>>
>> [1]: https://cf-pcmdi.llnl.gov/trac/browser/cf-checker
>> [2]: https://pypi.python.org/pypi/cfchecker
>>
>> ---
>> Stephen Pascoe +44 (0)1235 445980
>> Centre of Environmental Data Archival
>> STFC Rutherford Appleton Laboratory, Harwell Oxford, Didcot OX11 0QX, UK
>>
>>
>> -----Original Message-----
>> From: CF-metadata [mailto:cf-metadata-bounces at cgd.ucar.edu] On Behalf Of Charlie Zender
>> Sent: 09 January 2014 22:53
>> To: CF Metadata Mail List
>> Subject: [CF-metadata] Update on ncdismember (+CFchecker) for hierarchical files
>>
>> Hello CFers,
>>
>> A few months ago I introduced ncdismember, a script that uses the netCDF Operators (NCO) to dismember hierarchical netCDF-compliant files into netCDF3-compliant (flat-) files, then calls CFChecker on those. It is a simple (one-line) procedure that checks CF-compliance of all groups in hierarchical netCDF4/HDF5 files.
>> The recent releases of NCO 4.4.0 and netCDF 4.3.1-rc7 bring significant new features to ncdismember...
>>
>> 1. Works on all groups in netCDF4/HDF5 files. Not only leaf groups.
>> 2. Works on HDF4 files. No prior conversion to netCDF necessary.
>> 3. Automatically translates input to netCDF3-supported types (e.g.,
>> nc_string->nc_char, nc_ubyte->nc_short).
>> 4. Is faster: Uses CFChecker batch mode and avoids temporary output.
>>
>> Example input (*.nc, *.hdf, *.h5, *.he5) and output (*.txt):
>> http://dust.ess.uci.edu/diwg
>>
>> For more information see
>> http://nco.sf.net/nco.html#dismember
>>
>> Feedback welcome on relevant NCO SourceForge forum https://sourceforge.net/p/nco/discussion
>>
>> Enjoy,
>> Charlie
>> --
>> Charlie Zender, Earth System Sci. & Computer Sci.
>> University of California, Irvine 949-891-2429 )'( _______________________________________________
>> CF-metadata mailing list
>> CF-metadata at cgd.ucar.edu
>> http://mailman.cgd.ucar.edu/mailman/listinfo/cf-metadata
>>
>
> --
> Charlie Zender, Earth System Sci. & Computer Sci.
> University of California, Irvine 949-891-2429 )'(

-- 
Scanned by iCritical.
Received on Wed Jan 15 2014 - 08:04:03 GMT

This archive was generated by hypermail 2.3.0 : Tue Sep 13 2022 - 23:02:41 BST

⇐ ⇒