[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[LDM #JYC-726133]: malformed filenames in received datasets

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [LDM #JYC-726133]: malformed filenames in received datasets
  • Date: Thu, 15 Jul 2010 17:19:42 -0600
Hi Erik,

> in our pqact.conf file we have the following stanza:
> 
> NLDN    .*
> PIPE    decoders/dcnldn -m 25000 -b 30 -s minute05
> -e GEMTBL=gempak/gempak/tables
> metwx/data/YYYYMMDD/nldn/YYYYMMDDHHNN_nldn.gem
> 
> but the data we receive is always prefaced with the same name starting
> at 201005200000_nldn.gem even when the sizes of the files differ from
> day to day. Is this a problem with our setup, or a glitch in the feed?


to use dcnldn you want your pattern action entry to look like:

NLDN       
^([12][0-9][0-9][0-9]|[0-9][0-9])([0-3][0-9][0-9])([0-2][0-9])([0-5][0-9])([0-5][0-9])
        PIPE    decoders/dcnldn -m 25000 -b 30 -s minute05
        -d data/gempak/logs/dcnldn.log
        -e GEMTBL=gempak/gempak/tables
        ...../nldn/YYYYMMDDHHNN_nldn.gem


> 
> On a similar note we have this stanza also in the pqact.conf file:
> 
> WMO     (^S[IM]V[IGNS])|(^SNV[INS])|(^S[IMN](W[KZ]|[^VW]))
> PIPE    decoders/dclsfc -v 2 -s lsystns.upc
> -e GEMTBL=gempak/gempak/tables
> 
> metwx/data/YYYYMMDD/surface/synoptic/(\1:yyyy)(\1:mm)*(\1:dd)_syn.gem
> 
> and the data doesn't seem to get the dates changed at all. The filenames
> seem to be made without any formatting substitutions:


The dclsfc example is using incorrect string substitution formatting ( \1:yyyy, 
\1:mm, etc.).

Try:

WMO     (^S[IM]V[IGNS])|(^SNV[INS])|(^S[IMN](W[KZ]|[^VW]))
        PIPE    decoders/dclsfc -v 2 -s lsystns.upc
        -d data/gempak/logs/dclsfc.log
        -e GEMTBL=gempak/gempak/tables
        ....../YYYYMMDD_syn.gem

With the appropriate gempak data path for your system.

Let me know if you encounter any more trouble.

Michael James
Unidata User Support






Ticket Details
===================
Ticket ID: JYC-726133
Department: Support GEMPAK
Priority: Normal
Status: Open