[LDM #JXN-827520]: pact metar2nc failure

Hi Terri,

Before diving into the extensive info you provided below (very nice, by the 
way),
I have one question:

- what is the <datadir-path></datadir-path> setting for pqact in your 
~ldm/etc/registry.xml
  file?

  If it is _not_ /home/ldm, then your problem is being caused by the current
  working directory for 'pqact' not being /home/ldm, and when this is the
  case, the pattern-action file reference to the decoder, 'util/metar2nc'
  will not be correct.  This can be "fixed" in either of two ways:

  - change the <datadir-path></datadir-path> setting in ~ldm/etc/registry.xml
    to /home/ldm

    NB: this could well have some unexpected consequences depending on your
    LDM installation

  - change the relative reference to the decoders to absolute references

    For instance, change all occurrences of 'util/metar2nc' to 
'/home/ldm/util/metar2nc'
    in your pattern-action file(s) (actually, change all relative references
    to absolute ones in all pattern-action files)

If you opt for the 2nd way above, you should be able to simply send a
HUP signal to all 'pqact' instances telling them to reread their pattern-action
files:

-- make the changes from relative to absolute reference of decoders
ldmadmin pqactcheck
ldmadmin pqactHUP

Cheers,

Tom

> My environment is:
> 
> Linux energy02 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt11-1+deb8u6 
> (2015-11-09) x86_64 GNU/Linux
> debian_version 8.3 (jessie)
> 
> LDM version 6.12.14
> 
> *****
> I am getting the following errors constantly in my /var/log/syslog file.
> 
> Mar 16 20:23:55 energy02 pqact[119690] ERROR: Child 131879 exited with status 
> 1
> Mar 16 20:23:55 energy02 pqact[119690] ERROR: Deleting failed PIPE entry: 
> pid=131879, cmd="util/metar2nc -t 300 -l logs -d data/dec_data/obs/metar 
> etc/metar.cdl”
> 
> and
> 
> Mar 16 20:25:16 energy02 pqact[132356] ERROR: No such file or directory
> Mar 16 20:25:16 energy02 pqact[132356] ERROR: [filel.c:1552] Couldn't execute 
> decoder "util/metar2nc"
> Mar 16 20:25:16 energy02 pqact[132356] NOTE: Exiting
> 
> The process id must be a child process in the second batch of errors.
> 
> The pqact.conf entry is:
> 
> WMO     ^S[AP].* .... ([0-3][0-9])([0-2][0-9][0-5][0-9])        PIPE    
> util/metar2nc -t 300 -l logs -d data/dec_data/obs/metar etc/metar.cdl
> 
> The raw files exist:
> 
> # ls -al /home/ldm/data/raw_data/obs/metar
> total 24
> drwxr-xr-x 6 ldm dicast 4096 Mar 16 00:15 .
> drwxr-xr-x 4 ldm dicast 4096 Feb  3 22:05 ..
> drwxr-xr-x 2 ldm dicast 4096 Mar 16 00:15 20160313
> drwxr-xr-x 2 ldm dicast 4096 Mar 16 20:15 20160314
> drwxr-xr-x 2 ldm dicast 4096 Mar 15 23:00 20160315
> drwxr-xr-x 2 ldm dicast 4096 Mar 16 20:00 20160316
> 
> # ls -al /home/ldm/data/raw_data/obs/metar/20160316
> total 26444
> drwxr-xr-x 2 ldm dicast    4096 Mar 16 20:00 .
> drwxr-xr-x 6 ldm dicast    4096 Mar 16 00:15 ..
> -rw-r--r-- 1 ldm dicast 1265708 Mar 16 00:59 metar.20160316.0000.asc
> -rw-r--r-- 1 ldm dicast 1223156 Mar 16 01:59 metar.20160316.0100.asc
> -rw-r--r-- 1 ldm dicast 1244933 Mar 16 02:59 metar.20160316.0200.asc
> -rw-r--r-- 1 ldm dicast 1274306 Mar 16 03:59 metar.20160316.0300.asc
> -rw-r--r-- 1 ldm dicast 1295598 Mar 16 04:59 metar.20160316.0400.asc
> -rw-r--r-- 1 ldm dicast 1328534 Mar 16 05:59 metar.20160316.0500.asc
> -rw-r--r-- 1 ldm dicast 1361447 Mar 16 06:59 metar.20160316.0600.asc
> -rw-r--r-- 1 ldm dicast 1373147 Mar 16 07:59 metar.20160316.0700.asc
> -rw-r--r-- 1 ldm dicast 1355347 Mar 16 08:59 metar.20160316.0800.asc
> -rw-r--r-- 1 ldm dicast 1368429 Mar 16 09:59 metar.20160316.0900.asc
> -rw-r--r-- 1 ldm dicast 1342102 Mar 16 10:59 metar.20160316.1000.asc
> -rw-r--r-- 1 ldm dicast 1334404 Mar 16 11:59 metar.20160316.1100.asc
> -rw-r--r-- 1 ldm dicast 1362192 Mar 16 12:59 metar.20160316.1200.asc
> -rw-r--r-- 1 ldm dicast 1325419 Mar 16 13:59 metar.20160316.1300.asc
> -rw-r--r-- 1 ldm dicast 1339141 Mar 16 14:59 metar.20160316.1400.asc
> -rw-r--r-- 1 ldm dicast 1303124 Mar 16 15:59 metar.20160316.1500.asc
> -rw-r--r-- 1 ldm dicast 1259828 Mar 16 16:59 metar.20160316.1600.asc
> -rw-r--r-- 1 ldm dicast 1290720 Mar 16 17:59 metar.20160316.1700.asc
> -rw-r--r-- 1 ldm dicast 1289696 Mar 16 18:59 metar.20160316.1800.asc
> -rw-r--r-- 1 ldm dicast 1225412 Mar 16 19:59 metar.20160316.1900.asc
> -rw-r--r-- 1 ldm dicast  780683 Mar 16 20:31 metar.20160316.2000.asc
> 
> The target directory did not exist, but the error persisted after I created it
> 
> # ls -al /home/ldm/data/dec_data/obs/metar
> otal 8
> drwxr-xr-x 2 ldm dicast 4096 Mar 16 20:29 .
> drwxr-xr-x 5 ldm dicast 4096 Mar 16 20:29 ..
> 
> The cdl file exists:
> 
> # ls -al /home/ldm/etc/metar.cdl
> -rw-r--r-- 1 ldm ldm 27048 Jan 29  2014 /home/ldm/etc/metar.cdl
> 
> Running the command as user ldm manually on the command line by copy/pasting 
> the “cmd=“ section of the pqact.conf
> file gave a few perl warnings but otherwise no output other than the file 
> /home/ldm/logs/metar2nc.20160316.asc.
> 
> ldm>date
> Wed Mar 16 20:40:23 UTC 2016
> ldm>util/metar2nc -t 300 -l logs -d data/dec_data/obs/metar etc/metar.cdl
> defined(@array) is deprecated at util/metar2nc line 1227.
> (Maybe you should just omit the defined()?)
> 
> … many more on different lines in the script
> 
> # cat /home/ldm/logs/metar2nc.20160316.asc
> 20:40:26 Starting metar2nc, process ID 135229
> 20:45:26 Caught SIGtimeout --shutting down
> 20:45:26 Ending process ID 135229
> 
> Same problem with the syn2nc util.
> *****
> 
> If there is a separate forum for the utils, please let me know. Maybe there 
> are
> new utils somewhere? File format problem?
> 
> Thanks a bunch for any advice,
> Terri
> 
> —
> Terri Eads | IT Manager | Global Weather Corporation
> 3005 Sterling Circle, Suite 201, Boulder, CO 80301 USA | m) 303.775.0080
> address@hidden <mailto:address@hidden>
> 
> 

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: JXN-827520
Department: Support LDM
Priority: Normal
Status: Closed