[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: LDM write errors

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: Re: LDM write errors
  • Date: Tue, 29 Feb 2000 16:18:25 -0700
Hi Ken,

> # Run the process script to do the proper actions for this new message
> AFOS  ^(...)(...)(...|..)
>       PIPE    -strip /home/ldm/process \1 \2 \3

gets errors like

> Feb 29 21:48:53 wwwldm notifyme[24340]:     8904 20000229214815.415    
> AFOS 000  MEMFWFMRX 
> Feb 29 21:48:54 wwwldm pqact[10524]: pipe_dbufput: 
> -strip/home/ldm/processMEMFWFMRX write error 

I don't know much about this particular problem, but in general a
write error from a PIPE command usually means that the process that
owns the other end of the pipe that pqact is trying to write to has
died, so the pipe has been closed.

Try processing products of this type manually with /home/ldm/process
to see if they cause the /home/ldm/process script to die for some
reason.  Check to make sure that the process has permission to write
any files or create any directories that are needed.  Try to capture
any error messages produced by the /home/ldm/process perl script
somewhere else so you can see what error it encountered.

This doesn't appear to be an LDM problem, but rather a problem with
the perl script that pqact invokes to process the products.

--Russ

     We have problems with certain text products that seem to indicate that 
     our EXEC'ed script gets fired off twice when a product is received 
     once.  A look at the ldmd.log finds entries like:
     
     Feb 29 21:48:53 wwwldm notifyme[24340]:     8904 20000229214815.415    
     AFOS 000  MEMFWFMRX 
     Feb 29 21:48:54 wwwldm pqact[10524]: pipe_dbufput: 
     -strip/home/ldm/processMEMFWFMRX write error 
     Feb 29 21:48:54 wwwldm pqact[10524]: pipe_dbufput: 
     -strip/home/ldm/processMEMFWFMRX write error 
     
     Feb 29 21:51:54 wwwldm notifyme[24340]:     8904 20000229215116.736    
     AFOS 000  MEMFWFMRX 
     Feb 29 21:51:55 wwwldm pqact[10524]: pipe_dbufput: 
     -strip/home/ldm/processMEMFWFMRX write error 
     Feb 29 21:51:56 wwwldm pqact[10524]: pipe_dbufput: 
     -strip/home/ldm/processMEMFWFMRX write error 
     
     Note that I get two errors for each receipt of the product.  This 
     really louses up my script as it is rotating versions (1 through 9) 
     and the two instances of the script fall over each other.  The result 
     is instead of having versions 1-2-3-4-5-6-7-8-9 I end up with either 
     2-4-6-8 or 1-3-5-7-9.  
     
     What I really need to know is what is causing these write errors.  The 
     error seems to be product specific.  Namely it always happens to 
     certain products (like MEMFWFMRX, in this case).
     
     I have attached some relevant files.
     
     Thanks for any help.
     
     Ken Waters
     NWS Southern Region SSD
     (817) 978-2671

2.      process
You have received an encoded file.              (Invoke menu with right button.)
        name = process
        disposition = attachment
        filename = process

 Decode and Save... 

3.      text/plain
# File a temporary copy of each incoming message

AFOS    ^(...)(...)(...|..)
        FILE    -strip -overwrite /home/ldm/data/current/\1\2\3.tmp


# Run the process script to do the proper actions for this new message

AFOS    ^(...)(...)(...|..)
        PIPE    -strip /home/ldm/process \1 \2 \3


# Temporary routine to write a temp file just to make new directories as needed

AFOS    ^(...)(...)(...|..)
        FILE    -overwrite /home/ldm/data/\1/\2/temp.tmp

# Extra write to ENSURE important products get properly written!

AFOS    ^(...)(ZFP)(...)
        FILE    -strip -overwrite /home/ldm/data/\1/\2/\1\2\3.1.txt
AFOS    ^(ATL)(HYD)(...)
        FILE    -strip -overwrite /home/ldm/data/\1/\2/\1\2\3.1.txt
AFOS    ^(ATL)(MAP)(...)
        FILE    -strip -overwrite /home/ldm/data/\1/\2/\1\2\3.1.txt
AFOS    ^(...)(NOW)(...)
        FILE    -strip -overwrite /home/ldm/data/\1/\2/\1\2\3.1.txt
AFOS    ^(...)(TOR)(...)
        FILE    -strip -overwrite /home/ldm/data/\1/\2/\1\2\3.1.txt
AFOS    ^(...)(SVR)(...)
        FILE    -strip -overwrite /home/ldm/data/\1/\2/\1\2\3.1.txt

4.      text/plain
Feb 29 21:53:24 wwwldm notifyme[24340]:      904 20000229215301.808    AFOS 000 
 NMCRRAOR 
Feb 29 21:53:24 wwwldm notifyme[24340]:      569 20000229215301.893    AFOS 000 
 NMCRRAAZ 
Feb 29 21:53:24 wwwldm notifyme[24340]:      314 20000229215301.976    AFOS 000 
 NMCRRAOUN 
Feb 29 21:53:24 wwwldm notifyme[24340]:      274 20000229215302.071    AFOS 000 
 NMCRRAOKC 
Feb 29 21:53:24 wwwldm notifyme[24340]:      298 20000229215302.209    AFOS 000 
 NMCRRATUL 
Feb 29 21:53:24 wwwldm notifyme[24340]:      167 20000229215302.301    AFOS 000 
 MEMCCFMRX 
Feb 29 21:53:24 wwwldm notifyme[24340]:      925 20000229215302.485    AFOS 000 
 OMASVROMA 
Feb 29 21:53:24 wwwldm notifyme[24340]:     1715 20000229215302.583    AFOS 000 
 MIAAFDTLH 
Feb 29 21:53:54 wwwldm notifyme[24340]:     2333 20000229215327.682    AFOS 000 
 SJUMWSSJU 
Feb 29 21:53:54 wwwldm notifyme[24340]:     1190 20000229215327.768    AFOS 000 
 STLSVRMCI 
Feb 29 21:53:54 wwwldm notifyme[24340]:       68 20000229215327.848    AFOS 000 
 ABQMTRLVS 
Feb 29 21:53:54 wwwldm notifyme[24340]:       99 20000229215327.934    AFOS 000 
 ABQMTRDMN 
Feb 29 21:53:54 wwwldm notifyme[24340]:     3170 20000229215328.024    AFOS 000 
 RDUZFPRAH 
Feb 29 21:53:54 wwwldm notifyme[24340]:      118 20000229215328.116    AFOS 000 
 FTWBOYPN1 
Feb 29 21:53:54 wwwldm notifyme[24340]:      498 20000229215328.218    AFOS 000 
 STLNOWMCI 
Feb 29 21:53:54 wwwldm notifyme[24340]:      137 20000229215328.308    AFOS 000 
 FTWBOYOC7 
Feb 29 21:54:13 wwwldm pqexpire[10522]: > Recycled    811.998 kb/hr (  1155.940 
prods per hour) 
Feb 29 21:54:24 wwwldm notifyme[24340]:     3577 20000229215353.422    AFOS 000 
 FTWRRSFWR 
Feb 29 21:54:24 wwwldm notifyme[24340]:     2781 20000229215353.501    AFOS 000 
 NEWRRSORN 
Feb 29 21:54:24 wwwldm notifyme[24340]:     3295 20000229215353.587    AFOS 000 
 OKCRRSTUA 
Feb 29 21:54:25 wwwldm notifyme[24340]:      892 20000229215353.678    AFOS 000 
 NMCRRSDDC 
Feb 29 21:54:25 wwwldm notifyme[24340]:      118 20000229215353.762    AFOS 000 
 FTWBOYPN1 
Feb 29 21:54:25 wwwldm notifyme[24340]:     5170 20000229215353.852    AFOS 000 
 CAEZFPGSP 
Feb 29 21:54:25 wwwldm notifyme[24340]:      696 20000229215353.947    AFOS 000 
 ATLRRSALR 
Feb 29 21:54:27 wwwldm pqact[10524]: pbuf_flush (33) write: Broken pipe 
Feb 29 21:54:55 wwwldm notifyme[24340]:      118 20000229215419.052    AFOS 000 
 FTWBOYPN1 
Feb 29 21:54:55 wwwldm notifyme[24340]:      288 20000229215419.140    AFOS 000 
 NMCRRSGLD 
Feb 29 21:54:55 wwwldm notifyme[24340]:       92 20000229215419.335    AFOS 000 
 NMCRRSMAF 
Feb 29 21:54:55 wwwldm notifyme[24340]:      720 20000229215419.432    AFOS 000 
 NMCRRSMCI 
Feb 29 21:54:55 wwwldm notifyme[24340]:     2241 20000229215419.530    AFOS 000 
 WBCCWFWBC 
Feb 29 21:54:55 wwwldm notifyme[24340]:     1103 20000229215419.628    AFOS 000 
 NMCRRSRIW 
Feb 29 21:54:55 wwwldm notifyme[24340]:     5038 20000229215419.710    AFOS 000 
 PITRVFNY1 
Feb 29 21:54:55 wwwldm notifyme[24340]:     8904 20000229215419.806    AFOS 000 
 MEMFWFMRX 
Feb 29 21:54:55 wwwldm notifyme[24340]:       89 20000229215419.895    AFOS 000 
 MIARR3TBW 
Feb 29 21:54:58 wwwldm pqact[10524]: pbuf_flush (14) write: Broken pipe 
Feb 29 21:54:58 wwwldm pqact[10524]: pipe_dbufput: 
-strip/home/ldm/processMEMFWFMRX write error 
Feb 29 21:54:58 wwwldm pqact[10524]: pipe_prodput: trying again 
Feb 29 21:54:58 wwwldm pqact[10524]: pbuf_flush (14) write: Broken pipe 
Feb 29 21:54:58 wwwldm pqact[10524]: pipe_dbufput: 
-strip/home/ldm/processMEMFWFMRX write error 
Feb 29 21:54:58 wwwldm pqact[10524]: pbuf_flush (34) write: Broken pipe 
Feb 29 21:55:25 wwwldm notifyme[24340]:      118 20000229215445.003    AFOS 000 
 FTWBOYPN1