Re: 20020425: RAP IIDA Icing product to FSL questions again

Hi Celia, 

Still using pqinsert instead of ldmsend?

If so, the bigger queue would make sense, otherwise I do not think we have
resolved the issue...

Glad to hear things are working.

Thanks for the update,

-Jeff
____________________________                  _____________________
Jeff Weber                                    address@hidden
Unidata Support                               PH:303-497-8676 
NWS-COMET Case Study Library                  FX:303-497-8690
University Corp for Atmospheric Research      3300 Mitchell Ln
http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000
________________________________________      ______________________

On Wed, 8 May 2002, Celia Chen wrote:

> Hi Jeff,
> 
> The files seem to be sent okay now.  I am not sure what did it.  One thing
> I did was to increase the pq_size. 
> 
> To answer your question about the feedtype, all the products are sent as
> EXP type.
> 
> Thanks for your help.
> 
> Celia
> 
> 
> > 
> > On Tue, 7 May 2002, Celia Chen wrote:
> > 
> > > Hi Jeff,
> > > 
> > > We have been sending those two different types of products out for 
> > > sometime
> > > now without problems. I asked the person who wrote the script to use 
> > > pqinsert 
> > > instead of ldmsend yesterday. Do you think that would make a difference?
> > 
> > pqinsert is more robust, ldmsend is a one shot deal, if it does not
> > transfer...it does not transfer. pqinsert at least puts it in the queue so
> > multiple attempts to send can be carried out if a packet drops.
> > 
> >  I
> > > still see missing products when I do ldmadmin watch. I have also asked
> > > the user to save the data files on the disk for a longer period 
> > > of time - to make sure the file is there when needed to be. 
> > > 
> > > Also, people use front to send out two other grb products in addition
> > > to these two. Could this be the reason that causes data not to be
> > > delevered?
> > 
> > On the same feedtype?
> > 
> > 
> > It could be consuming bandwidth if they are large, or if you have a slow
> > machine..and w/ldmsend they are not resent. Between here and FSL one would
> > not think bandwidth should be an issue...
> > 
> > 
> > 
> > Jeff Weber
> > Unidata Support
> > 
> > 
> > > Thanks.
> > > 
> > > Celia
> > > 
> > > > 
> > > > HI Celia, 
> > > > 
> > > > Something I just noticed:
> > > > 
> > > >  May 06 20:26:10 front iita(noti)[9725]: 2002050620f00_IIDA.grb: RPC:
> > > > Unable to receive
> > > > 
> > > > oppossed to
> > > > 
> > > > request  EXP   "RAP\.Icing\.IIDA\.ASCII
> > > > 
> > > > one is looking for .ascii and the other is .grb...could be an issue.
> > > > 
> > > > Thank you,
> > > > 
> > > > -Jeff
> > > > ____________________________                  _____________________
> > > > Jeff Weber                                    address@hidden
> > > > Unidata Support                               PH:303-497-8676 
> > > > NWS-COMET Case Study Library                  FX:303-497-8690
> > > > University Corp for Atmospheric Research      3300 Mitchell Ln
> > > > http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000
> > > > ________________________________________      ______________________
> > > > 
> > > > On Mon, 6 May 2002, Celia Chen wrote:
> > > > 
> > > > > Jeff,
> > > > > 
> > > > > I setup to request the Icing product from iita and here is what I got:
> > > > > 
> > > > > May 06 20:26:10 front iita(noti)[9725]: 2002050620f00_IIDA.grb: RPC: 
> > > > > Unable to receive
> > > > > May 06 20:26:10 front iita(noti)[9725]: pq_sequence failed: I/O error 
> > > > > (errno = 5)
> > > > > May 06 20:26:10 front iita(noti)[9725]: Exiting 
> > > > > 
> > > > > Please advise.
> > > > > 
> > > > > Thanks.
> > > > > 
> > > > > Celia
> > > > > 
> > > > > > 
> > > > > > He Jeff, 
> > > > > > 
> > > > > > Here is what I got from the FSL last week - I asked for a copy of 
> > > > > > the
> > > > > > ldmd.conf file:
> > > > > > > > Here is our request line for the IIDA/IIFA data:
> > > > > > > >
> > > > > > > > request  EXP   "RAP\.Icing\.IIDA\.ASCII"        
> > > > > > > > front.rap.ucar.edu               
> > > > > > 
> > > > > > Is there an LDM command that I can use to see if the product is 
> > > > > > indeed sent out 
> > > > > > from front?
> > > > > > 
> > > > > > Thanks.
> > > > > > 
> > > > > > Celia
> > > > > > 
> > > > > > > 
> > > > > > > Hi Jeff,
> > > > > > > 
> > > > > > > As you can see I am still working on this problem.  I tried to 
> > > > > > > get a copy of
> > > > > > > the ldmd.conf file from FSL but have not received one yet. Can 
> > > > > > > you tell me  what
> > > > > > > "Connection reset by peer" mean, as shown in the following log 
> > > > > > > messages?
> > > > > > > Looks like the following 3 lines appeared when the prduct didn't 
> > > > > > > get to
> > > > > > > FSL.
> > > > > > > 
> > > > > > > 
> > > > > > > May 06 20:03:38 front localhost[9404]: hiya: 20020506190338.844 
> > > > > > > TS_ENDT {{EXP,  ".*"}}
> > > > > > > May 06 20:03:38 front localhost[9404]: Connection reset by peer
> > > > > > > May 06 20:03:38 front localhost[9404]: Exiting    
> > > > > > > 
> > > > > > > 
> > > > > > > Thanks.
> > > > > > > 
> > > > > > > Celia
> > > > > > > 
> > > > > > > > 
> > > > > > > > Hi Celia, 
> > > > > > > > 
> > > > > > > > nullproc(gobbo.fsl.noaa.gov): RPC: Timed out
> > > > > > > > 
> > > > > > > > Yes, this could cause you to lose products..
> > > > > > > > 
> > > > > > > > I am guessing here, because (I assume) gobbo has removed the 
> > > > > > > > ALLOW
> > > > > > > > *.unidata.ucar.edu line from their ldmd.conf so I cannot query 
> > > > > > > > gobbo.
> > > > > > > > 
> > > > > > > > I am also guessing, but suspect strongly, that this section has 
> > > > > > > > been
> > > > > > > > incorrectly modified..
> > > > > > > > 
> > > > > > > > ###############################################################################
> > > > > > > > 
> > > > > > > > # send anything to your own machine
> > > > > > > > allow   ANY
> > > > > > > > 
> > > > > > > > ^((localhost|loopback)|(127\.0\.0\.1\.?$)|([a-z].*\.unidata\.ucar\.edu\.?$))
> > > > > > > > 
> > > > > > > > ###############################################################################
> > > > > > > > # ACCEPT: Who can feed us
> > > > > > > > #
> > > > > > > > # accept <feedset> <pattern> <hostname pattern>
> > > > > > > > ###############################################################################
> > > > > > > > 
> > > > > > > > 
> > > > > > > > # accept anything from yourself
> > > > > > > > accept  ANY     .*      
> > > > > > > > ^((localhost|loopback)|(127\.0\.0\.1\.?$))
> > > > > > > > ------------------------------------------------------------------------------
> > > > > > > > 
> > > > > > > > Can you get a copy of their ldmd.conf to confirm or dissolve 
> > > > > > > > this
> > > > > > > > hypothesis..
> > > > > > > > 
> > > > > > > > Thank you,
> > > > > > > > 
> > > > > > > > -Jeff
> > > > > > > > ____________________________                  
> > > > > > > > _____________________
> > > > > > > > Jeff Weber                                    address@hidden
> > > > > > > > Unidata Support                               PH:303-497-8676 
> > > > > > > > NWS-COMET Case Study Library                  FX:303-497-8690
> > > > > > > > University Corp for Atmospheric Research      3300 Mitchell Ln
> > > > > > > > http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 
> > > > > > > > 80307-3000
> > > > > > > > ________________________________________      
> > > > > > > > ______________________
> > > > > > > > 
> > > > > > > > On Thu, 25 Apr 2002, Unidata Support wrote:
> > > > > > > > 
> > > > > > > > > 
> > > > > > > > > ------- Forwarded Message
> > > > > > > > > 
> > > > > > > > > >To: address@hidden
> > > > > > > > > >cc: address@hidden (Celia Chen)
> > > > > > > > > >From: Celia Chen <address@hidden>
> > > > > > > > > >Subject: Re: RAP IIDA Icing (fwd)
> > > > > > > > > >Organization: UCAR/Unidata
> > > > > > > > > >Keywords: 200204251739.g3PHdFa00107
> > > > > > > > > 
> > > > > > > > > Dear Support,
> > > > > > > > > 
> > > > > > > > > We are using the LDM to send the Icing product to FSL and 
> > > > > > > > > having
> > > > > > > > > missing data problems recently.  I noticed the following from 
> > > > > > > > > this
> > > > > > > > > morning's ldmd.log:
> > > > > > > > > 
> > > > > > > > > Apr 25 15:42:32 front gobbo[2448]: Connection from 
> > > > > > > > > gobbo.fsl.noaa.gov
> > > > > > > > > Apr 25 15:42:36 front gobbo[2448]: Connection reset by peer
> > > > > > > > > Apr 25 15:42:36 front gobbo[2448]: Exiting  
> > > > > > > > > 
> > > > > > > > > and
> > > > > > > > > 
> > > > > > > > > Apr 25 15:48:46 front gobbo(feed)[384]: 
> > > > > > > > > nullproc(gobbo.fsl.noaa.gov): RPC: Timed out
> > > > > > > > > Apr 25 15:48:46 front gobbo(feed)[384]: Exiting
> > > > > > > > > 
> > > > > > > > > 
> > > > > > > > > Please tell me what these messages mean and are they the 
> > > > > > > > > reasons that FSL
> > > > > > > > > didn't get the feed?
> > > > > > > > > 
> > > > > > > > > Thanks in advance.
> > > > > > > > > 
> > > > > > > > > Celia
> > > > > > > > > 
> > > > > > > > > > 
> > > > > > > > > > On Thu, 2002-04-25 at 15:39, Jonathan Auerbach wrote:
> > > > > > > > > > > RAP IIDA Icing last received at 04/25/02 12:18Z. Uptime 
> > > > > > > > > > > unknown.
> > > > > > > > > > >  
> > > > > > > > > > 
> > > > > > > > > > Celia/Frank,
> > > > > > > > > > 
> > > > > > > > > > We are still getting rather inconsistent delivery of IDDA 
> > > > > > > > > > icing
> > > > > > > > > > products. Here's our local dir listing:
> > > > > > > > > > 
> > > > > > > > > > /public/data/grids/ruc2/40km_fsl-conus_icing/iida/ascii/*
> > > > > > > > > > Expected frequency: 1.0 hour
> > > > > > > > > > 
> > > > > > > > > > Modify Time           Size        Filename
> > > > > > > > > > 
> > > > > > > > > > 
> > > > > > > > > > 04/24/02 17:19      11329832      2002042417
> > > > > > > > > > 04/24/02 18:18      11329832      2002042418
> > > > > > > > > > * Have a gap... deltaT = 300 min   #missed = 4
> > > > > > > > > > 
> > > > > > > > > > 04/24/02 23:18      11329832      2002042423
> > > > > > > > > > 04/25/02 00:18      11329832      2002042500
> > > > > > > > > > 04/25/02 01:18      11329832      2002042501
> > > > > > > > > > * Have a gap... deltaT = 420 min   #missed = 6
> > > > > > > > > > 
> > > > > > > > > > 04/25/02 08:18      11329832      2002042508
> > > > > > > > > > 04/25/02 09:18      11329832      2002042509
> > > > > > > > > > * Have a gap... deltaT = 180 min   #missed = 2
> > > > > > > > > > 
> > > > > > > > > > 04/25/02 12:18      11329832      2002042512
> > > > > > > > > > 
> > > > > > > > > > 
> > > > > > > > > > The NCAR web page shows 15z has been produced but we are 
> > > > > > > > > > not showing
> > > > > > > > > > notifications coming from front via ldm since delivery of 
> > > > > > > > > > the 12z file.
> > > > > > > > > > 
> > > > > > > > > 
> > > > > > > > > 
> > > > > > > > > ------- End of Forwarded Message
> > > > > > > > > 
> > > > > > > > > 
> > > > > > > > 
> > > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > > -- 
> > > > > > > Celia Chen
> > > > > > > RAP/NCAR
> > > > > > > 
> > > > > > > "Nothing is as strong as gentleness or as gentle as strength."
> > > > > > >                                   - Dove Milk Promises
> > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > 
> > > > > > 
> > > > > > -- 
> > > > > > Celia Chen
> > > > > > RAP/NCAR
> > > > > > 
> > > > > > "Nothing is as strong as gentleness or as gentle as strength."
> > > > > >                                     - Dove Milk Promises
> > > > > > 
> > > > > > 
> > > > > > 
> > > > > 
> > > > > 
> > > > > -- 
> > > > > Celia Chen
> > > > > RAP/NCAR
> > > > > 
> > > > > "Nothing is as strong as gentleness or as gentle as strength."
> > > > >                                       - Dove Milk Promises
> > > > > 
> > > > > 
> > > > > 
> > > > 
> > > > 
> > > 
> > > 
> > > -- 
> > > Celia Chen
> > > RAP/NCAR
> > > 
> > > "Nothing is as strong as gentleness or as gentle as strength."
> > >                                   - Dove Milk Promises
> > > 
> > > 
> > > 
> > 
> > 
> 
> 
> -- 
> Celia Chen
> RAP/NCAR
> 
> "Nothing is as strong as gentleness or as gentle as strength."
>                                       - Dove Milk Promises
> 
> 
>