RE: 20001002: pqing in ldm 5.1.2

On Mon, 2 Oct 2000, Rodger R. Getz wrote:

> Robb-
> 
> ldm 5.1.2 uses the new queue structure, so it must be different than
> previous versions. We tried to use 5.0.9 and it complains about the queue.
> Prior to 5.1.2 when we would run a file through the ldm with pqing it would
> indicate "STARTING UP" in the logs and end with the summary info saying that
> it processed so many products and other stats. We are not seeing the summary
> info with 5.1.2. Another weird behavior is that we have seen some nulls and
> other control characters (SO and SIs) in surface collectives downloaded from
> FSU and UCAR. pqing has choked on files with these control characters. Have
> you tried to run a large surface collective file with pqing to verify that
> the entire file is being processed?
> 
> Rodger


Rodger,

I was talking about the functionality of pqing, not the internals.  Sure
the queue structures are different so one can't use the 5.1.2 pqing on an 
older release, like mixing apples and oranges.  I just
did a test on a surface raw file. 2000100312_sao.wmo   It seemed to work
fine,  output included.


I haven't downloaded any surface files from FSU or UCAR so I don't know
how the nulls are processed. The nulls could possibly cause a problem but
don't have time now to test as I have jury duty in 10 minutes. Maybe you
could shed so light on the problem.

Robb...


% pqing -vl sao.log ~rkambic/sao.wmo > /dev/null

% more sao.log

Oct 03 13:59:37 pqing[4721]: Starting Up
Oct 03 13:59:37 pqing[4721]: FILE "/home/rkambic/sao.wmo"
Oct 03 13:59:37 pqing[4721]: Creating AFOS-like pil tags
Oct 03 13:59:37 pqing[4721]:       97 20001003135937.556     WMO 893
SAUS70 KWB
C 031200 /pMETAR
Oct 03 13:59:37 pqing[4721]:      102 20001003135937.975     WMO 577
SAUS70 KWB
C 031200 /pMETAR
Oct 03 13:59:38 pqing[4721]:      136 20001003135938.139     WMO 749
SAUS80 KWB
C 031200 /pMETAR
Oct 03 13:59:38 pqing[4721]:      130 20001003135938.276     WMO 209
SAUS80 KWB
C 031200 /pMETAR
Oct 03 13:59:38 pqing[4721]:      106 20001003135938.370     WMO 219
SAFJ31 NFN
A 031200
Oct 03 13:59:38 pqing[4721]:       89 20001003135938.457     WMO 832
SAUS70 KWB
C 031200 /pMETAR
Oct 03 13:59:38 pqing[4721]:      147 20001003135938.497     WMO 838
SAUS80 KWB
C 031200 /pMETAR  

....

Oct 03 13:59:40 pqing[4721]:     1212 20001003135940.224     WMO 895
SAXX60 KWB
C 031200 /pMETAR
Oct 03 13:59:40 pqing[4721]:      157 20001003135940.225     WMO 918
SAUS46 KSE
/local/ldm% tail sao.log
Oct 03 13:59:45 pqing[4721]:      379 20001003135945.092     WMO 983
SAEN31 KWB
C 031220 RRF /pMETAR
Oct 03 13:59:45 pqing[4721]: Exiting
Oct 03 13:59:45 pqing[4721]:   Queue usage (bytes):100007936
Oct 03 13:59:45 pqing[4721]:            (nregions):   24408
Oct 03 13:59:45 pqing[4721]:   Duplicates rejected:       0
Oct 03 13:59:45 pqing[4721]:   WMO Messages seen:      2170
Oct 03 13:59:45 pqing[4721]:   SOH/ETX missing  :         0
Oct 03 13:59:45 pqing[4721]:   parity/chksum err:         0
Oct 03 13:59:45 pqing[4721]:   WMO format errors:         0
Oct 03 13:59:45 pqing[4721]:   FILE Bytes read:      701713  





> 
> > -----Original Message-----
> > From: Robb Kambic [mailto:address@hidden]
> > Sent: Monday, October 02, 2000 3:45 PM
> > To: Rodger R. Getz
> > Cc: support-ldm
> > Subject: Re: 20001002: pqing in ldm 5.1.2
> >
> >
> > On Mon, 2 Oct 2000, Unidata Support wrote:
> >
> > >
> > > ------- Forwarded Message
> > >
> > > >To: <address@hidden>
> > > >From: address@hidden (Rodger R. Getz)
> > > >Subject: pqing in ldm 5.1.2
> > > >Organization: UCAR/Unidata
> > > >Keywords: 200010021659.e92Gxhb04575
> > >
> > > We lost (along with the rest of the world) all Alden feeds
> > during the night.
> > > We will be installing a NOAAPort system from Planetary Data Systems
> > > tomorrow! In the meantime, we have been trying to process product
> > > collectives (metars, synoptics, etc) that we have obtained by
> > ftp. Prior to
> > > ldm 5.1.2, we processed these files with pqing with no problem.
> > Has there
> > > been any changes to pqing which would prevent the processing of
> > an hour's
> > > worth of surface data from a file?
> >
> > Rodger,
> >
> > The basic function of pqing has not changed at all. The only change was
> > the -5 flag to eliminate the sequence number from the product checksum. So
> > I believe pqing should work fine.
> >
> > Robb...
> >
> >
> > >
> > > Rodger R. Getz, President and CEO
> > > AWIS Weather Services, Inc.
> > > 1735 East University Drive, Suite 101
> > > P.O. Box 3267
> > > Auburn, AL      36831-3267         http://www.awis.com
> > > ph: (334) 826-2149 ext 104 (voice)  (334) 826-2152 (FAX) 
> > >
> > >
> > > ------- End of Forwarded Message
> > >
> >
> > ==================================================================
> > =============
> > Robb Kambic                            Unidata Program Center
> > Software Engineer III                          Univ. Corp for
> > Atmospheric Research
> > address@hidden                 WWW: http://www.unidata.ucar.edu/
> > ==================================================================
> > =============
> >
> 

===============================================================================
Robb Kambic                                Unidata Program Center
Software Engineer III                      Univ. Corp for Atmospheric Research
address@hidden             WWW: http://www.unidata.ucar.edu/
===============================================================================