Re: 20010605: problem ingesting Unidata-Wisconsin images at UCR

Unidata Support wrote:
> 
> ------- Forwarded Message
> 
> >From: =?X-UNKNOWN?Q?Jimmy_Mejia_Fern=E1ndez?= <address@hidden>
> >Organization: University of Costa Rica
> >Keywords: 200106050208.f5528Sp02926 LDM ingest decode
> 
> Hello:
>         Since some time ago I have noticed that I am receiving less and
> less data till 2 weeks ago that I am receiving nothing, we here at the
> University of Costa Rica had some problems with chines  crackers that
> abused our servers, we made more restrictive de firewall and for that
> reason I though that we was having problems  getting the images. But in
> the last days I moved the ldm machine to outside the firewall and the
> problems are still there. Nothing has been changed with the configuration
> and the machine have a fresh installation so I do not think that the
> machine is hacked.
> The output if  the command:
> $pqcat -vl - -f MCIDAS > /dev/null   is
> Jun 05 01:57:19 pqcat: Starting Up (10614)
> Jun 05 01:57:19 pqcat:     6080 20010604120548.044  MCIDAS 000  pnga2area
> Q1 U3 205 GRAPHICS UNKBAND 5km 20010604 1159
> Jun 05 01:57:19 pqcat:   141320 20010604121047.822  MCIDAS 000  pnga2area
> Q1 U1 191 GOES-9_IMG UNKBAND 20km 20010604 0900
> Jun 05 01:57:19 pqcat:   120696 20010604121510.409  MCIDAS 000  pnga2area
> Q0 CA 1100 GOES-10_SND UNKBAND 14km 20010604 1100
> 
> .........
> 
> Jun 05 02:05:13 pqcat:    46376 20010605005009.108  MCIDAS 000  pnga2area
> Q0 CF 1150 GOES-10_SND UNKBAND 20km 20010604 2300
> Jun 05 02:05:13 pqcat:     9167 20010605010539.409  MCIDAS 000  pnga2area
> Q1 U3 200 GRAPHICS UNKBAND 5km 20010604 2259
> Jun 05 02:05:13 pqcat: Exiting
> Jun 05 02:05:13 pqcat: Number of products 52
> 
> And the output of the command:
> $pqcat -vl - -f HRS -p "^[YZ].[QRUT].*/mETA" > /dev/null   is:
> Jun 05 02:06:18 pqcat: Starting Up (10670)
> Jun 05 02:06:21 pqcat:     2050 20010604140604.198     HDS 459  YHTB99
> KWBE 041200 /mETA_84
> Jun 05 02:06:21 pqcat:     1620 20010604140604.201     HDS 460  YVTB95
> KWBE 041200 /mETA_84
> Jun 05 02:06:21 pqcat:     1834 20010604140604.204     HDS 461  YXTB98
> KWBE 041200 /mETA_84
> Jun 05 02:06:21 pqcat:     1620 20010604140604.207     HDS 462  YRTB99
> KWBE 041200 /mETA_84
> 
>  ...............
> 
> Jun 05 02:06:22 pqcat:    23994 20010604193805.904     HDS 014  ZTRB35
> KWBE 041800 /mETA_84
> Jun 05 02:06:22 pqcat:    26978 20010604194022.920     HDS 995  YTRC93
> KWBE 041800 /mETA_84
> Jun 05 02:06:22 pqcat: Exiting
> Jun 05 02:06:22 pqcat: Number of products 132
> 
> So, it look like if all is OK but I receive nothing on the data's
> directory.
> 
> Is something changed on the LDM server on UNIDATA?
> 
> Thank You very much,
>                         JImmy
> 
> ------- End of Forwarded Message

Hi Jimmy,

If you think that you're getting all the data into your queue that
you're requesting, then the problem is not with your server (which is
your upstream host, probably not a machine here at Unidata), but rather
with pqact on your own machine.

Are any problems indicated in the log?  Are you sure pqact is running? 
Have you run out of space on your disk?  Are the permissions set
properly on the data directories so the LDM can write to them?  Have any
paths in the data directory changed?  

A good test is to put pqact in debug mode.  To do this, find pqact's PID
(the command 'ps -ef | grep pqact' will give you this), then give the
command:
        kill -USR2 <pqactPID>
This will cause more information to go to the log.  pqact has three
modes: quiet, verbose, and debug.  Sending it the USR2 signal will cause
it to cycle through these modes.  Debug is *very* verbose - it will
quickly take up a lot of space.  A little bit is probably sufficient to
see if there's a problem or not, so you probably don't want to leave it
in that mode too long.

Try these things and let me know what you find.

Anne
-- 
***************************************************
Anne Wilson                     UCAR Unidata Program            
address@hidden                 P.O. Box 3000
                                  Boulder, CO  80307
----------------------------------------------------
Unidata WWW server       http://www.unidata.ucar.edu/
****************************************************