20010427: Data feed to UCR (cont.)

>From: =?X-UNKNOWN?Q?Jimmy_Mejia_Fern=E1ndez?= <address@hidden>
>Organization: UCR
>Keywords: 200104170329.f3H3T4L28470 IDD MCIDAS

Jimmy,

re: notifyme to thelma works
>Yes, I know I am allowed to connect to thelma from inti and from titan (a
>machine that finally I coud not make to work, I need to replace the SCSI
>controler)

re: using pqutil to watch for arriving products
>Ujum, this 2 days I has been reading the manuals pages they have more info
>than the "unidata LDM5 site managers guide" :)

re: pqcat -vl - -f MCIDAS > /dev/null
>I did it I got a beautiful output, may be is because since 2 days ago we
>changed to a bigger bandwith, a T1

This would help a lot!

>here is an extraction of the output:
>[ldm@inti data]$  pqcat -vl - -f MCIDAS > /dev/null
>Apr 28 02:10:50 pqcat: Starting Up (13868)
>Apr 28 02:10:50 pqcat:    62080 20010427134912.146  MCIDAS 000  pnga2area
>Q0 CE 1140 GOES-10_SND UNKBAND 14km 20010427 1200
>Apr 28 02:10:50 pqcat:     3756 20010427140529.360  MCIDAS 000  pnga2area
>Q1 U3 201 GRAPHICS UNKBAND 5km 20010427 1359
>Apr 28 02:10:50 pqcat:   144826 20010427161627.260  MCIDAS 000  pnga2area
>Q1 UB 171 GOES-10_IMG 6.8um 8km 20010427 1600
>Apr 28 02:10:50 pqcat:   303931 20010427173151.463  MCIDAS 000  pnga2area
>Q1 UA 161 GOES-8_IMG 0.65um 1km 20010427 1715
>Apr 28 02:10:50 pqcat:    71415 20010427174808.087  MCIDAS 000  pnga2area
>Q0 CD 1130 GOES-10_SND UNKBAND 14km 20010427 1600
>Apr 28 02:10:50 pqcat:   164050 20010427181624.962  MCIDAS 000  pnga2area
>Q1 UB 172 GOES-10_IMG 6.8um 8km 20010427 1800
>........ 

Excellent.  This shows that you are getting the Unidata-Wisconsin imagery.

re: pqcat -vl - -f HRS -p "^[YZ].[QRUT].*/mETA" > /dev/null
>Again here is a short output of the above command:
>
>[ldm@inti data]$ pqcat -vl - -f HRS -p "^[YZ].[QRUT].*/mETA" > /dev/null
>Apr 28 02:12:08 pqcat: Starting Up (13869)
>Apr 28 02:12:08 pqcat:      764 20010427140147.169     HDS 778  YOTA10
>KWBE 271200 /mETA_84
>Apr 28 02:12:08 pqcat:      978 20010427140147.189     HDS 779  YOTA15
>KWBE 271200 /mETA_84
>Apr 28 02:12:08 pqcat:      978 20010427140147.568     HDS 816  YOTA20
>KWBE 271200 /mETA_84
>Apr 28 02:12:08 pqcat:     1192 20010427140147.571     HDS 817  YOTA30
>KWBE 271200 /mETA_84
>Apr 28 02:12:08 pqcat:     1192 20010427140147.575     HDS 818  YOTA25
>KWBE 271200 /mETA_84
>Apr 28 02:12:08 pqcat:     1192 20010427140147.580     HDS 819  YOTA35
>KWBE 271200 /mETA_84
>Apr 28 02:12:08 pqcat:     1406 20010427140147.583     HDS 820  YOTA40
>KWBE 271200 /mETA_84
>Apr 28 02:12:08 pqcat:     1406 20010427140147.587     HDS 821  YOTA80
>KWBE 271200 /mETA_84
>Apr 28 02:12:08 pqcat:     1406 20010427140147.592     HDS 822  YOTA45
>KWBE 271200 /mETA_84

OK, this looks good as well.

>I also  followed the changes that Mr. Yoksas pointed in his last letter,
>posible that also helped (Spliting the requests),

That is a trick that a number of sites have used with great success.
I am glad that it is helping you out as well.

>I see that the 
>/home/ldm/data/mcidas/area directory is being filled with area files, the
>same is hapening with the /home/ldm/data/GRIB directory with the *.avn
>files.

Sounds good.

>A single question, how much hard disk will I need for this two products?
>I commented out the lines:
>
>WMO
>^([^H][A-Z])([A-Z][A-Z])([0-9][0-9]) (....) ([0-3][0-9])([0-2][0-9])
>       FILE    data/\2/\4/\6/\1\3.wmo
>
>form the pqact.conf file, that is because the *.wmo files are filling the
>system, so, for now I do not want this files.

The amount of disk space that you will need depends on how much data you
want to keep.  For instance, your pqact.conf actions file McIDAS imagery
in two different ways:

This action uses the old McIDAS filing convention (circular file naming
and routing table information (if ROUTE.SYS is copied to the output
data directory)).  The number of files that will be saved is, therefore,
fixed.

MCIDAS  ^pnga2area Q. (..) (.*) (.*) (.*) (.*) (........) (....)
        PIPE    -close
        pnga2area -d /home/ldm/data/mcidas/area -r \1,\2

The next two actions file products with names generated from information
in the broadcast header.  The number of these files will continue to
grow over time unless you scour off the old ones.

MCIDAS  ^pnga2area Q. CA .... (.*) (.*) (.*) (........) (....)
        PIPE    -close
        pnga2area /home/ldm/data/gempak/nport/SOUNDER/\3/CTP/CTP_\4_\5
MCIDAS  ^pnga2area Q. CB .... (.*) (.*) (.*) (........) (....)
        PIPE    -close
        pnga2area /home/ldm/data/gempak/nport/SOUNDER/\3/PW/PW_\4_\5

>Next week I will install
>another hard drive in this machine, how big do you recommend for this?

You can _never_ have too much disk for data.  If you plan on keeping a
lot of imagery and gridded data on disk, I would not hesitate to dedicate
several GB for data (say 18 GB).

>Thank you very much for all your help. 

I'm glad to hear that things are now working.

Tom