[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[AWIPS #PKL-603844]: AWIPS2 Sever Overload

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [AWIPS #PKL-603844]: AWIPS2 Sever Overload
  • Date: Thu, 21 Jul 2016 10:59:30 -0600
> Hey Michael,
> 
> Logged in this morning and saw the top output below. Rebooted system.
> 
> Any idea what's going on?


I'm not sure, this is the first I've seen this problem.  I would guess it's 
related to the very old data files which are curiously still on your system.

find /awips2/edex/data/hdf5 -type f -printf '%T+ %p\n' | sort | more

2016-01-27+17:55:08.7508680450 
/awips2/edex/data/hdf5/grid/RAP40/MAXW/RAP40-2016-01-27-21-FH-012.h5
2016-01-27+17:55:08.7968689350 
/awips2/edex/data/hdf5/grid/RAP40/FRZ/RAP40-2016-01-27-21-FH-012.h5
...
2016-01-27+18:13:37.4832765460 
/awips2/edex/data/hdf5/gfe/OAX/GFS80/2016_01_27_1800/OAX_GRID__GFS80_20160127_1800_QPF_SFC.h5
2016-01-27+18:13:37.6042788800 
/awips2/edex/data/hdf5/gfe/OAX/GFS80/2016_01_27_1800/OAX_GRID__GFS80_20160127_1800_CWR_SFC.h5
...

for example look at the RAP40:

ls -la /awips2/edex/data/hdf5/grid/RAP40/CBL/|more
drwxr-xr-x  2 awips fxalpha  8192 Jul 21 12:08 .
drwxr-xr-x 21 awips fxalpha  4096 Jun  3 08:23 ..
-rw-r--r--  1 awips fxalpha 47339 Jan 27 17:50 RAP40-2016-01-27-21-FH-003.h5
-rw-r--r--  1 awips fxalpha 46521 Jan 27 17:52 RAP40-2016-01-27-21-FH-006.h5
-rw-r--r--  1 awips fxalpha 46817 Jan 27 17:54 RAP40-2016-01-27-21-FH-009.h5
-rw-r--r--  1 awips fxalpha 47194 Jan 27 17:55 RAP40-2016-01-27-21-FH-012.h5
-rw-r--r--  1 awips fxalpha 47751 Jul 18 04:57 RAP40-2016-07-18-08-FH-011.h5
-rw-r--r--  1 awips fxalpha 45434 Jul 18 05:05 RAP40-2016-07-18-08-FH-018.h5

The July 18 files *should* be the oldest on your system, anything older should 
be scoured, but apparently that's not working for certain products.   I don't 
know why. 

The h5repack process is run by the python package pypies/impl/H5pyDataStore.py 
but I can't determine for what purpose it's running with these processes or why 
they hung for so long. 

I restarted EDEX and we should watch to see if this happens again.  Sorry I 
don't have more for you. 




Ticket Details
===================
Ticket ID: PKL-603844
Department: Support AWIPS
Priority: Normal
Status: Open
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.