Introduction
The program CHECK performs consistency checks on the data in the database. To check the data of a certain day the observations from 18 UTC of the previous day until 12 UTC of the next day are needed. Consequently, CHECK can only be used after the data of the next day are added to the database with the program EXDEC. Only the data of the stations which will be part of the database (i.e. the stations marked with S) are subjected to the consistency checks. The values of the following observation elements are checked: air temperature, dew-point temperature, pressure at sea level, wind speed, amount of precipitation, amount of CL clouds (or CM clouds if no CL clouds are present) and duration of sunshine. Obvious errors in the observations are automatically corrected and a message is written to the log file REALDATA:CHECK.LOG. Other possible errors are also written to this log file. These latter messages can be read by the OBSCON program, which also offers an operator the possiblity of modifying the data. After the observations of a station are checked (and if necessary corrected) the derived parameters are recalculated and the data are written back to the database DECODED.
Air temperature, maximum temperature and minimum temperature
The minimum temperature TnTnTn is first checked on possible sign errors using the observed air temperatures between 18 and 6 UTC. When (a) the minimum value of the observed air temperatures is positive while TnTnTn is negative, (b) the difference between these two values is more than 4°C, and (c) -TnTnTn is less than the minimum value of the observed air temperatures, the minus sign of TnTnTn is changed in a plus sign. In case the maximum value of the observed air temperatures between 18 and 6 UTC is less than 0°C while TnTnTn is positive, the plus sign of TnTnTn is changed in a minus sign. Next the value of TnTnTn is checked by comparing it with the air temperatures between 18 and 6 UTC. When there are two or more values of TTT below the minimum temperature the value of TnTnTn is changed to NOT DEFINED ('/'). In case only one observation of TTT is below the minimum temperature the value of TnTnTn is changed to this value when the difference is less than 0.5°C. For differences of 0.5°C or more an error message is written to the log file.
Similarly, the maximum temperature TxTxTx is compared with the observed air temperatures between 6 and 18 UTC. The value of TxTxTx is changed to NOT DEFINED when there are two or more values of TTT which exceed the observed maximum temperature. In case only one value of air temperature is higher than the maximum temperature and the difference is less than 0.5°C TxTxTx is changed to this value. When the difference is larger an error message is written to the log file.
Finally, the minimum and maximum temperature are compared with the values of air temperature before and near sunrise (three values of TTT) and around high noon (four values of TTT), respectively. When TnTnTn is more than 5°C below all three values of TTT or TxTxTx exceeds all four values of TTT (or three when the fourth observation is not present or not defined) with more than 5°C an error message is written to the log file.
The values of the air temperature TTT between 6 UTC of the day under consideration and 6 UTC of the next day are checked using a temperature curve. This curve is based on the two minimum temperatures and the maximum temperature reported in this period. When one or more of these values are not available they are calculated as follows:
- the minimum temperature TnTnTn is set at a value of 1°C below the air temperature TTT which is observed at the observation time closest to the time of sunrise plus half an hour. When this value is not available TnTnTn is set at 1°C below the value observed three hours earlier. Furthermore, TnTnTn must be lower than all values of TTT between 18 and 6 UTC and if necessary the value of TnTnTn is changed to the lowest observed value. In case both values of TTT near sunrise are not available the minimum temperature is set at NOT DEFINED;
- the maximum temperature TxTxTx is set at 1°C above the air temperature TTT which is observed at the observation time closest to the time of high noon plus two hours. When this value is not available TxTxTx is set at 2°C above the value of TTT observed three hours later. Furthermore, TxTxTx must exceed all values of TTT between 6 and 18 UTC and if necessary the value of TxTxTx is changed to the highest observed value. In case both values of TTT near high noon plus two hours are not available the maximum temperature is set at NOT DEFINED.
Note that the computed values of TnTnTn and TxTxTx are only used for the construction of the temperature curve, but are not stored in the database. The temperature curve is only constructed when values for both minimum temperatures and the maximum temperature could be determined (i.e. none of these values is NOT DEFINED). From the whole hour closest to the time of sunrise plus half an hour (t 1 ) until the whole hour closest to half way between high noon plus two hours and sunset (t 2 ) a sine function is used:
where TTT(t) is the air temperature at time t (t1 ≤ t ≤ t2) and TnTnTn is the minimum temperature observed at 6 UTC of the day under consideration. An exponential curve is used from time t2 until time t1 + 24 hours (t3):
where t is the observation time (t2 ≤ t ≤ t3) and TnTnTn ' is the minimum temperature observed at 6 UTC of the day after the day under consideration.
The observed values of air temperature TTT are compared with the values obtained from the temperature curve. In case an observed value of TTT deviates more than 10°C from the computed value while the minimum and maximum temperatures were found to be correct or were automatically corrected the value of TTT is changed to NOT DEFINED. When the observed air temperature deviates between 6°C and 10°C from the value obtained from the curve and this difference can not be explained by the presence of heavy showers or thunderstorms (ww-codes above 80) an error message is written to the log file. An error message is also written to the log file when the deviation is more than 6°C and errors were found in the minimum and/or maximum temperature which could not automatically be corrected.
Dew-point temperature
The dew-point temperature TdTdTd is first compared with the dew-point temperatures at the same station observed three hours before and three hours later. When the difference with both of these values is more than 8°C and the difference between these two values is less than 8°C TdTdTd is changed to NOT DEFINED ('/'). In case one of the neighbouring observations of dew-point temperature is missing and the difference of the observation with the only other neighbouring observation present is more than 8°C an error message is written to the log file. Furthermore, the dew-point temperature is compared with the air temperature at the same time: TdTdTd must be less than or equal to TTT. When TdTdTd exceeds TTT with less than 0.3°C TdTdTd changed to the value of TTT. For differences of 0.3°C or more an error message is written to the log file.
Amount of CL clouds (or CM clouds if no CL clouds present)
The program checks whether the amount of CL clouds (or CM clouds if no CL clouds are present) Nh is less than or equal to the total cloud cover N. When this is not the case the value of Nh is changed to the value of N.
Amount of precipitation
First the program checks whether the amount of precipitation RRR reported for the six hour period (i.e. tR = 6) is equal to the amount reported for the twelve hour period (tR = 12). When the reported amounts are equal no further checking is done, because it is unlikely that the same mistake is made twice. An exception is made for precipitation amounts above 30 millimetres: these amounts must always be checked manually using OBSCON and therefore an error message is written to the log file. In all other cases the observed weather conditions (i.e. ww, W1 and W2 ) are used for some more checks. If there has only been fog in the period tR and no other source of precipitation (i.e. all ww-codes present are between 40 and 49 and all W1 -codes are less than or equal to 4) no more than 1 millimetre of precipitation is allowed. When RRR exceeds this value an error message is written to the log file. In table III.1 relative precipitation intensities are given for all values of ww, W1 and W2 , which are used when fog is not a source of precipitation or not the only source in the period tR .
Table III.1. Relative precipitation intensities associated with ww, W1 and W2.
| |
|
0 |
1 |
2 |
3 |
4 |
5 |
6 |
7 |
8 |
9 |
| ww |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
| |
10 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
1 |
0 |
0 |
| |
20 |
1 |
1 |
1 |
1 |
1 |
1 |
1 |
1 |
0 |
1 |
| |
30 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
| |
40 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
| |
50 |
1 |
1 |
1 |
1 |
2 |
2 |
1 |
1 |
1 |
1 |
| |
60 |
1 |
1 |
1 |
2 |
3 |
3 |
1 |
2 |
1 |
2 |
| |
70 |
1 |
1 |
1 |
2 |
2 |
3 |
1 |
1 |
1 |
1 |
| |
80 |
1 |
2 |
4 |
1 |
2 |
1 |
2 |
2 |
2 |
3 |
| |
90 |
2 |
2 |
2 |
4 |
4 |
4 |
4 |
4 |
4 |
4 |
| W1 |
|
0 |
0 |
0 |
0 |
0 |
1 |
1 |
1 |
3 |
4 |
| W2 |
|
0 |
0 |
0 |
0 |
0 |
1 |
1 |
1 |
3 |
4 |
For every observation of a station in the period tR for which at least the present weather ww or the past weather W1 is available the total precipitation intensity is found by adding the intensities corresponding with ww, W1 and W2. Furthermore, the maximum intensity is determined from ww, W1 or W2. When ww and W1 are not observed or NOT DEFINED ('/') the total intensity is set at 1 for that particular observation, while the maximum intensity remains 0. Next the total intensities of all observations of a station in the period tR are added to give the overall intensity and the maximum intensity during this period is determined. The amount of precipitation reported is allowed when one of the following criteria is met:
- the overall intensity is 8 or more for amounts between 20 and 30 millimetres
- the overall intensity is 7 or more for amounts between 15 and 20 millimetres
- the overall intensity is 6 or more for amounts between 10 and 15 millimetres
- the overall intensity is 5 or more for amounts between 8 and 10 millimetres
- the overall inentsity is 4 or more for amounts between 6 and 8 millimetres
- the overall intensity is 3 or more for amounts between 4 and 6 millimetres
- the overall intensity is 2 or more for amounts between 3 and 4 millimetres
- the overall intensity is 1 or more for amounts between 1 and 3 millimetres
- the maximum intensity is 4 for amounts between 20 and 30 millimetres
- the maximum intensity is 3 or more for amounts between 8 and 20 millimetres
- the maximum intensity is 2 or more for amounts between 3 and 8 millimetres
- the maximum intensity is 1 or more for amounts between 1 and 3 millimetres
- the amount of precipitation is less than 1 millimetre
When the observed value of RRR is does not correspond to the precipitation intensity or when the amount of precipitation exceeds 30 millimetres an error message is written to the log file.
Finally, the program compares the amount of precipitation observed in the six hour period with the amount observed in the twelve hour period: the amount observed in the latter period must be equal to or exceed the amount reported six hours before. If this is not the case an error message is written to the log file.
Pressure at sea level
The value of the pressure at sea level PPPP must lie between 950 hPa and 1060 hPa. When PPPP is less than 950 hPa or more than 1060 hPa the value of PPPP is changed to NOT DEFINED ('/'). Furthermore, the values of the amount of pressure tendency ppp and of the pressure at station level PoPoPoPo are also changed to NOT DEFINED. If the pressure at sea level is between 950 and 1060 hPa the pressure tendency ppp is checked: when the absolute value of ppp exceeds 15 hPa per three hours ppp is changed to NOT DEFINED. Since it is very likely that there are also errors in the pressure at sea level and the pressure at station level, the values of PPPP and PoPoPoPo are also changed to NOT DEFINED. Finally, if the pressure at sea level is between 950 and 1060 hPa and the pressure tendency is less than 15 hPa per three hours, PPPP is compared with the observation of three hours before. When the difference between the PPPP of three hours before and the PPPP under consideration exceeds the pressure tendency ppp more than 2 hPa the values of PPPP, PoPoPoPo and ppp are changed to NOT DEFINED.
Wind speed
The observed wind speed ff is compared with the observed value of three hours before at the same station. The program checks on an increase in ff of more than 20 knots. Such an increase is only allowed if (a) heavy showers or thunderstorms are coded in the observation (i.e. ww-codes above 80), (b) the pressure tendency is more than 3 hPa per three hours or (c) the difference in wind speed with the observation of three hours later is less than 20 knots. However, when the increase in wind speed exceeds 40 knots the value of ff is changed to NOT DEFINED ('/'). In all other cases (i.e. increases between 20 and 40 knots which can not be explained) an error message is written to the log file. In case the wind speed of three hours before is not known ff is only checked on its value: when the wind speed is higher than 80 knots an error message is written to the log file.
Duration of sunshine
The program checks whether the observed duration of sunshine 55j2j3j4 exceeds the calculated time between sunrise and sunset. When the observed sunshine duration is more than 25% longer than this computed day length the sunshine duration is set at NOT DEFINED ('/'). In all other cases an error message is written to the log file.
Messages
The messages generated by the CHECK program are written to the file REALDATA:CHECK.LOG. In table III.2 the possible messages are described. Note the difference between %I-messages (information) and %E-messages (errors).
Table III.2. Description of the messages generated by the CHECK program.
| Message |
Description |
% I-Check TN : - sign Date : <DTG> No : <NO> TN_old : <TNOLD> TT_min : <TTMIN> TN_new : <TNNEW> |
Sign error in minimum temperature: minus sign is automatically changed to plus sign |
% I-Check TN : + sign Date : <DTG> No : <NO> TN_old : <TNOLD> TT_min : <TTMIN> TN_new : <TNNEW> |
Sign error in minimum temperature: plus sign is automatically changed to minus sign |
% I-Check TN : TN > TT Date : <DTG> No : <NO> TN : <TN> TT_min : <TTMIN> |
Air temperatures below minimum temperature: minimum temperature changed to '/' ( ³ two observations below minimum temperature) or to air temperature (one observation below minimum and difference < 0.5 ° C) |
% E-Check TN : TN > TT Date : <DTG> No : <NO> TN : <TN> TT_min : <TTMIN> |
One observation of air temperature below minimum temperature and difference ³ 0.5 ° C |
% I-Check TN : TN < TT06 Date : <DTG> No : <NO> TN : <TN> TT06 : <TT06> |
Temperature of 6 GMT is less than minimum temperature: minimum temperature is automatically changed to 6 GMT temperature |
% I-Check TX : TX < TT Date : <DTG> No : <NO> TX : <TX> TT_max : <TTMAX> |
Air temperatures above maximum temperature: maximum temperature changed to '/' ( ³ two observations above maximum temperature) or to air temperature (one observation above maximum and difference < 0.5 ° C) |
% E-Check TX : TX < TT Date : <DTG> No : <NO> TX : <TX> TT_max : <TTMAX> |
One observation of air temperature above maximum temperature and difference ³ 0.5 ° C |
% I-Check TX : TX06 --> TX18 Date : <DTG> No : <NO> TX : <TX> |
Maximum temperature reported in 6 UTC observation copied to 18 UTC observation of previous day |
% E-Check TN : sunrise Date : <DTG> No : <NO> TN : <TN> TT : <TT> TT-3 : <TT-3> |
Minimum temperature more than 5 ° C lower than air temperatures before and near sunrise |
% E-Check TX : high noon Date : <DTG> No : <NO> TX : <TX> TT : <TT> TT-3 : <TT-3> |
Maximum temperature more than 5 ° C higher than air temperatures around high noon |
%I-Check TT: curve Date : <DTG> No : <NO> TT_obs : <TTOBS> TT_cur : <TTCUR> TT_dif : <TTDIF> |
Observed air temperature deviates more than 10 ° C from temperature curve while minimum and maximum temperature are correct or automatically corrected: air temperature automatically changed to '/' |
%E-Check TT: curve Date : <DTG> No : <NO> TT_obs : <TTOBS> TT_cur : <TTCUR> TT_dif : <TTDIF> |
Observed air temperature differs 6 ° C-10 ° C from temperature curve and ww < 80 or observed temperature deviates more than 6 ° C from the curve while not automatically corrected errors were detected in minimum and/or maximum temperature |
%I-Check TD: jump Date : <DTG> No : <NO> TD-3 : <TD-3> TD : <TD> TD+3 : <TD+3> |
Dew-point temperature deviates more than 8 ° C from dew-point temperature three hours before and three hours later while these values differ less than 8 ° C: dew-point temperature automatically changed to '/' |
%E-Check TD: jump Date : <DTG> No : <NO> TD-3 : <TD-3> TD : <TD> |
Dew-point temperature differs more than 8 ° C from dew-point temperature three hours before |
%E-Check TD: jump Date : <DTG> No : <NO> TD : <TD> TD+3 : <TD+3> |
Dew-point temperature differs more than 8 ° C from dew-point temperature three hours later |
%I-Check TD: TD > TT Date : <DTG> No : <NO> TD : <TD> TT : <TT> |
Dew-point temperature exceeds air temperature with less than 0.3 ° C: dew-point temperature automatically changed to air temperature |
%E-Check TD: TD > TT Date : <DTG> No : <NO> TD : <TD> TT : <TT> |
Dew-point temperature exceeds air temperature with more than 0.3 ° C |
%I-Check FF: 40 Date : <DTG> No : <NO> FF-3 : <FF-3> FF : <FF> |
Wind speed increased more than 40 knots compared to three hours before: wind speed changed automatically to '/' |
%E-Check FF: 20 Date : <DTG> No : <NO> FF-3 : <FF-3> FF : <FF> |
Wind speed increased between 20 and 40 knots and this increase could not be explained with other observed elements |
%E-Check FF: 80 Date : <DTG> No : <NO> FF : <VALUE> |
Wind speed is higher than 80 knots |
% I-Check NH : NH > N Date : <DTG> No : <NO> N : <N> NH : <NH> |
Amount of C L (or C M ) clouds exceeds total cloud cover: value changed automatically to value of total cloud cover |
%E-Check RRR: fog Date : <DTG> No : <NO> TR : <TR> RRR : <RRR> |
Fog is only source of precipitation in period tR and the precipitation amount is more than 1 millimetre |
%I-Check RRR: 50 Date : <DTG> No : <NO> RRR-6 : <RRR-6> RRR : <RRR> |
Amount of precipitation of six hours ago exceeds current amount of precipitation by more than 50 millimeteres: value of six hours ago is automatically changed to '/' |
%E-Check RRR: WW Date : <DTG> No : <NO> TR : <TR> RRR : <RRR> IWmax : <IWMAX> IWtot : <IWTOT> |
Amount of precipitation does not correspond to precipitation intensity or is more than 30 millimetres |
%E-Check RRR: -6 Date : <DTG> No : <NO> RRR-6 : <RRR-6> RRR : <RRR> |
Amount of precipitation observed in six hour period exceeds the amount observed in the whole period of twelve hours |
%I-Check PPP: Date : <DTG> No : <NO> PPP : <VALUE> |
Pressure at sea level is less than 950 hPa or more than 1060 hPa: values of pressure at sea level, pressure at station level and pressure tendency changed to '/' |
%I-Check APP: Date : <DTG> No : <NO> APP : <VALUE> |
Pressure tendency exceeds 15 hPa per three hours: values of pressure at sea level, pressure at station level and pressure tendency changed to '/' |
%I-Check PPP: app Date : <DTG> No : <NO> PPP-3 : <PPP-3> APP : <APP> PPP : <PPP> |
Difference between pressure at sea level with value of three hours before exceeds pressure tendency with more than 2 hPa: values of pressure at sea level, pressure at station level and pressure tendency changed to '/' |
%I-Check SUN: > 25% Date : <DTG> No : <NO> SUN : <SUN> DAYL : <DAYL> |
Observed sunshine duration exceeds the calculated day length with more than 25%: the sunshine duration is automatically changed to '/' |
%E-Check SUN: < 25% Date : <DTG> No : <NO> SUN : <SUN> DAYL : <DAYL> |
Observed sunshine duration exceeds the calculated day length less than 25% |
|