The data processing and quality control takes place in two phases: an automated phase and a manual phase. Most of the quality control and processing of the near real-time data is carried out in an automated way using specifically developed software. The delayed mode data will have also undergone manual checks whereby a Data Scientist will have performed a visual check; undertaken parameter inter-comparisons; and cross-checked the data against published climatologies. Their findings and actions will have been fully documented.
When defining the near real-time quality control steps, care was taken to follow standards already introduced by other international projects. These include the Argo, the Global Ocean Surface Underway Data (GOSUD), and the Global Temperature and Salinity Profile Project (GTSPP) real-time quality control procedures.
A complete list of the quality control and processing procedures applied to CARBON-OPS data, prior to being loaded in the BODC CARBON-OPS database, is documented below.The items marked with * are planned for version II of the automated software.
Near real-time quality control procedures
Near real-time processing procedures
Action: failed records are not loaded to the database but are diverted to a log file for manual checks.
Action: failed records are loaded into the database but flagged with a suspect 'M' flag by the software pending manual correction.
The check uses successive ship positions to calculate the distance travelled between two data cycles. When the resulting speed exceeds 10 m per second, an alarm message is sent by email to a data scientist who will check the records and manually flag or correct the erroneous value. This check enables the software to detect spikes in the ship’s position or time channels.
The check uses limits for parameters as set up in the BODC parameter dictionary. Checks are carried out on all incoming parameters labelled with a BODC parameter code.
This check has two goals:
The limit and absent data values currently used for each of the input parameters is described in the parameters document (69 KB).
Action (1): input values are replaced by their absent data values as defined in BODC parameter dictionary and the flag value for that parameter record is set to 'N' (null).
Action (2): values outside the minimum and maximum range are left unchanged but the flag value for that parameter record is set to 'M' (suspect).
Checks for spikes will be performed on all temperature channels, and on the salinity, atmospheric pressure, and atmospheric CO2 channels. Planned for version II of the automated software.
Planned for version II of the automated software.
Checks will include two-by-two comparisons of various temperature channels: upper and lower equilibrator temperature values, hull and thermosalinograph, hull and equilibrator, and equilibrator and thermosalinograph. Planned for version II of the automated software.
Checks will look at whether the xCO2 values measured in air and in sea water are within the range of the measured standard values. Planned for version II of the automated software.
The CARBON-OPS data use a combination of the BODC and the International Ocean Carbon Coordination Project (IOCCP) quality control flags.
The following single character qualifying flags may be associated with one or more individual parameters within a data cycle:
Flag | Description |
---|---|
Blank | Unqualified |
< | Below detection limit |
> | In excess of quoted value |
H | Extrapolated value |
L | Improbable value – originator's quality control |
M | Improbable value – BODC quality control |
O | Improbable value – user quality control |
R | Replacement value |
T | Interpolated value |
U | Uncalibrated |
In addition to BODC quality control flags, CARBON-OPS uses the system of sub-flag recommended by IOCCP to provide additional information on questionable measurements. The flag values range from 1 to 10 with the following definitions
The automated quality control procedures currently in place do not use the full range of IOCCP quality control flags. This will be implemented progressively as the project develops.
BODC receives the raw data in the form of comma-separated values (CSV) files generated from the raw pCO2 database held at the Plymouth Marine Laboratory (PML). The raw data consists of eight separate files
The underway p(CO2) analytical cycle is composed of a sequence of analyses comprising an equilibrator air measurement, a marine air measurement, and a gas standard measurement. In addition, the sequence also includes the logging of ancillary and navigation and meteorology data from the ship’s instrumentation.
In the raw data files, each measurement is associated with its own time and position corresponding to the time the measurement was made within the analytical sequence.
Having received and archived the original data, the first task for the automated processing software is to reduce the input data to one data cycle per analytical cycle.
The reduction is based on the equilibrator measurement; its time stamp is used as the time stamp for the entire analytical cycle. The analytical is given a unique cycle identifier and all the other measurements for the same analytical cycle are linked to the equilibrator's time stamp without interpolation.
In the event of a missing equilibrator measurement, the software takes the next available measurement in the rotation to use as the time stamp for the entire cycle.
The calculation of salinity is based on conductivity and the concomitant temperature measurement in the thermosalinograph (TSG) manifold. If either measurement is missing or flagged suspect by the automated quality control then salinity is not derived.
The raw pCO2 measurements from the equilibrator, marine air and the three standards are corrected to dry air based on the formula adapted from DOE (1994) SOP5.
p(CO2)dry, uncal = p(CO2)meas, uncal / (1 – (p(H2O)meas/1000))
where
Corrected values will not be generated if any of the input parameters are missing or have been flagged suspect by the automated quality control.
The raw pCO2 values measured by the LICOR and corrected to dry air (p(CO2)dry, uncal) are calibrated against gas standards held in gas cylinders onboard the ship. Each standard has known CO2 concentrations determined against National Oceanic and Atmospheric Administration (NOAA) standards. There are three standards: a CO2-free gas standard, a standard with a nominal CO2 concentration of 250 ppm and a standard with a nominal CO2 concentration of 450 ppm.
As only one standard is measured during an analytical cycle, the standards are measured alternately, so each is measured every third cycle. Prior to performing the pCO2 calibration it is necessary, in order to have a value for each of the three standards, to interpolate or extrapolate the standard measurements.
Interpolation is carried out between successive measured values coming from the same gas cylinders and separated by less than 12 hours. For the first and last measurement within a batch of data, the missing standard values are derived by extrapolation from the nearest measurement for that cylinder within a six hour period. If a standard is not available under either of these conditions, the calibrated pCO2 value is not derived.
Linear regression of p(CO2)dry, uncal against the known x(CO2) values for the three standards is then used to provide slope and intercept, which are then applied to the p(CO2)dry, uncal values to correct them to x(CO2)dry, cal.
Note – linear regression against x(CO2) removes the pressure signal from the CO2 measurements. It would be possible to divide p(CO2)dry, uncal by pressure to obtain x(CO2)dry, uncal before undertaking linear regression to x(CO2)dry, cal but because the linear regression effectively does this anyway, it makes this extra step redundant.
In situations when the calibrated concentration value of the standard is not yet available, the software uses the nominal concentration instead and flags any derived value with a 'U' flag to indicate that the value is 'Uncalibrated'.
This is done using the standard formula:
p(CO2)dry, cal = x(CO2)dry, cal . p
where
p is the barometric pressure, nominally at sea level, expressed in units of atmosphere. We use the atmospheric pressure measured by the ship's meteorological instruments at the height of the instruments (generally 5 - 10 m above sea level). The pressure is not currently corrected to sea level.If the ship's atmospheric pressure is missing or flagged suspect then the processing software uses the pressure measured by the LICOR during the marine air measurement.
The conversion will not take place if the atmospheric pressure measured by the ship's instrumention or by the LICOR are missing or have been flagged suspect.
The data from the two platinum resistance thermometers located at the top and bottom of the equilibrator are dynamically calibrated, corrected for ice-point error and scaled to the ITS-90 temperature scale prior to loading in the BODC CARBON-OPS database. Calibration of the instruments is performed at the Plymouth Marine Laboratory every six months or as soon as possible thereafter. The calibration coefficients are then sent to BODC where they are entered in the CARBON-OPS database and applied dynamically to the incoming data.
Correction for water vapour pressure is carried out using the equations of Weiss & Price (1980), which are valid over the temperature range 0 to 40°C (273-313K) and salinity range 0-40 PSU.
For equilibrator seawater measurements, the water vapour pressure in the equilibrator sample in atmosphere units (p(H2O)equ) is first calculated as follows:
ln p(H2O)equ = 24.4543 – 67.4509 (100/Tequ) – 4.8489 ln (Tequ/100) – 0.000544 S
where
For the pCO2 system used in CARBON-OPS, the water temperature is measured at the top (inflow) and at the bottom (outflow) of the equilibrator by two Platinum Resistance thermometers. The software takes the mean of the two values in °C if both values are good; if only one is good then this is the value that will be used. It then converts the value to degrees K to obtain Tequ.
For marine air measurements, the water vapour pressure (p(H2O)sst) over the sea surface is determined using the in-situ sea surface temperature measured by the ship's instruments converted to degrees K, and the sea surface salinity.
ln p(H2O)sst = 24.4543 – 67.4509 (100/Ts) – 4.8489 ln (Ts/100) – 0.000544 S
where
The water vapour pressure values are then used to correct p(CO2)dry, cal to 100% humidity using the standard formula as given in DOE (1994) SOP 5:
p(CO2)wet, cal = p(CO2)dry, cal . (1 – p(H2O)equ)
where
p(H2O) is the vapour pressure in units of atmosphere over a seawater sample of a given salinity at the temperature of equilibration for the equilibrator sample or at the sea surface temperature for the marine air sample.
The sea water sample pCO2 is then corrected to in-situ temperature as per DOE (1994) SOP 5, using the constant of 0.0423 determined experimentally by Takahashi et al (1993)
p(CO2, Ts)wet, cal = p(CO2, Tequ)wet, cal . e(0.0423(Ts-Tequ))
The calculation of the fugacity ƒ(CO2) includes the following steps
a) Starting with x(CO2)dry, cal at Tequ, calculate at x(CO2) at SST using Takahashi et al. (1993)
x(CO2, Ts)dry, cal = x(CO2, Tequ)dry, cal . e(0.0423(Ts-Tequ))
b) Calculate at 100% humidity
x(CO2, Ts)wet, cal = x(CO2, Ts)dry, cal . (p – p(H2O)sst ) /p
where
p is the atmospheric pressure in Pascals and p(H2O)sst is the water vapour pressure at SST in Pascals.
p(H2O)sst in atmosphere units is calculated from Weiss & Price (1980) using the sea surface temperature measured at the hull (Ts) in degrees K.
ln p(H2O)sst = 24.4543 – 67.4509 (100/Ts) – 4.8489 ln (Ts/100) – 0.000544 S
p(H2O)sst is converted to Pascals by multiplying the value by 101325.
c) Calculate the virial coefficients (δ, β, γ) using Weiss (1974).
δ = (57.7 - 0.118 . Ts) . 10-6
β = (-1636.75 + 12.0408 . Ts - 0.0327957 . Ts2 + 3.16528 . 10-5 . Ts3) . 10-6
γ1 = (β + 2δ . (1-(x(CO2, Ts)wet, cal . 10-6))2), calculated for both sea and air x(CO2)
γ2 = (p . 100)/(R . Ts), where R is the gas constant 8.3144
γtotal = exp (γ1 . γ2), calculated for both sea and air x(CO2)
d) Calculate the fugacity
ƒ(CO2) = γtotal . p(CO2, Ts)wet, cal
DOE (1994) Standard Operating Procedures (SOP) 5: Determination of p(CO2) in air that is in equilibrium with a continuous stream of sea water.
In: Handbook of methods for the analysis of the various parameters of the carbon dioxide system in sea water - Version 2, A. G. Dickson & C. Goyet, eds. ORNL/CDIAC-74.
Takahashi T, Olafsson J, Goddard J, Chipman DW, Sutherland SC (1993) Seasonal variation of CO2 and nutrients in the high-latitude surface oceans: A comparative study.
Global Biogeochemical Cycles, 7, 843-878.
Weiss RF (1974) Carbon dioxide in water and seawater: the solubility of a non-ideal gas.
Marine Chemistry 2:203-215.
Weiss RF, Price BA (1980) Nitrous oxide solubility in water and seawater.
Marine Chemistry 8:347-359.