Skip to main content

Quality Control of CTD profiles

Project description

This package is intended to quality control CTD stations by applying a sequence of tests. It uses the Seabird package to interpret the SeaBird’s .cnv output file.

This is the result from several generations of quality control systems, which started in 2006, while I was in charge of the quality control of termosalinographs at AOML-NOAA, USA. Later I was advising the quality control of the brazilian hydrography of PIRATA.

CoTeDe can apply different quality control procedures:
  • The default GTSPP or EGOOS procedure;

  • A custom set of tests and user defined thresholds;

  • A novel approach based on Anomaly Detection, described by Castelao 2015;

Quick howto

To evaluate the records of a profile:

import cotede.qc

pqc = cotede.qc.fProfileQC(‘example.cnv’)

To see the temperature records of the primary sensor:

pqc[‘temperature’]

To see the flags of all tests applied on the secondary sensor of salinity:

pqc.flags[‘salinity2’]

To evaluate a full set of profiles at once, like all profiles from a cruise, use the class ProfileQCCollection, like:

dataset = ProfileQCCollection(‘/path/to/data/’, inputpattern=”.*.cnv”) dataset.flags[‘temperature’].keys()

Check the notebooks galery for more examples and functionalities: http://nbviewer.ipython.org/github/castelao/CoTeDe/tree/master/docs/notebooks/

Support and Documentation

http://cotede.readthedocs.org/en/latest/

How I see quality control

Quality control is different then data processing. On the processed data, the quality control/quality assurance means to check what looks fine. It is very important that the data is properly sampled and processed. The quality control procedures can’t go back on time and fix improper sampling, but only tell you that the data don’t looks fine.

Why CoTeDe?

For a long time I had the idea of the anomaly detection technique in mind, but I only really formalize the procedure in 2013, when I spent few months in Toulouse. The full name of this package is CoTe De l’eau, which I understand as something near to “rating the water”. The short name is cotede, to make easier for the users to remember, since it is the quality control of COnductivity TEmperature and DEpth (cotede). The french name is a kind of tribute to the great time that I spent in France with Bia and the croissants that were converted in code lines.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cotede-0.10.1.tar.gz (14.4 kB view details)

Uploaded Source

File details

Details for the file cotede-0.10.1.tar.gz.

File metadata

  • Download URL: cotede-0.10.1.tar.gz
  • Upload date:
  • Size: 14.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for cotede-0.10.1.tar.gz
Algorithm Hash digest
SHA256 5918d12b753a815b2b8292257848df51562d07c0bdb4bac4fa61fe673f80ef36
MD5 d26d68bfaa4fe7b4ba0513b6d4301708
BLAKE2b-256 d3c1c75c1f6518cbd166c1ab3bded49848a003b1aadf1c31743c635eed9d9807

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page