Validating Data

Validating Data - Overview

Tool Location:  Data > Validate Data

The quality assurance (QA) steps check that the data in the database is very robust and ready for reporting and analysis.

 Highlights of the validation process are as follows:

·         Errors are checked at the field level, record level and database level

·         Errors are clearly displayed to the user

·         Data can be edited without having to load the application that created the data file

Validating Data - General Usage

The Validate Data form is shown below.

image

Pressing the Check for Errors button causes SiteFX to scan the temporal data tables for any records that are missing critical information. For any tables that have an error count greater than 0, clicking on the table name will provide a breakdown of where the errors occur in the top right hand corner. Click on one of the buttons next to the error count will setup the form so that corrections can be made.

Corrections are made by first choosing the existing value, then choosing the new value.  The existing value is chosen by clicking on one of the blue fields, the new value is picked from the list in the bottom left hand corner. Once the old and new value are picked, pressing the Update All Matching Records will update the records. The user can fine tune what records are updated by placing check marks next to field names in the bottom right hand corner.

Validating Data - Features

Check for Errors Button

Checks all temporal data records in the database for errors.

Error Type Buttons - Interval Name, Sample Date, Sample Type, Reading Name, Reading Types and Units Buttons

These buttons become active when errors exist in the respective data.  Pressing the button brings up either the errors only or all data, depending on the toggle below the buttons.

‘Available’ drop down list

Shows groupings for data when a error type button is pressed.  For example, when Interval Name is pressed, the available Interval Types (i.e. climate station, drain, monitoring well) appear in the window.

Old Value and New Value

This fields show the existing value and the new value. It can be thought of as a ‘find and replace’ type setup.

Validating Data - Checking the Data

1.        Open the form by going to Temporal Data > Validate Data.

2.        Press the Check for Errors button. If errors are present, you will see the number of errors Error list and the parameter buttons will become active.  If not, there error count will be zero.

3.        Make sure Show Errors Only is selected. Show All Data is useful. for browsing data or fixing validation that were made inadvertantly.

4.        Press one of the error type buttons with errors present (Interval Name, Reading Name etc).  The middle half of the form will show records that have errors of the type selected.

5.        Correct the errors.  Do this by first clicking on a blue field for a record you wish to correct. Then selected the correct value from the list in the bottom left hand corder. The old value and new value fields should be update to reflect what you have picked.

6.        Press Update All Matching Records to correct the remaining matching errors.

7.        The error count numbers to do not get updated until you press the  Check for Errors button again.  There should now be no errors for Interval Name.

8.        Repeat with the remaining parameter errors. 

Note:  In some instances, New Values can be typed into the field instead of selected from the Available Parameters window.