Import CSV File Overview
To populate data into Dips Orientation Data, the user can use one of the following options:
- Manually enter each cell one by one
- Manually copy columns or rows of data from an Excel spreadsheet
- Use the Import CSV File option to specify the format and columns for mass import from a comma-delimited file or an Excel spreadsheet
The Import CSV File option allows users to import columnized data from comma-delimited text files (.csv) or Excel spreadsheets (.xlsx) into Orientation Data.
To allow the most generalized/customizable import of data, Import CSV File allows users to:
- Import any traverse type
- Import a single or several files at once (e.g. 1 file with 6 Linear Traverses, or 6 files with 1 Linear Traverse per file)
- Import files with any order of column headers
- Import files with any starting data row (e.g., header is on first row, and data starts on second row)
- Start from a previously saved Import CSV Template which specifies all the import settings (optional)
The Import CSV dialog is a wizard-style dialog with the multiple sections:
- Import Settings
- Traverse Data
- Survey Data (if applicable)
- Discontinuities Data
Navigate through the wizard process by clicking on the Next/Back buttons.
To start the import process using Import CSV File:
- Select File > Import > Import CSV File from the menu, or Analysis > Import CSV
from the Home ribbon. - The Import CSV dialog consists of a series of pages which guides the user through the process of selecting data type for import, adding import files, and specifying the various import settings.
- In the Import Settings section:
- Select the Traverse Type from the dropdown. The required inputs will vary depending on the traverse type selected. Examples of the file format are shown on the right side of the dialog.
- Click Next.
- In the Traverse Data section:
- Select the Add button or drag and drop file(s) under Import Traverse Files.
- Select the Delimiter from the drop down.
- Select the Start Row (e.g., enter 2 if the first row is the header, so data reading does not include the header text)
- Optionally, select the Include Declination checkbox if your file contains a declination correction value. If unchecked, then 0 degrees (i.e., no correction) is assumed.
- Optionally, select the Include X, Y, Z checkbox if your file contains UTM coordinates. If unchecked, then the origin (i.e., 0, 0, 0) is assumed.
- Optionally, select the Include Comments checkbox if your file contains extra information you would like to include in comments. If unchecked, then comments will be left blank.
- All parameters listed are required and must be mapped to the appropriate column in the source file. For each Parameter:
- Set the Assigned Column
- Select the Format from the drop down
- Set the Unit Type (if numeric) and Unit (if not unitless) from the drop downs.
- Click Next.
Multiple files can be added, so long as their column and row formats are consistent; the rows from each file will be appended. - In the Survey Data section:
- Select the Add button or drag and drop file(s) under Import Survey Data Files.
- Select the Delimiter from the drop down.
- Select the Start Row (e.g., enter 2 if the first row is the header, so data reading does not include the header text)
- Select the De-survey Option from the drop down.
- Optionally add additional parameters by clicking the Insert or Append button and entering a Parameter name. These will be mapped to extra columns in the Survey Data grid of the Orientation Data.
TIP: If there are many extra columns, you can add all of them as parameters by clicking Add Additional Parameters. In the Add Parameters from File dialog, set the Row Number Containing Parameter Headers and select Extract Units checkbox. On OK, the headers will be automatically added under Parameter. If not unit text is included in the headers (or cannot be inferred from Dips' supported unit formats), then Text Format is assumed. - All parameters listed are required and must be mapped to the appropriate column in the source file. For each Parameter:
- Set the Assigned Column
- Select the Format from the drop down
- Set the Unit Type (if numeric) and Unit (if not unitless) from the dropdowns.
- Click Next.
Multiple files can be added, so long as their column and row formats are consistent; the rows from each file will be appended. - In the Discontinuities Data section:
- Select the Add button or drag and drop file(s) under Import Discontinuities Files.
- Select the Delimiter from the drop down.
- Select the Start Row (e.g., enter 2 if the first row is the header, so data reading does not include the header text)
- Select the Data Orientation from the drop down.
- Optionally, select the Include Declination checkbox if your file contains a declination correction value. If unchecked, then 0 degrees (i.e., no correction) is assumed.
- Optionally, select the Include X, Y, Z checkbox
if your file contains discontinuity locations (if applicable). If
unchecked, then the origin (i.e., 0, 0, 0) is assumed.
- Optionally, select the Include Persistence checkbox if your file contains discontinuity persistence measurements. If unchecked, then a persistence of 0 is assumed.
- Optionally, select the Include Quantity checkbox if your file contains multiple discontinuity quantities (repeated measurements). If unchecked, then a quantity of 1 is assumed.
- All parameters listed are required and must be mapped to the appropriate column in the source file. For each Parameter:
- Set the Assigned Column
- Select the Format from the dropdown
- Set the Unit Type (if numeric) and Unit (if not unitless) from the dropdowns.
- Click Finish to import.
Multiple files can be added, so long as their column and row formats are consistent; the rows from each file will be appended. - The Import Summary page reports the import status and the counts of Traverses, Survey Data Points, and Discontinuities that were imported.
- Optionally, select Save Current Import Settings As a Template and enter a Template Name to save the current selections as an Import CSV Template for future use when importing files of the same format.
- Click OK.
Expected File Formats
Import CSV reads columnized data in a comma-delimited text file (.csv) or Excel format (.xls or .xlsx). When importing from an Excel file, only the first sheet is read.
MULTIPLE IMPORT FILES
If importing more than one file for a given data type, ensure that all files have a consistent row and column format.
- Same order of column headers
- Same starting data row
- Same header row (if a header exists)
The selections per data type (including column mappings) apply to all files. If you need to import multiple files of differing formats, you can re-run Import CSV, and make the corresponding selections.
Import Settings
The Import Settings is the first section of the Import CSV dialog and contains selections for Import Preference and Traverse Type.
IMPORT NEW
To start importing from scratch, select the Import New option.
IMPORT FROM A SAVED TEMPLATE
The Import From a Saved Template option allows users to start from a user-defined template. Any user-defined templates saved on your local machine will be available in the Template drop down. Click the Edit button in the Import Preference group box to manage Import CSV templates in the Template Manager.
After selecting an Import CSV Template from the Template drop down, the Import CSV dialog controls will be automatically selected/populated based on the template settings. All the user has to do from here is add the import files for each data type.
DATA TYPES
Select a Traverse Type from the drop down:
- Spot Mapping
- Linear Scanline
- Planar
- Linear Borehole Oriented Core
- Linear Borehole Televiewer
- Curved Borehole Oriented Core
- Curved Borehole Televiewer
- Clinorule
Depending on the Traverse Type selected, various inputs are required, as indicated by the Required Inputs text. Some arbitrary examples of the input data files are also shown. Note that the column order and header names do not need to exactly match these examples. For each data type (i.e., Traverse Data, Survey Data, Discontinuities Data), a page will appear after this page, which allows users to select the specific row and column formats of the import file for each data type.
Traverse Data
The Traverse Data section allows users to select the import file for reading and the format of the import data for the Traverse information corresponding to the Traverse Type selected in Import Settings.
TRAVERSE DATA VALIDATION
Selections in the Traverse Data must ensure that the import data follows these rules:
- The Traverse must be non-blank and unique (across imported and existing Orientation Data).
- The Latitude, Longitude, and Elevation must be non-blank and numeric.
- All orientations (i.e., Trend, Plunge, Orient 1, Orient 2, Orient 3) (if applicable) must be non-blank and numeric.
- X, Y, Z (if applicable) must be non-blank and numeric.
- Traverse IDs must be unique for all Traverses, not just for a given Traverse type.
Survey Data
The Survey Data section allows users to select the import file for reading and the format of the import data for the Survey information corresponding to the Traverse Type selected in Import Settings. Only Curved Borehole Televiewer and Curved Borehole Oriented Core traverse types have Survey Data.
SURVEY DATA VALIDATION
Selections in the Survey Data must ensure that the import data follows these rules:
- The Traverse must be non-blank and match with those imported from Traverse Data page.
- The Distance must be non-blank and numeric.
- Trend and Plunge must be non-blank and numeric.
- Any additional parameters which have a Numeric Format must be non-blank and numeric.
Discontinuities Data
The Discontinuities Data section allows users to select the import file for reading and the format of the import data for the Discontinuities information corresponding to the Traverse Type selected in Import Settings.
DISCONTINUITY DATA VALIDATION
Selections in the Discontinuity Data section must ensure that the import data follows these rules:
- The Traverse must be non-blank and match with those imported from Traverse Data page.
- All orientations (i.e., Trend, Plunge, Dip, Dip Direction, Strike, Alpha, Beta) (whichever are applicable) must be non-blank and numeric.
- Quantity (if applicable) must be non-blank and numeric.
- X, Y, Z (if applicable) must be non-blank and numeric.
- The Distance (if applicable) must be non-blank and numeric.
- Persistence must be non-blank and numeric.
- Any additional parameters which have a Numeric Format must be non-blank and numeric.
If any of these rules are violated, you will not be able to proceed on Next or Finish.
Import Summary
The Import Summary is the last section of the Import CSV dialog and contains a summary of the Traverses, Survey Data Points, and Discontinuities counts being imported.
If the top of this section indicates "Import completed successfully", then you may proceed to importing the data into Dips by clicking Finish.
SAVE AS TEMPLATE
Prior to clicking Finish, you may save the current set of selections in all the previous pages of the Import CSV dialog as a template. Select the Save Current Import Settings as a Template checkbox and enter a Template Name.