Creating Tags in Cintoo Cloud

Created by John Tapia, Modified on Fri, 19 Apr 2024 at 02:28 AM by Nicholas Czarnick

Creating a List of Tags

Click on in the top right corner of Cintoo Cloud UI and select ‘Create Tag List’ or select ‘Tag’ in the main window after you have created a new Work Zone to contain all your tags, which is recommended:

Creating tag lists can be done from the DATA tab or the 3D VIEW:

1. Enter a name

2. Select a color for your tags: The same color will be applied to all tags of this list in the 3D View.

3. Add a description, which can also be a hyperlink.

4. Add your custom metadata (up to 20 fields).

5. When naming your tag metadata, avoid spaces in the metadata field names, and avoid reserved keywords such as:

"id"
"subId"
"name"
"boundingBox"
"orientedBoundingBox"
"model"
"class"
"cameraState"
"unit"
"functionalSystem"
"description"
"confidence"
"scanUuids"
"needValidation"
"nature"
"customFields"
"metadata"

Manual Tagging

Manual tagging in Cintoo Cloud consists of using the bounding box tool to demarcate the equipment, and setting the tag ID and metadata manually.

1. Go to 3D VIEW and open the Tag Explorer from the vertical tool bar:

2. In the Tag Explorer, select a tag list by clicking on the name of the list.

3. Click on ‘Show’ as well to display those tags in the 3D View:

4. Clicking on ‘Show’ will display the tags for this list in the 3D View but it does not mean that you have selected this list of tags. Both clicks (select the tag list and show it) are mandatory.

5. Before creating a given tag, it is recommended that you first set your view point in the 3D View to look at the selected equipment. You can be in ‘Scan Mode’ as in ‘3D Navigation’ mode.

6. Once a list has been selected, you then have access to a series of possible actions for this selected list of tags at the bottom of the Tag Explorer. One of them is ‘Create Tag’:

*Note that the same actions are also available from the DATA tab.

7. Creating a tag will prompt the tag editor on the right of your display. Make sure that the right list is indicated at the top:

8. Fill in the various fields.

9. Once you place your mouse in the 3D View, you will see a bounding box appear, which you may place close to the equipment to be tagged. Note that you can use the mouse scroll wheel to preadjust the size of the box.

*Note that if the bounding box does not appear, it means that you have forgotten to click on ‘Show’. (See Manual Tagging - Steps 3 and 4 in these instructions.)
10. Click once in the 3D View to display the gizmo. You may change the point of view or the display mode (Surface, RGB…) to have a better understanding of the equipment’s form and size. For example, switch to ‘3D Surface’ in 3D Navigation in this case:

11. Use the gizmo to adjust the bounding box to the equipment. The Gizmo features are the following:

Click & hold and move the Cubes for editing size by adjusting the faces.
Click & hold and move Lines to move along one axis.
Click & hold and move Quadrants to rotate along axis.

12. Click on ‘Create’ to create this tag once you have filled in all the metadata information. The view used for the creation of the bounding box (in Scan Mode or in 3D Navi mode) will be the default view for this tag.

You can change this view at any time: see sub-section ‘Changing the Default View’ below.

You can also create a tag by duplicating an existing one, in the case when there are several similar equipment that can benefit from your first tag creation.

Duplicate a Tag

1. Select the first tag created.

2.Click on ‘Duplicate’ in the list of available actions for this tag:

3. This will open the Create Tag toolbox, prefilled with the information from the first tag. The ID will be credited by 1.

4. You may then simply move the bounding box with a simple translation for example to create an adjacent similar tag to the first one as in this example:

Importing a List of Tags from a 3D Model

You can get a list of tags from your Digital Twin or from your Revit or Navisworks model via a simple CSV file that contains the ID of each piece of equipment, their location, and various other metadata according to the Tag Data Model that you have set initially when creating this list of tags.

These tags from your Digital Twin or CAD model will then be displayed as bounding boxes overlaid on the scans, with the possibility to edit each box to match the reality, or to edit the list to add more metadata.

1. When creating the tag list (see Creating a List of tags section above, Steps 1-5) make sure that you define your metadata fields to match exactly the metadata fields provided in your CSV file. Note that the metadata fields in Cintoo Cloud do not need to be in the same order as the columns in your CSV file.

2. Once the corresponding list has been selected in your Tag Explorer (see Manual Tagging section above, Steps 1-4), select ‘Import Tag List’ from the list of actions related to this list:

*Note that the same actions are also available from the DATA tab.

A screenshot of a computer
Description automatically generated

3. Clicking on ‘Import Tag List’ will prompt the following menu:

4. Select your CSV or Excel file. This will populate your tag list automatically.

Example Tag from 3D Model

Creating a List of Tags using Cintoo AI Engine

Cintoo AI Engine replaces the cumbersome manual tag search in your scan data with an automated, faster, easier, and more accurate approach.

Based on a Deep Neural Network engine and modern computer vision algorithms, Cintoo AI Engine allows users to automatically geolocate and classify tags in the 3D scans. Cintoo AI Engine is tailored to the industrial customers’ requirements and the important objects they need to identify for their specific applications.

For example, the Cintoo AI Engine can readily detect common Industry 4.0 objects such as valves, flanges, electric motors, electric devices etc. The Cintoo AI Library contains a large set of real use-case content that has been manually annotated and includes at least seven different categories of tags. This customized list of assets is continuously enhanced and updated according to customer requirements.

Example categories of tags:

Electric Motors

Valves (Handle Actuator)
Valves (Hand Wheel Actuator)

Flanges

Electric Boxes

Control Boxes

Manometers

Filters

Pressure Regulators

Slam Shut Valves

1. In 3D VIEW, select the Work Zone where your scans are located for the search process.

* Note that the current AI Engine will search tags in a maximum of 500 scans simultaneously, so you may have to organize your scans accordingly.

2. Using the Tag Explorer, select the list that has been created for this search. (If no lists are present see Creating a List of Tags section above)

3. In the list of available actions for the selected list, select ‘AI Detection’:

4. Select the tag class(es) to be detected for this list and click on Detect:

The online detection process benefits from bidirectional translation between 3D point clouds and 2D modes (RGB, surface map, intensity map). Using cloud computing, the online detection process runs very fast, around 45 seconds for a 40-million-pixel scan. You will be notified by email when the search is complete.

*Note that there can be only one AI search process at a time on a given project. If one AI search has started already, you will be notified with the following message:

5. Once the search process is complete, you need to go through the validation step. Each tag detected automatically comes with a confidence metadata that can be found in the Properties:

Each tag detected also automatically comes with the status ‘Validation Needed’:

6. You can select ‘Go To’ to view the selected tag in the closest scan location computed by Cintoo Cloud:

You may manually edit this selected tag to add metadata or slightly adjust the bounding box, by clicking on ‘Edit’ in the list of possible actions for this tag.

7. When if you are satisfied by the tag, you can validate it: