Automatic Tag Detection and Classification with Cintoo AI

Created by Nikita Barnev, Modified on Tue, 12 Nov at 9:52 AM by Nikita Barnev

Cintoo's AI Engine replaces the cumbersome manual tag search in your scan data with an automated, faster, easier, and more accurate approach.

Based on a Deep Neural Network engine and modern computer vision algorithms, Cintoo's AI Engine allows users to automatically geolocate and classify tags in the 3D scans. Cintoo's AI Engine is tailored to the industrial customers’ requirements and the important objects they need to identify for their specific applications.

For example, Cintoo's AI Engine can readily detect common Industry 4.0 objects such as valves, flanges, electric motors, electric devices etc. The Cintoo AI Library contains a large set of real use-case content that has been manually annotated. This customized list of assets is continuously enhanced and updated according to customer requirements.

Example categories of tags:

Electric Motors

Valves (Handle Actuator)
Valves (Hand Wheel Actuator)

Flanges

Electric Boxes

Control Boxes

Manometers

Filters

Pressure Regulators

Slam Shut Valves

How to use

1. In 3D View, select the Work Zone that contains the scans to use for the AI detection process.

Note: Current AI Engine will search tags in a maximum of 500 scans simultaneously, so please organize scans accordingly.

2. Using the Tag Explorer, select the list that has been created for this search. If no lists are present see Create a List of Tags.

3. With the Tag list selected, click AI Detection in the list of available actions.

4. Select the tag class(es) to be automatically detected for this list and click Detect.

All tags are divided by categories for better distinction between them. Now there are two categories Equipment and Geometry. More categories would be introduced with new releases.

Online detection process benefits from bidirectional translation between 3D point clouds and 2D display modes (RGB, surface map, intensity map). Using cloud computing, online detection process runs very fast, around 45 seconds for a 40-million-pixel scan. You will be notified by email when the search is complete.

Note: There can be only one AI search process at a time on a given project. If one AI search has started already, you will be notified with Tag list has pending AI jobs message.

5. Once the search process is complete, you need to go through the validation step. Each tag detected automatically comes with confidence metadata that can be found in Properties. Each tag created by AI Detection automatically comes with the status Validation needed.

6. Select Go to to view the selected tag in the closest scan location computed by Cintoo Cloud.

Add metadata or adjust the bounding box for the selected tag manually by clicking on Edit in the list of possible actions for a tag.

7. Click Validate to validate the tag or click Delete to remove the tag.

8. Repeat steps 5-7 for each tag in the list to be validated.