Schneider Electric EcoStruxure Augmented Operator Advisor - Builder User Manual

This chapter introduces the EcoStruxure Augmented Operator Advisor Builder.

Builder

Introduction

Overview

EcoStruxure Augmented Operator Advisor uses a technology called augmented reality to optimize the operation and maintenance of industrial sites and equipment:

• The operator points a tablet computer at the site or equipment to be monitored.

• EcoStruxure Augmented Operator Advisor uses special image comparison techniques to match the scene visible in the field of view of the tablet camera with previously stored photographs of the same scene.

• When a match is made, markers called points of interest are overlaid on the live scene visible on the tablet.

• The operator taps the point of interest markers to display information. A wide variety of information can be displayed, including:

◦ Process variables

◦ Values extracted from an SQL database

◦ Documents, instruction sheets or wiring diagrams

◦ Web pages

◦ Videos

◦ Audio

◦ Procedures

You can also view all the information overlaid on the stored images of the site or equipment to be monitored without being physically in front of it.

EIO0000003006.12

Builder

EcoStruxure Augmented Operator Advisor introduces a number of other key concepts:

• An area is a zone within each site or building (such as production lines, plant rooms, storage areas, workshops, laboratories, and office areas) that you want to monitor using

EcoStruxure Augmented Operator Advisor.

NOTE: The number of areas you can monitor depends on the type of license you purchase .

• Scenes are things to monitor within an area, for example, machines, electrical cabinets, or production lines.

• Subscenes are a part of a scene, typically a close up view of a particular area of the scene. A subscene can contain its own points of interest.

• Procedures are a set of instructions that the operator must carry out in a predefined order to complete the task. Instructions can include scenes that must be recognized by the EcoStruxure Augmented Operator Advisor App using augmented reality.

NOTE: Procedures are only available with particular license types .

• A project is a container for all the information in areas, scenes, subscenes and procedures.

EIO0000003006.12

Builder

EcoStruxure Augmented Operator Advisor is made up of the following main components:

• EcoStruxure Augmented Operator Advisor Builder, an application running in the cloud.

• EcoStruxure Augmented Operator Advisor Runtime, server-based Windows software.

• EcoStruxure Augmented Operator Advisor App, an application running on a tablet computer.

EcoStruxure Augmented Operator Advisor Builder

Software

EcoStruxure Augmented Operator Advisor Builder is software that you use to:

• Organize and structure the areas, scenes, subscenes, and points of interest in a project.

• Create and position the points of interest on photographs.

• Attach documents directly to a scene or associate them with information in list points of interest.

• Define what happens when the operator taps the point of interest.

• Build procedures to explain a set of tasks the operator must carry out.

Getting Started with EcoStruxure Augmented

Operator Advisor Builder

Overview

EcoStruxure Augmented Operator Advisor Builder is an application that runs in a web browser, also called Cloud Builder. No installation is required. The PC running EcoStruxure

Augmented Operator Advisor Builder must have internet access.

NOTE: Alternatively, you can install the software locally on your PC. Internet access is not required. To use the Local Builder, contact the sales department for the installation file.

The following web browsers can be used:

• Google

Chrome

™

(version 101 or later)

• Mozilla

Firefox

™

(version 100 or later)

• Microsoft

Edge

™

(version 101 or later)

EIO0000003006.12

Builder

photographs or tags to identify a scene, page

Before using EcoStruxure Augmented Operator Advisor

Builder

Before using EcoStruxure Augmented Operator Advisor Builder, plan your project structure:

• The sites where EcoStruxure Augmented Operator Advisor is to be deployed.

• The areas within each site—such as production lines, plant rooms, storage areas, workshops, laboratories, and office areas—to be monitored.

• The scenes within each area, for example, production lines, machines, and electrical cabinets.

• Optionally, the subscenes, that is, parts of a scene that may need to be zoomed in on to uniquely identify all the controls on the equipment.

Taking Photographs and Tagging Equipment

The first step is to determine whether to use

If you are using photographs, the next step is to take

high-resolution photographs of all the areas, scenes, and subscenes, page 87 .

Store the photographs on a hard disk drive, USB key, or network folder accessible from the device on which EcoStruxure Augmented Operator Advisor Builder is used.

If you are using tags, the next step is to uniquely identify physically similar or identical items of equipment

and attach tags to them, page 89

16 EIO0000003006.12

Builder

Logging In to the Cloud Builder

To use cloud EcoStruxure Augmented Operator Advisor Builder, navigate to https://app.

schneider-electric.com/ecostruxure-augmented-operator-advisor . The login window appears.

EcoStruxure Augmented Operator Advisor

Builder is a tool to create custom projects improving operational efficiency with augmented reality.

Or continue with

Don’t have a user account? Register here

We process account registration information and connection logs for authentication and application access management… Privacy Notice

If you already have a user account, with login and password, you can log in to cloud Builder as follows:

Step

Action

Enter your e-mail address and click Next .

Enter your password and click Login .

Creating a User Account for Cloud Builder

If you do not have a user account, then you can create one as follows:

Step

Action

Click Register here from the login window.

Follow the instructions in the windows to create your account. You will need to provide:

EIO0000003006.12

Builder

Step Action

• A valid e-mail address

• Your name

• Your password

• Your location

Click Next , then in the next window, provide the required company information.

Click Register .

Complete the registration process.

Logging In to the Local Builder

After installing the software (see EcoStruxure Augmented Operator Advisor, Quick Start

Guide) and activating a license in the License Manager, you can log in to the local

EcoStruxure Augmented Operator Advisor Builder.

Docker Desktop for Windows must be installed and running, before you can launch the local

Builder.

To log in to the local Builder:

18 EIO0000003006.12

Step

Action

Click EcoStruxure Augmented Operator Advisor

Windows programs.

> Local Builder in the list of installed

Result: The login window appears.

Builder

LOCAL

Version x.y

EcoStruxure Augmented Operator Advisor Builder is a tool to create custom projects improving operational efficiency with augmented reality.

This application is protected by copyright law and international treaties.

Username admin

Password

**********

In the window that opens, enter a new admin password, following the instructions.

NOTE: Record the password in a safe location and provide appropriate protection.

Logging Out from EcoStruxure Augmented Operator

Advisor Builder

You are logged out automatically after several hours of inactivity. To log out from

EcoStruxure Augmented Operator Advisor Builder:

Step

Action

Click your login name in the top right corner of the main window in EcoStruxure Augmented

Operator Advisor Builder.

Choose Log out .

NOTE: EcoStruxure Augmented Operator Advisor Builder saves all your changes automatically. It does not ask you if you want to save them.

EIO0000003006.12

Builder

Overview of the EcoStruxure Augmented Operator

Advisor Builder Window

Overview

When you log in to EcoStruxure Augmented Operator Advisor Builder, the Projects page appears presenting the list of available projects:

John Doe

Projects

Import Project Create Project

First project

Description of the First Project

4 Areas 70 Scenes 1 Procedure Created a day ago By Modified an hour ago By

Second project

Description of the Second Project

1 Area 30 Scenes

Third project

Description of the Third Project

4 Areas 10 Scenes

1 Procedure Created a day ago By JD Modified an hour ago By

1 Procedure Created a day ago By Modified an hour ago By

For each project, the following information is displayed:

• The project name

• Description of the project

• Number of areas

• Number of scenes

• Number of procedures

• When and who created the project

• When and who last modified the project

Click on a project to open it, you can edit a project from the following main window:

20 EIO0000003006.12

Builder

2 3 4 5 6

John Doe

AREAS SCENES PROCEDURES REMOTE EXPERTS

Area Translation

My Project

Area 1

Variables

Documents

External Applications

Scenes

Area 2

Variables

Documents

External Applications

Scenes

Area 3

Variables

Documents

External Applications

Scenes

Area 4

Variables

Documents

External Applications

Scenes

Variables

Manage all your variables.

Scenes

Access to

Scenes.

Documents

Manage all your documents.

Procedures

Access to

Procedures.

External Applications

Manage all your external applications.

Area

Area 1

Area description

Attach document

Validate

Cancel

1 Toolbar. Displays icons specific to the currently opened tab

2 Project toolbar. Displays icons for project-specific actions

3 Tabs to access the areas, scenes, procedures, or remote experts windows

4 Allows you to choose the language of the user interface

5 Gives access to online help, terms & conditions (cloud only), downloading tags and product information

6 Shows the currently logged in user name and allows access to license information and the log out command

7 Right sidebar

8 Main window

9 Left sidebar

EIO0000003006.12

Builder

Projects

Overview

In EcoStruxure Augmented Operator Advisor Builder, a project is a container that allows you to organize your photographs and define points of interest. When complete, the project must be imported to the EcoStruxure Augmented Operator Advisor Runtime. Refer to

Building a

Project, page 80

for more details.

Projects are stored in the EcoStruxure Augmented Operator Advisor Builder website, or on the PC when using local Builder. You can only open one project at a time.

Refer to

for information on the maximum number of elements allowed.

22 EIO0000003006.12

multiple languages, page 93 .

Creating a New Project

Builder

Step

Action

Result: The Create Project dialog box opens.

Create Project

Project name

First project

Project description

Description of my first project.

Supported Languages

English – Unitied States

Spanish – Spain

French – France

German – Germany

Italian - Italy

Chinese (Simplified)

Japanese - Japan

Korean - Korea

Reference language

Make Reference language

The reference language cannot be changed once the project is created

Cancel Create

Type the new Project name .

Optionally, type a Project description .

In the Supported Languages , select one or multiple supported languages for your project. You can then use the Translation tab to make your project available in

By default, the first supported language you select is the Reference Language , if you want to change the default language for the project, click Make Reference Language for the corresponding language.

NOTE: Once the project is created, you cannot modify the reference language of your project.

Click Create .

EIO0000003006.12

Builder

Structure of a Project

When you open a project, a structured view of the project appears in the left sidebar. Each object you create (area, scene, point of interest, and so on) is automatically added to the structure. By default, the structure of areas in the project is displayed, for example:

5 4

AREAS SCENES PROCEDURES REMOTE EXPERTS

Area Translation

My project

Area 1

Variables

Documents

External Appli...

Scenes

Area 2

1 Click to collapse the structure

2 Click to list the variables, documents, external applications and scenes in this area

3 Click to expand the structure

4 Click the PROCEDURES tab to display the corresponding structured view for procedures.

5 Click the SCENES tab to display the corresponding structured view for scenes.

Using the Save Project As Function

To duplicate your current project under another name, click the icon. In the window that opens, enter the new project name and confirm. All subsequent changes will be made in the new project.

24 EIO0000003006.12

Builder

Sharing a Project

In EcoStruxure Augmented Operator Advisor Builder, if you are the owner of a project, you can invite a list of others to work on your current project. The Share Project function is only available when you have activated an EcoStruxure Augmented Operator Advisor Builder license. Otherwise the icon is unavailable in the toolbar.

Only one user can edit the shared project at a time. If a shared project is already opened by someone, you get the current editor e-mail so you can contact the user if needed. Close the shared project after you finish working on it to make it available for others.

Sharing projects is limited depending on the types of licenses held by the users (see

EcoStruxure Augmented Operator Advisor, Quick Start Guide).

• You cannot open a shared project if it contains functions that are not available with your activated license (for example procedures).

• You cannot include functions in a project if they are not available with the activated license of the project owner.

Step

Action

Open the project to share.

Click the Share Project icon in the project toolbar.

Result: A Share Project window appears.

Share Project

[email protected]

Share with other users

Enter an email address Add

Cancel Validate

EIO0000003006.12

Enter the e-mail address of the other user under the Share with people field and then click Add .

NOTE: Refer to

for information on the e-mail limitations.

Result: The new user is added to the list in the Share Project window.

NOTE: You can repeat step 3 to add multiple users by entering the e-mail address of each new user and clicking Add .

Click Validate to confirm the addition of the new users.

Builder

Unsharing a Project

If you are the owner of a shared project, you can remove other users from your shared project.

Step

Action

Open the shared project.

Click the Share Project icon in the project toolbar.

Result: A Share Project window appears.

In the list of users, click to the right of the user you want to remove.

Click Validate to confirm the removal.

26 EIO0000003006.12

project size limit, page 91

Creating a Backup of the Project

Builder

You can make a backup of your project on your local device using the icon. At a later time, you can use this backup to import your project into the EcoStruxure Augmented

Operator Advisor Builder.

The backup function is only available when you have activated an EcoStruxure Augmented

Operator Advisor Builder license. Otherwise the icon is unavailable in the toolbar.

Step

Action

Open the project to be backed up in the EcoStruxure Augmented Operator Advisor Builder.

Click the icon on the project toolbar.

Result: The Create a project backup screen appears:

Create a project backup

Password (optional)

Cancel Create

If you wish to use a password to encrypt your project backup file, set the password in the

Password field. Selecting the icon allows you to see the password you are typing.

The password must contain:

• A minimum of eight characters.

• At least three of the following types of characters:

◦ Upper case letter

◦ Lower case letter

◦ Number

◦ Symbol

Click Create to create the backup file.

Result: The backup .zip file is automatically downloaded to your local PC.

Verify that your backup .zip file does not exceed the

EIO0000003006.12

Builder

Importing a Project from a Backup File

You can only import a project if you have activated an EcoStruxure Augmented Operator

Advisor Builder license.

Step

Action

Click Import Project on the Projects page.

Result: The Import a Project screen appears:

Import a Project

Project name (Optional)

Drag and drop or

Browse for File

Open project after import

Cancel Import

Enter the name of the project in the Project name (optional) field. If you do not enter a project name, the name of the backup file is used.

Drag and drop the backup file or click Browse for File to select it.

NOTE: The backup file must have a .zip extension.

By default, Open project after import is activated so the project will immediately be opened after the import. Deactivate this if you do not wish to open the project immediately after import.

Click Import to start the import process.

Result: A progress bar is displayed to indicate the import progress.

28 EIO0000003006.12

backup of your project, page 27

Builder

Step

Action

If a password was set when the backup file was created, a new Import a Project screen appears,

Import a Project

Your backup file is password protected.

Password

Cancel Ok

Enter the corresponding backup file password in the Password field. Selecting the allows you to see the password you are typing.

NOTE: The entered password is checked after the backup file is fully uploaded.

Click Ok to complete the import process.

icon

Transferring a Project

You can transfer projects between cloud Builder and local Builder.

Step

Action

Open a project in cloud Builder or local Builder.

Make a

Import the project from the backup, as described in

Importing a Project from a Backup File, page

EIO0000003006.12

Builder

Deleting a Project

Shared projects can only be deleted by the project owner. You cannot delete a shared project if it is currently in use by another user.

To delete a project from the Projects page:

Step

Action

Find the project you want to delete.

Click the Delete icon in the top right corner of the corresponding project.

Result: A confirmation window appears.

Click Remove .

Result: The project and all its components are permanently deleted.

You can also delete an already opened project:

Step

Action

Open the project to delete.

Click the Delete icon in the project toolbar.

Result: A confirmation window appears.

Click Remove .

Result: The project and all its components are permanently deleted.

Closing a Project

If you want to return to the Projects page or open another project, you need to close the current project. If you are working on a shared project, close it when you finish working on it, to make it available for other users.

30 EIO0000003006.12

Step

Action

In the opened project, click the Close icon

Result: A confirmation window appears.

in the project toolbar.

Click Yes to close the current project.

Result: The project is closed and the Projects page opens.

Builder

EIO0000003006.12

Builder

Areas

Overview

A project is made up of one or more areas. You can create an area, for example, for each production line or item of equipment to be monitored.

If you want to associate a project with a machine type in EcoStruxure Machine Advisor, the project must contain only one area.

Creating a New Area

Step

Action

Select the AREAS tab.

Click the Area icon in the toolbar.

In the right sidebar, type the Area name , and if required, a short description.

Optionally, activate Attach document to attach a document to the area, that could be displayed in the document browser in the App.

Click Validate .

Deleting an Area

Step

Action

In the project structure, right-click on the area to delete and choose Remove .

Result: A confirmation window appears.

Click Remove .

32 EIO0000003006.12

Builder

Points of Interest Content

Overview

A point of interest is a position in a scene for which additional diagnostic or technical information is available. The point of interest can be placed anywhere in the scene. The number of points of interest that can be added to each scene is limited: refer to

External applications, page 44

. Various types of points of interest can be defined, including technical documentation, design drawings, information contained in a spreadsheet, and the real-time values of process variables generated by equipment.

When the operator points the tablet camera at the scene, EcoStruxure Augmented Operator

Advisor automatically recognizes it using augmented reality and displays the points of interest on the scene.

You can define the following types of content for your points of interest:

•

Variables, page 33

•

Documents, page 38

•

•

Procedures, page 68

Variable Points of Interest

Overview

When viewing a scene, a variable point of interest is replaced by the real-time value of a process variable.

EcoStruxure Augmented Operator Advisor supports the following variable source types:

• EcoStruxure Operator Terminal Expert (or Pro-face BLUE) variables. The value is read from the PLC using EcoStruxure Operator Terminal Expert (or Pro-face BLUE) software.

• Internal. The value is read from an SQL database using Node-RED software.

Variable points of interest are specific to an area. For example, you could define a variable with the name “VAR101” in two different areas with different properties.

EIO0000003006.12

Builder

NOTE:

• EcoStruxure Augmented Operator Advisor Builder variable names must be exactly the same as the variable names defined in EcoStruxure Operator Terminal Expert or Node-RED.

• For EcoStruxure Operator Terminal Expert / Pro-face BLUE variables, use the complete name, including the device name part.

• All EcoStruxure Operator Terminal Expert / Pro-face BLUE variables must be declared as ‘animated’ variables in the runtime of the EcoStruxure Operator

Terminal Expert / Pro-face BLUE. This includes, but is not limited to, being part of one of the following groups:

◦ Alarm group

◦ Data logging group

◦ Displayed on an active HMI screen

Refer to the relevant EcoStruxure Operator Terminal Expert / Pro-face BLUE documentation for more details.

Creating a Variable

Step

Action

Select the AREAS tab.

Select Variables in the area structure.

Result: A list of existing variables appears:

VARIABLES

Name

Alias

Search: Type to search…

Type

EcoStruxure Operator Terminal Expert /

BLUE

EcoStruxure Operator Terminal Expert /

BLUE

EcoStruxure Operator Terminal Expert /

BLUE

EcoStruxure Operator Terminal Expert /

BLUE

Internal

34 EIO0000003006.12

Builder

Step

Action

Click the button

In the right sidebar, type the name of the variable, for example “VAR1”.

If you want to add a dynamic part to the variable name, that is, any part that can vary depending on the scene label, click in the right sidebar. Then, in the dialog box, place the cursor where the dynamic part is to be added and click Current Scene or Parent Scene (fixed scenes only). Click

OK to apply your changes.

Edit Variable Name

MODbus-TCP/IP.Schneider.

Current Scene .temperature

Current Scene Parent Scene

Cancel OK

In the Alias box, type a short name of the variable.

Select the variable type: EcoStruxure Operator Terminal Expert / BLUE or Internal .

Click Validate .

Result: A variable point of interest is created and added to the list of variables.

You can also create variables when configuring list points of interest: refer to

Configuring

List Items, page 60 .

Creating Multiple Variables

You can create multiple variables by importing a list of Internal variables from a .csv file.

Step

Action

Select the AREAS tab.

Select Variables in the area structure.

EIO0000003006.12

Builder

Step Action

Result: A list of existing variables appears:

VARIABLES

Name Alias

Search: Type to search…

Type

EcoStruxure Operator Terminal Expert /

BLUE

EcoStruxure Operator Terminal Expert /

BLUE

EcoStruxure Operator Terminal Expert /

BLUE

EcoStruxure Operator Terminal Expert /

BLUE

Internal

Click the (Import) button.

Result: The Import variables dialog box appears.

4 Only Internal variable type is available.

Create the .csv file using a template:

Click Download CSV Template to open the .csv file template.

Do not modify the first two lines.

EIO0000003006.12

Builder

Step

Action

Edit the next lines to fill in the .csv file with the variables to import.

Save the .csv file with the appropriate name.

You can import variables using one of the following ways, or click Cancel to cancel the import and close the Import variables dialog box.

• Drag and drop the .csv file in the Click or drop a CSV file area.

• Click the Click or drop a CSV file area:

A file selection dialog box appears. Search for and select the .csv file to import.

Result: A message is displayed indicating that the .csv file is uploaded and verified.

If the .csv file is not valid, the import is stopped and messages are displayed with more detailed information.

If the .csv file is valid, CSV file checked is displayed. Click Finish to create the variables.

When the variables are created, the Import variables dialog box is closed and the variables are displayed in the VARIABLES window.

You can also create variables when configuring list points of interest: refer to

Configuring

List Items, page 60 .

Modifying Variable Properties

To change the name or properties of an existing variable:

Step

Action

Select the AREAS tab.

Select Variables in the area structure.

Select the variable to configure.

You can use the Search box to narrow the search for the variable.

In the right sidebar, modify the variable name, alias, or type as required.

Click Validate .

Result: The updated variable properties are automatically saved.

EIO0000003006.12

Builder

scenes or subscenes, page 61 .

Using Variables in Scenes

After you have defined your variables, you can use them when configuring variable points of interest in

Deleting Variables

Step

Action

Select the AREAS tab.

Select Variables in the project structure.

Result: A list of variables appears.

Select the checkbox to the right of the variable or variables to delete.

You can use the Search box to narrow the search for the variable.

Click .

Result: A confirmation window appears.

Click Remove .

Document Points of Interest

Overview

You can associate document points of interest with specific positions in a scene. The operator viewing the scene on the tablet can then tap the point of interest to display the associated document. The document could be, for example, a wiring diagram for a cable loom, a video, a web page, or a user manual.

If several documents are added, this can decrease the performance of the App by displaying a large number of document point of interest almost illegible for the operator. If the documents are less targeting a specific position in a scene, for example equipment maintenance guide, the following alternative can be utilized, refer to

Attaching Documents to a Scene, page 52

38 EIO0000003006.12

Variables with dynamic parts, page 34

Builder

Three types of documents can be added to the project — Embedded , URL , or Hosted .

If you have a project associated with a machine type in EcoStruxure Machine Advisor, a fourth type of document is available — EcoStruxure Machine Advisor documents.

These documents can be associated with the project in the following ways:

• Embedded — by importing a copy of the document from the runtime device.

◦ The document is temporarily copied to the tablet each time the operator taps the associated document point of interest.

◦ The imported document can also be permanently copied locally on the tablet ( Copy the document locally option).

For frequently consulted documents, the Copy the document locally option optimizes access performance with large documents. The document must be up to date. However be aware that storing too many documents locally can fill up the tablet storage and increase the loading time of the project at start-up. Use this option only when necessary.

• URL — by accessing an external document from a URL.

You can also define a dynamic URL ( Dynamic URL option) where the URL address can vary depending on the scene label, or the value of a variable. In this way you directly access the related document.

cannot be added in a dynamic URL.

• Hosted — by importing the document file names in the project. The documents themselves are stored in a .zip file, that is hosted in the EcoStruxure Augmented

Operator Advisor Runtime, or in a remote location.

Use to create the path in EcoStruxure Augmented Operator Advisor Builder without copying the documents to the project. The .zip file must then be imported to the

EcoStruxure Augmented Operator Advisor Runtime (local), or an URL must be entered to configure the documents remote location (redirection or proxy). The use of hosted documents optimizes the import and the update of your documents, and the project size. Rebuilding the project is not required when updating the hosted documents.

• EcoStruxure Machine Advisor documents — by associating a project with a machine type in EcoStruxure Machine Advisor.

EIO0000003006.12

Builder

Creating Documents

Step

Action

Select the AREAS tab.

In the area structure in the left sidebar, select Documents .

Result: A list of existing documents appears:

DOCUMENTS

Label

M221 Programming Guide

M221 Hardware Guide

Dash document.pdf

Source

Embedded

URL

Hosted

Search: Type to search…

File Name / URL

EIO0000001360.09.pdf

EIO0000001384.06.pdf

https://doc Current Scene .pdf

Project Docs/document.pdf

Click the button

In the right sidebar, select a document type in the drop-down list under Type — Embedded , URL ,

Hosted .

Enter the name of the document in the Label box.

40 EIO0000003006.12

There are limitations regarding the file formats and the maximum file sizes, page 91 .

Builder

Step

Action

• For embedded documents, if you want to access a document on the runtime device and copy the document in the project, click the button and select the document. If you want to copy the document locally onto the tablet, select the checkbox Copy the document locally .

• If you want to access a document on a website, select the URL document type, and enter the path.

If the URL has a dynamic part, that is, any part of the path that can vary depending on the scene label or the value of a variable, click in the right sidebar. Then, in the dialog box, place the cursor where the dynamic part is to be added and click Current Scene , Parent

Scene (fixed scenes only), or Variable . Click OK to apply your changes.

Edit URL www.google.fr/Schneider/ Parent Scene .temperature/

MODbus-TCP/IP.Schneider

Current Scene .

Current Scene Parent Scene Variable

Cancel OK

• If you want to access a document stored in the EcoStruxure Augmented Operator Advisor

Runtime, select the Hosted document type, and enter the path to the document location.

NOTE: If you select the Hosted document type, in EcoStruxure Augmented Operator

Advisor Runtime you must copy the document to the runtime device, or to the remote location.

NOTE:

Click Validate .

Result: A document is created and is added to the list of documents.

EIO0000003006.12

Builder

EcoStruxure Machine Advisor Documents

If you want to use EcoStruxure Machine Advisor documents in your project, after you create the project, associate it with a machine type in EcoStruxure Machine Advisor. The documents are stored in EcoStruxure Machine Advisor and they can only be modified or removed from there.

After you have associated the machine in EcoStruxure Machine Advisor with your project, the EcoStruxure Machine Advisor documents become available in EcoStruxure Augmented

Operator Advisor Builder.

To access EcoStruxure Machine Advisor documents:

Step

Action

Select the AREAS tab.

In the area structure in the left sidebar, Select Machine documents for EcoStruxure Machine

Advisor documents.

Result: A list of available documents appears:

AREAS SCENES PROCEDURES REMOTE EXPERTS

Area Translation test

Area 1

Variables

Documents

Machine documents

External Applications

Scenes

ECOSTRUXURE MACHINE ADVISOR

DOCUMENTS

Label howto_setup

Search:

File Name how_to.mp4

user_manual.pdf

schema.pdf

Type to search…

Document

Label howto_setup

File Name how_to.mp4

Validate

Cancel

3 If you want to use a document when EcoStruxure Augmented Operator Advisor Builder is not connected to EcoStruxure Machine Advisor (for example, with local Builder), click the required document and enter a name of the document in the Label box in the right sidebar, then click

Validate . This only customized the documents name for EcoStruxure Augmented Operator

Advisor Builder.

NOTE: You can synchronize EcoStruxure Augmented Operator Advisor Builder with

EcoStruxure Machine Advisor and update the list of documents by clicking . The indicators on the page show if you are connected to EcoStruxure Machine Advisor, and whether a document used in your project is no longer available in EcoStruxure Machine Advisor.

Modifying Document Properties

To modify the name or properties of an existing document point of interest:

42 EIO0000003006.12

scenes or subscenes, page

Builder

Step

Action

Select the AREAS tab.

In the area structure, select either Documents or Machine documents .

Result: A list of existing documents appears.

Select the document to configure.

You can use the Search box to narrow the search for the document.

In the right sidebar, edit the document label or click the

Click Validate .

Result: The updated document properties are saved.

button to replace the document file.

Using Documents in Scenes

After you have defined your documents, you can:

• Associate them with information in list points of interest in

59 .

• Attach them directly to a Scene,

Attaching Documents to a Scene, page 52

Deleting Documents

Step

Action

Select the AREAS tab.

In the area structure, select either Documents or Machine documents .

Result: A list of existing documents appears.

You can use the Search box to narrow the search for the document.

Select the checkbox to the right of the document or documents to delete.

Click the button.

Result: A confirmation window appears.

Click Remove .

NOTE: In the list of EcoStruxure Machine Advisor documents, this only removes the label of the selected documents that are not used in a scene point of interest.

EIO0000003006.12

Builder

External App Points of Interest

Overview

External App points of interest appear as markers when the operator views a scene on the tablet. The external app is launched when the operator taps the marker. The app could be, for example, Vijeo Design’Air Plus.

Creating External Apps

External apps can either be launched directly as executable files, or by using a Uniform

Resource Identifier (URI). This is used to point to an object such as a file, and defines which application is used to open it.

The use of external apps may require the installation of third party applications.

Some examples follow, although syntax may vary depending on the OS type and version used, and on the version of the external application:

Google Maps

Word / Excel with Google

Docs

Direct Word / Excel file link

You can copy and paste a link from Google Maps in your internet browser and add it as an external link. Doing so opens the link in the Google Maps app (if installed on your device).

Example: https://www.google.fr/maps/place/Schneider+Electric+(SAS)/

@43.7860875,7.2098797,17z/data=!3m1!4b1!4m5!3m4!

1s0x12cdced20699b423:0x9ddfab4156c099ea!8m2!3d43.7860875!4d7.2120684

• In Android, the Google Docs link directly opens the Google Docs application with the document.

• In iOS, the Google Docs link opens the Google Docs website in Safari.

NOTE: Google Docs can read several file formats like .docx, .xlsx, .ppt and .

pdf.

Example: https://docs.google.com/viewer?url=https%3A%2F%2Fcalibre-ebook.

com%2Fdownloads%2Fdemos%2Fdemo.docx

• In Android, the document file is downloaded by the browser. You can click the downloaded file to open it in Word / Excel.

• In iOS, the document file is downloaded and opened in Safari.

Example: https://calibre-ebook.com/downloads/demos/demo.docx

By the use of the mailto link, the operating system will start an email application, and create an email with the specified destination, subject and contents.

Example: mailto:[email protected]?subject=test&body=test_mail_ content

44 EIO0000003006.12

configuring list points of interest, page 60 .

Vijeo Design'Air Plus

Skype

Step

You can open Vijeo Design’Air Plus with an app at a specified IP address.

Example: airplus://w.x.y.z

You can also open Vijeo Design’Air Plus on the alarm page of the app.

Example: airplus://w.x.y.z/alarm

You can launch a Skype audio call to a specified skype user name or phone number.

Example: skype:skypeNameOrPhoneNumber?call

Action

Select the AREAS tab.

Select External Applications in the area structure.

Result: A list of existing external applications appears:

Builder

Click the button.

In the right sidebar, type the name of the external application, for example “Vijeo Design’Air Plus”.

Type the path of the application or a URI.

Click Validate .

Result: An external application point of interest is created and is added to the list of external applications.

Using External Apps in Scenes

Once you have defined your external applications, you can use them in scenes when

EIO0000003006.12

Builder

Deleting External Apps

Step

Action

Select the AREAS tab.

Select External Applications in the area structure.

Result: A list of existing external applications appears.

Select the checkbox to the right of the external application or applications to delete.

Click .

Result: A confirmation window appears.

Click Remove .

46 EIO0000003006.12

images or tags to identify the scene, page 84 .

Builder

Creating and Deleting Scenes

Scenes

Overview

A scene is a combination of:

• An image (high-resolution photograph) of, for example, an electrical cabinet, machine, or production line.

• Points of interest, positioned on the image to indicate where information is being monitored. This information can be real-time variable data, text, documents, or procedures.

• Subscenes. A subscene is an image overlaid on the main image used to access more detailed information about a particular part of a scene.

• Other graphics, such as arrows, lines, or text, that are overlaid on the main image to help the operator better understand or more easily navigate the scene.

Before creating a scene, decide whether you are going to use

Creating a Scene

Step

Action

Select the AREAS tab.

In the left sidebar, select Scenes in the area where you want the scene to be available.

Result: A list of existing scenes appears.

Click the button.

In the right sidebar, select the scene type:

• Image recognition . A scene that differs significantly from all the other scenes in a project, for example, a view of the factory floor.

• Tag recognition . A scene that is identical or very similar to other scenes in the project, for example, a row of machines. In this case, tags must be printed and attached to the cabinet doors to assist EcoStruxure Augmented Operator Advisor to uniquely identify the scene and display the appropriate points of interest. See

for details.

EIO0000003006.12

Builder

Step

Action

• Fixed . A scene that does not need to be recognized, for example, a large machine which does not fit in the field of view. A static image is shown on the EcoStruxure Augmented

Operator Advisor App, without the need to be tracked.

NOTE: Fixed is only useful for subscenes.

Type a unique label for the scene, for example “Factory A, Second Floor”.

If you selected Tag recognition , select the number of the tag that is physically attached to the equipment in the scene from the drop-down list. See

Taking Photographs, page 87 .

for details.

Add images to use for the scene, using any of the following methods:

• Drag and drop images on the Drop images box.

• Click Upload images then browse and select one or more images. Refer to

Guideline for

• For Image recognition or Fixed , click Upload folder of images then browse and select a folder containing images. All images in the folder are uploaded. You can then select which image to use for the scene.

NOTE: Do not use the same image in multiple scenes or subscenes. An image should only be used in one scene or one subscene of your project. If the same image is used in multiple scenes, all points of interest from all scenes and subscenes will be displayed together.

Optionally, enable Attach document to attach documents to the scene. Refer to

Attaching

Documents to a Scene, page 52 .

Click Validate .

NOTE: After you have created a scene inside an area, it becomes available for use within that area of your project.

Using an Existing Scene in an Area

In order for a scene to be available in your App, it must be used in one or more Areas:

Step

Action

Select the SCENES tab.

In the left sidebar select the area where you want the scene to be added.

Click in the toolbar.

In the right sidebar, clear the checkbox Create new scene .

In the right sidebar, under Choose existing scene , select the scene to insert.

Click Validate .

Result: The Scene is now integrated in the Area structure in the left pane.

48 EIO0000003006.12

Builder

Searching for a Scene to edit

If you have a large number of scenes, use the scenes dashboard to easily find the scene to be edited.

Step

Action

Select the Area tab.

In the left sidebar, select Scenes in the relevant area.

Result: A list of existing scenes appears.

Enter the label of the scene you want to edit in the Search box to narrow the search for the scene.

SCENES

Label

M340

M340's steps

M340UC Assemblage

Type

Tag recognition

Search: M340

Tag number

560

561

Images

205.JPG

150.JPG

Assemblage_M340.png

Result: The available scenes that match the search text are displayed.

Click the scene icon displayed for the corresponding scene.

Result: The corresponding scene is now selected and displayed in the Scenes tab.

NOTE: the scene icon is displayed only for the scenes used in the Scenes tab.

Creating Multiple Duplicates of an Existing Scene

You can create multiple scenes by using a .csv

file that contains a listing of all the scenes to add. You also need a .zip file that contains all the images associated with the new scenes.

Step

Action

Click the SCENES tab.

In the left pane, right-click on the scene to duplicate and select Multiple duplicate .

Result: The Duplicate scene (Step 1/3) dialog box appears.

EIO0000003006.12

Builder

Step Action

3 Create a .csv file containing the new scenes to add using a CSV file template: a.

Click Download CSV Template then open the downloaded file.

The .csv template content is different depending on whether the scene uses Image recognition , Tag recognition , or Fixed :

• Image recognition and Fixed .csv files contain a scene label and an image file.

• Tag recognition .csv files contain a scene label, a tag number, and an image file.

The separator used is the comma.

Edit the file:

• Do not modify the first two lines.

• Edit the next lines as necessary for the scenes to add.

• When using Image recognition or Fixed , you can have multiple lines for one scene, so that you can define multiple images for the scene.

• When using Tag recognition , the file contains one line for each scene.

Save the .csv file with the appropriate name.

Use the Click or drop a CSV file area to select the .csv file just created.

Result: The .csv file is uploaded and verified.

EIO0000003006.12

remove the subscene from the scene before you can delete it, page 57

Builder

Step

Action

After the .csv file is verified, the Duplicate scene (Step 2/3) dialog box appears.

Drag and drop the .zip file containing the images to associate with the created scenes and that are referenced in the previous .csv file.

Result: Images are uploaded. The Duplicate scene (Step 3/3) dialog box appears:

5 Click Finish to create and load the new scenes with all associated images. The scenes are then available for use within that area of your project.

Deleting a Scene

Step

Action

Select the AREAS tab.

Select Scenes in the area structure.

Result: A list of existing scenes appears.

You can use the Search box to narrow the search for the scene.

Select the checkbox to the right of the scene or scenes to delete.

Click the button.

Result: A confirmation window appears.

Click Remove .

NOTE: If the scene is associated to a procedure, or if it is a subscene of another scene, you will not be able to delete it. You must first disassociate the scene from the procedure, or

EIO0000003006.12

Builder

Configuring Scenes

Attaching Documents to a Scene

Overview

If the existing documents are not related to specific positions in a scene, you can attach them to scenes without creating document points of interest. In this way, the documents can be displayed using the document browser in the App.

Attaching Documents

Step

Action

Select the SCENES tab.

Select a scene or subscene in the scene structure in the left sidebar.

Click the in the right sidebar.

Result: The Attached documents window appears containing your available project documents:

Attached documents

M340 Benefits

M340 Process

Manual Insertion Process

Manual Insertion Benefits

Manual Insertion Numbers

M580 Process

M580 Benefits

Warehouse Numbers

Cancel Validate

NOTE: The checked documents are already attached to the scene.

52 EIO0000003006.12

Step

Action

Select the checkbox for the corresponding documents.

Click Validate .

Result: The selected documents are attached to the scene.

Un-attaching Documents from a Scene

You can un-attach documents from a scene as follows:

Step

Action

Select the SCENES tab.

In the left sidebar, select the scene.

Click the in the right sidebar.

Result: The Attached documents window appears containing your available documents:

NOTE: The checked documents are already attached to the scene.

Deselect the checkbox for the corresponding attached documents.

Click Validate .

Result: The deselected documents are removed from the scene.

Builder

Adding Points of Interest to a Scene

When you have added all images to your scene, you can start to position points of interest on the scene.

EIO0000003006.12

Builder

. Refer to Adding Subscenes to a Scene, page 54

Step

Action

Drag and drop one of the icons from the toolbar onto the scene image. You can use to zoom in / out of the scene.

Subscene

Text . Refer to

Adding Texts to Scenes or Subscenes, page 58

List . Refer to

Adding Lists to Scenes or Subscenes, page 59

Variable . Refer to

Using Variables in Scenes or Subscenes, page 61

Image . Refer to

Using Images in Scenes or Subscenes, page 63

Configure the point of interest.

Repeat steps 1 and 2 to add other points of interest to the scene.

Adding Subscenes to a Scene

Overview

A subscene is a type of point of interest that appears in a scene. When the operator clicks the subscene point of interest on the tablet, an image is displayed. This image could be, for example, an electrical cabinet with the doors opened, or a zoomed-in view of part of the scene.

Points of interest can be added to a subscene in the same way as for a scene.

Creating a New Subscene

Step

Action

Select the SCENES tab.

Select a scene in the scene structure in the left sidebar.

54 EIO0000003006.12

Step

Action

Drag the Subscene icon from the toolbar and drop it on the scene image.

Result: A subscene marker appears in the scene:

Builder

Drag the marker to the exact position required in the scene.

In the right sidebar, select the subscene type:

• Image recognition . A scene that differs significantly from all the other scenes in a project, for example, a view of the factory floor.

for details.

• Fixed . A scene that does not need to be recognized, for example, a large machine which does not fit in the field of view. A static image is shown on the EcoStruxure Augmented

Operator Advisor App, without the need to be tracked.

Type a unique name for the subscene, for example “Zoom on pump area”.

If you selected Tag recognition , select the number of the tag that is physically attached to the equipment in the subscene from the drop-down menu. See

for information on naming the tag.

Add images to use for the subscene, using any of the following methods:

• Drag and drop images on the Drop images box.

• Click Upload images , browse, and select one or more images.

• For Image recognition or Fixed , click Upload folder of images ; browse and select a folder containing images. All images in the folder are uploaded. You can then select which image to use for the scene.

Optionally, activate Full screen to display the subscene image in full screen in the EcoStruxure

Augmented Operator Advisor App.

When Full screen is active, Arrange is unavailable and there is no preview of the subscene image in the EcoStruxure Augmented Operator Advisor Builder.

Click Validate .

Using an Existing Scene as a Subscene

You can use an existing scene in the SCENES tab to include it as a subscene. This will include the image from the original scene, but will not contain any of the points of interest of the original.

EIO0000003006.12

Builder

first created in the scene structure prior to be proposed as a subscene., page 47

You can add new points of interest to the copied subscene.

Step

Action

Select the SCENES tab.

Select a scene in the scene structure in the left sidebar.

Drag the Subscene icon from the toolbar and drop it on the scene image.

Result: A subscene marker appears in the scene:

In the right sidebar, clear the checkbox Create new subscene .

In the list of subscenes, choose the subscene to copy from.

The subscene needs to be

Click Validate .

Result: A link to the selected subscene is made.

Modifying Subscene Properties

Once created, you can adjust a subscene as follows:

• Move the subscene marker by dragging it to a different position on the scene image.

• Click the subscene marker to show or to hide the subscene image, and to display its properties in the right sidebar.

• Click the subscene image and drag it to a different position relative to the subscene marker, or use Arrange to modify the position of the subscene image.

56 EIO0000003006.12

• To resize a subscene image, use Arrange in the right sidebar, or do the following:

Builder

1. Move the cursor over the red triangle in the bottom right corner of the image (note that the cursor changes to a double-headed arrow).

2. Drag the mouse diagonally until the graphic is the required size.

Adding Points of Interest to a Subscene

Step

Action

Select the subscene in the project structure in the left sidebar.

If required, modify the image used or the position of the subscene in the right sidebar.

Add points of interest in the

same way as for a scene

Deleting a Subscene from a Scene

Step

Action

Right-click on the subscene in the project structure in the left sidebar and choose Remove .

Result: A confirmation window appears.

Click Remove .

NOTE:

• This only removes the subscene from the scene. The original scene remains available for use in the relevant area of your project.

• If the subscene is used inside a procedure, you will not be able to remove it. You must first disassociate the subscene from the procedure before you can delete it.

EIO0000003006.12

Builder

Adding Texts to Scenes or Subscenes

Overview

A text is a point of interest that can appear in a scene or a subscene and displays a text message.

Adding Text to a Scene or Subscene

Step

Action

Select the SCENES tab.

Select a scene or subscene in the scene structure in the left sidebar.

Drag the Text icon from the toolbar and drop it on the image.

Result: A text marker appears:

Drag the marker to the exact position required in the scene.

In the right sidebar, type a name for the text.

Enter the text label. This is the text that appears on the tablet when the operator taps the text marker.

Select the checkbox next to each property to be modified. This will override the properties defined by the theme in the App.

Enter a value from 0 to 65535 to attribute a security level to the list.

NOTE: Only operator users with a security level numerical value equal to or greater than the security level of the objects (variable, document, External App, list or procedure) may view and interact with the object. Otherwise, the object is hidden or not accessible.

Optionally, configure the Properties of the text.

Click Validate .

58 EIO0000003006.12

Removing Text from a Scene or Subscene

Step

Action

Select the SCENES tab.

In the project structure in the left sidebar, right-click on the text and choose Remove .

Result: A confirmation window appears.

Click Remove

Builder

Adding Lists to Scenes or Subscenes

Overview

When a scene is displayed on the tablet, a list point of interest appears as a list of selectable items. Each list item can be separately configured to, for example, display text, a document, the value of a variable, launch an external App, or to launch a procedure.

Adding a List to a Scene or Subscene

Step

Action

Select the SCENES tab.

Select a scene or subscene in the scene structure in the left sidebar.

Drag the List icon from the toolbar and drop it on the image.

Result: A list marker appears:

Drag the marker to the exact position required in the scene.

In the right sidebar, type a name for the list, for example “More information”.

Optionally, select Keep opened . When this option is selected, all items in the list are automatically displayed when the scene or subscene is displayed on the tablet. When not selected, only the list icon is displayed and the operator must tap the list icon to display the list items.

Enter a value from 0 to 65535 to attribute a security level to the list.

EIO0000003006.12

Builder

Configuring List Items, page 60 .

Step

Action

Optionally, select Background color and define its property. This will override the properties defined by the theme in the App.

Select the color by either:

• Clicking on the color picker box. The corresponding RGBA values appear in the adjacent text boxes.

• Typing the RGBA values of the color directly in the text boxes, for example “255,0,0,100” for red, fully opaque, or 255,255,0,50 for yellow, half transparent.

You can add up to 11 predefined colors per project.

Click the arrow to the right of Configure Information and add information in the list, as described in

Click Validate .

Adding and Configuring List Items

Step

Action

Move the mouse over the list and click the icon:

In the right sidebar, type the list item label.

Optionally, clear Show to hide the details.

Select the type of information to display when the operator taps the list item:

• Text

Enter the text you would like to appear when the operator taps the list item.

• Open document

Either select Create a document and identify the document to open, or select a previously configured

document point of interest, page 38 . You can also choose to display the

document in Full Screen or Split Screen in the EcoStruxure Augmented Operator Advisor

App.

• Open external application .

Either select Create external app and identify the App to open, or select a previously configured

external App point of interest, page 44

• Read variable

Either select Create variable and configure a variable to display, or select a previously configured

variable point of interest, page 33

EIO0000003006.12

procedure point of interest, page 68

Builder

Step Action

• Start procedure

From the list of available procedures, select a

NOTE: The required procedure must first be made available in the relevant area that is found in the PROCEDURES tab.

Optionally, you can remove individual list items by clicking the

Click Validate .

icon.

Removing a List from a Scene

Step

Action

Select the SCENES tab.

In the project structure in the left sidebar, right-click on the list and choose Remove .

Result: A confirmation window appears.

Click Remove .

Using Variables in Scenes or Subscenes

Overview

A variable is a type of point of interest. When a scene is displayed on the tablet, the real-time value of the variable appears.

Adding Variables to a Scene or Subscene

Step

Action

Select the SCENES tab.

Select a scene or subscene in the scene structure in the left sidebar.

Drag the Variable point of interest icon

Result: A variable marker appears: from the toolbar and drop it on the image.

EIO0000003006.12

Builder

Step Action

variable resource, page 33

If necessary, drag the marker to a more precise position on the image.

In the right sidebar, type a title for the variable.

Enter the variable label. This is the text that appears on the tablet when the operator taps the variable marker. You must include the characters {0} in the label. These characters are replaced by the real-time value of the variable when displayed on the tablet. The following are valid labels:

• Temperature: {0} °C

• {0} rpm

Optionally, activate Display value as float to display a specific value format in the EcoStruxure

Augmented Operator Advisor App. You can choose between Fixed-point , Scientific , or General value type and set the number of digits after the decimal point.

Optionally, clear Show to hide the variable.

Enter a value from 0 to 65535 to attribute a security level to the variable point of interest.

Optionally, select Background color and define its property. This will override the properties defined by the theme in the App.

Select the color by either:

• Clicking on the color picker box. The corresponding RGBA values appear in the adjacent text boxes.

• Typing the RGBA values of the color directly in the text boxes, for example “255,0,0,100” for red, fully opaque, or 255,255,0,50 for yellow, half transparent.

You can add up to 11 predefined colors per project.

Select the variable that contains the value to display. You can either select Create variable and define the variable to use, or select an existing

Click Validate .

Removing a Variable from a Scene or Subscene

To remove a variable from a scene or subscene:

62 EIO0000003006.12

Step

Action

Select the SCENES tab.

In the project structure, in the left sidebar right-click on the variable and choose Remove .

Result: A confirmation window appears.

Click Remove .

Builder

Using Images in Scenes or Subscenes

Overview

You can import images into a scene or subscene. These images appear in the scene when viewed on the tablet. For example, you could add an image of an arrow to indicate the position of a subscene in a scene, or display a hazard icon to warn the operator of a hazardous situation.

Adding Images to a Scene or Subscene

Step

Action

Select the SCENES tab.

Select a scene or subscene in the scene structure in the left sidebar.

Drag the Image icon from the toolbar and drop it on the image. An image marker appears:

EIO0000003006.12

If necessary, drag the marker to a more precise position on the image.

On the right sidebar, under Properties , type a name for the image, for example “Right arrow”.

Optionally, select Show . When selected, the image is initially visible when the scene or subscene is displayed on the tablet.

Add images to use for the scene, using any of the following methods:

• Drag and drop images on the Drop images box.

• Click Upload images , browse and select one or more images.

• For Image recognition only, click Upload folder of images ; browse and select a folder containing images. All images in the folder are uploaded. You can then select the image that appears in the scene or subscene.

Builder

Step

Action

Enter a value from 0 to 65535 to attribute a security level to the image point of interest.

Optionally, in the right sidebar, under Arrange , you can change the position and the dimensions of the image.

The is used to lock or unlock the aspect ratio of the image.

Click Validate .

Deleting Images from a Scene or Subscene

Step

Action

Select the SCENES tab.

In the project structure in the left sidebar, right-click on the image and choose Remove .

Result: A confirmation window appears.

Click Remove

Using Triggers

Overview

A trigger contains one or more trigger conditions. A trigger condition compares the current value of a variable to a specific value according to a test condition and performs a specified action if the test condition is true. For example, a point of interest could start flashing on the tablet whenever the value of the Speed variable is less than 100.

Creating a Trigger

Step

Action

Select the SCENES tab.

Select Triggers in the scene structure, in the left sidebar.

Result: The triggers list is displayed:

64 EIO0000003006.12

trigger conditions, page 65

Step Action

TRIGGERS

Name trg1

Description

Search: Type to search…

Object

Speed

Builder

Click .

In the right sidebar, enter the trigger name and, optionally, a description.

Select the variable to associate with the trigger. Alternatively, click Create variable , then type the variable name and select the variable type.

Click Validate .

Result: The trigger is added to the list.

Click in the triggers list to configure the

and

actions, page 66

Adding Trigger Conditions

A trigger condition is a test performed on the value of a variable. If the test result is “true”, the trigger actions are performed. If the test result is “false”, nothing happens and the next trigger condition in the list is evaluated.

To add a trigger condition:

Action Step

Select the trigger in the left sidebar and click

In the right sidebar, select an operator.

, next to Conditions .

Choose what to compare the variable to:

• Variable . Select a second variable to compare two variable values.

• Number . Type a number to compare the variable value to a numeric value.

• Text . Type characters to compare the variable value to a string value.

EIO0000003006.12

Builder

Step

Action

Click Validate .

Result: The condition is added to the list of conditions. Click necessary.

to create more conditions if

Optionally you can change the priority of the conditions by drag and drop.

Adding Trigger Actions

Action Step

Select the trigger in the left sidebar and click , next to Actions .

In the right sidebar, select what happens to the point of interest that displays the variable when the condition evaluates to “true”:

• Change visibility . The point of interest is hidden ( Hide ) or displayed ( Show ).

• Edit text . The text displayed in the point of interest is changed. You can select the default checkbox to use the default text.

• Edit text color , Change background color . The text color or the background color of the point of interest changes. You can select the default checkbox to use the default color.

Select the color by either:

◦ Clicking on the color picker box. The corresponding RGBA values appear in the adjacent text boxes.

◦ Typing the RGBA values of the color directly in the text boxes, for example “255,0,0,100” for red, fully opaque, or 255,255,0,50 for yellow, half transparent.

You can add up to 11 predefined colors per project.

• Enable blinking . The point of interest starts flashing. Type the interval between flashes, in milliseconds. For example 1000 means the point of interest flashes once every second.

• Disable blinking . An already flashing point of interest stops flashing.

With all options, you must select the scene and the point of interest where the action will be performed.

Click Validate .

Result: The action is added to the list of actions. Click to create more actions if necessary.

66 EIO0000003006.12

Removing a Trigger Condition or Action

Step

Action

Select the SCENES tab.

Select the trigger in the project structure in the left sidebar.

Move the mouse over the trigger condition or action to delete and click

Result: A confirmation window appears.

Click Remove .

Builder

Removing a Trigger

Step

Action

Select the SCENES tab.

In the project structure in the left sidebar:

1. Click Triggers to display the list of triggers.

2. Select the checkbox in the last column of the trigger or triggers to remove.

3. Click .

Alternatively, in the project structure, right-click on the trigger to remove and choose Remove .

Result: A confirmation window appears.

Click Remove .

EIO0000003006.12

Builder

Procedures

Overview

A procedure describes the steps in a task and their order of execution.

For example:

A procedure always includes:

• A Start step. This is the entry point for the procedure and is always the first step executed.

• A Stop step. This is the exit point for the procedure and is always the last step executed.

You must then add at least one of the following:

• Standard steps, such as Step 1 and Step 2 in the example above.

• Multiple choice steps, such as Is machine running?

in the example above. The operator is shown a question and two options. The next step depends on the choice the operator makes.

EIO0000003006.12

• Subprocedures. A previously created procedure that is executed within another procedure.

The order in which these steps are executed is determined by the links connecting the steps.

Builder

Creating and Deleting Procedures

Creating a Procedure

To create a new procedure:

Step

Action

Select the PROCEDURES tab.

Result: A list of existing procedures is displayed:

Either click the Procedure icon in the toolbar, or click .

In the right sidebar, type a procedure name and, optionally, a description.

Enter a value from 0 to 65535 to attribute a security level to the procedure.

Optionally, activate Training mode to make the procedure available for training in the EcoStruxure

Augmented Operator Advisor App.

Click Validate .

Result: The procedure is added to the list of procedures.

EIO0000003006.12

Builder

Deleting a Procedure

Step

Action

Select the PROCEDURES tab.

In the project structure in the left sidebar, right-click on the procedure to remove and choose

Remove .

Result: A confirmation window appears.

Click Remove .

Configuring Procedures

Configuring a Procedure

To configure a procedure:

70 EIO0000003006.12

Connect the steps together, page 72

Step

Action

Select the PROCEDURES tab and click configure.

Result: A procedure diagram is displayed: in the Diagram column of the procedure to

Builder

Drag and drop the required step icons from the toolbar onto the procedure chart.

Configure the steps:

•

Standard steps, page 73

•

Multiple choice steps, page 74

•

Subprocedures, page 75

When the procedure is complete, save your changes.

Result: The procedure is added to the list of procedures.

Tips for Working with Procedures

Click and drag a step to move a step to a different position.

Click a step to select it. You can then configure its properties in the right sidebar, or press

Delete to remove it from the procedure.

EIO0000003006.12

Builder

Use the central scroll button on the mouse to zoom in or out of the procedure.

Connecting Standard Steps, Multiple Choice Steps, and

Subprocedures

Step

Action

Move the mouse over the step.

Result: Two connection handles appear. A standard step has 2 connection handles:

2 Move the mouse over the top connection handle and drag the mouse towards another step in the procedure until an arrow appears. For example, to connect a standard step to the Start step:

72 EIO0000003006.12

Configuring a Multiple Choice Step, page 74 .

Builder

Step

Action

Similarly, you can move the mouse over the bottom connection handle and drag down to make a connection to the next step to be executed. For example:

4 Multiple choice steps have 3 connection handles:

• One to connect to the previous step.

• One to connect to the next step when Option 1 evaluates to “true”.

• One to connect to the next step when Option 2 evaluates to “true”.

Refer to

Configuring a Standard Step

Step

EIO0000003006.12

Action

Click the standard step box to select it and display its properties in the right sidebar.

Type the step label: the text that appears when the procedure step appears on the tablet.

Optionally, type a short description of the step. This description appears when the list of procedures is displayed.

Builder

step to appear when the operator user is in front of a specific scene, page 75 .

Step

Action

In the Sticker box, enter the action to be performed by the operator.

Select the sticker position. This is the area of the tablet screen that the sticker appears on. For example, choose Top right to display the step in the top right corner of the tablet.

Optionally, select Attach content and define any content to associate with the step. This can be to open a document or an external application, or to display the real-time value of a variable.

Optionally, select Attach to scene if you only want the

NOTE: When the step is executed, the points of interest of the scene attached to the step will

only be visible if they are associated to that step, page 76 .

Click Validate .

Configuring a Multiple Choice Step

Step

Action

Click the multiple choice step box to select it and display its properties in the right sidebar.

Type the step label: the text that appears when the procedure step appears on the tablet.

Optionally, type a short description of the step. This description appears when the list of procedures is displayed.

In the Sticker box, enter the question that the operator is to reply to, and the two reply options,

Option 1 and Option 2 .

When the operator taps the left option, the step connected to the left connection handle appears next.

When the operator taps the right option, the step connected to the right connection handle appears next.

Select the sticker position. This is the area of the tablet screen that the sticker appears on. For example, choose Top right to display the step in the top right corner of the tablet.

Optionally, select Attach to scene if you only want the

step to appear when the operator user is in front of a specific scene, page 75 .

NOTE: When the step is executed, the points of interest of the scene attached to the step will only be visible if they are

associated to that step, page 76 .

Click Validate .

74 EIO0000003006.12

Builder

Configuring a Subprocedure

A subprocedure is a previously created procedure that is run before continuing with the next step.

Step

Action

Click the subprocedure box to select it and display its properties in the right sidebar.

Type the step name.

Optionally, type a short description of the step. This description appears when the list of procedures is displayed.

Select an existing procedure to run.

Click Validate .

Attaching a Scene to a Procedure Step

You can attach a scene to a procedure step.

The required scene must first be made available in the relevant area that is found in the

PROCEDURES tab:

Step

Action

Select the PROCEDURES tab.

Under Scenes , in the left sidebar, select the area where you want the scene to be available.

Click in the toolbar.

Either select an existing scene from the list, or you can create a new scene to be added.

You can then attach the scene to your procedure step as follows:

Step

Action

Select the PROCEDURES tab.

Select the required procedure in the left sidebar.

Select the step where the scene will be attached.

Select the checkbox Attach to scene and choose the scene from the list.

EIO0000003006.12

Builder

Step

Action

Optionally, activate Full screen to display the attached scene in full screen without needing to recognize it.

Click Validate .

Result: The attached scene is displayed in the bottom right corner of the main screen.

Adding Points of Interest to a Scene in a Procedure Step

Points of interest are not shared between the SCENES tab and the PROCEDURES tab.

You can add points of interest to a scene that will only be visible when the scene is used in a procedure:

Step

Action

Select the PROCEDURES tab.

Select the required scene in the scene structure in the left sidebar.

Drag and drop one of the icons from the toolbar onto the scene image:

Text .

List .

Variable .

Image .

Configure the point of interest.

Repeat steps 1 and 2 to add other points of interest to the scene.

Associating the Points of Interest of an Attached Scene to a Step

Only points of interest that are associated to a step are visible when that step is executed.

You can associate or disassociate points of interest to a step as follows:

EIO0000003006.12

Additional Information ..............................................................84

Builder

Step

Action

Select the PROCEDURES tab.

Select the required procedure in the left sidebar.

Result: The associated diagram appears.

In the diagram, select a step with an attached scene.

Result: The attached scene is displayed in the bottom right corner of the main screen.

Click the attached scene.

Result: The attached scene and its points of interest are displayed.

NOTE:

• Points of interest that are not yet attached to the step are semi-transparent.

• You can also filter which points of interest are displayed in the scene. Select an option in the Point of interest filter box:

◦ All (default value)

◦ Displayed in step

◦ Associated to step

Right-click on a point of interest to create or cancel an association with the step.

NOTE: You can also add new points of interest to the attached scene.

Removing a Scene from a Procedure Step

Step

Action

Select the PROCEDURES tab.

Select the procedure in the project structure in the left sidebar.

Select the step.

Clear the checkbox Attach to scene .

Click Validate .

EIO0000003006.12

Builder

Remote Experts

Overview

A remote expert is an individual or a team of experts that operators can contact, when using the EcoStruxure Augmented Operator Advisor App, to assist them in their operations.

In the REMOTE EXPERTS tab, up to 10 experts can be assigned per project. These experts can then be contacted remotely through the Remote Assist icon in the EcoStruxure

Augmented Operator Advisor App.

Assigning Remote Experts

To assign a remote expert to a project:

Step

Action

Open the REMOTE EXPERTS tab.

Tap the icon.

In the right sidebar, type the expert ID (the email or identifier used for Microsoft Teams).

Click Validate .

Modifying Remote Experts Properties

Once created, you can adjust the list of experts as follows:

• Click the arrows next to each expert ID to move it up or down the list.

• Select an expert on the list, then in the right sidebar, modify the expert ID.

Removing Remote Experts

To remove an expert from the list:

78 EIO0000003006.12

Remote Experts

Step

Action

Select the checkbox to the right of the expert ID to be removed.

Click the

Click Remove .

icon.

Builder

EIO0000003006.12

Builder

Building a Project

Building Projects

Overview

When you have finished defining scenes, you can build the project. After building the project, import the built file to the EcoStruxure Augmented Operator Advisor Runtime. The project is then available for use on the EcoStruxure Augmented Operator Advisor App. If you have included translations in your project, these are included in your project file.

Building a Project

Step

Action

Click the Build icon on the project toolbar.

Result: The Build project window appears.

The Build project window indicates the last time the project was built, and includes a checkbox to

Rebuild all .

• If you select this checkbox, the project is completely rebuilt.

• If you do not select this checkbox, the project is built by integrating recent modifications into the previous existing build.

If you have activated the Local projects add-on license (see EcoStruxure Augmented Operator

Advisor, Quick Start Guide), you also have a checkbox Allow unlimited local mode , selected by default.

Click Start Build .

Result: The Build window appears:

80 EIO0000003006.12

Building a Project

Builder

Step

Action

Building is complete when the horizontal progress bar reaches 100%.

Click Download to download the project file to the local PC.

Result: The project file is stored as a .zip file in the download folder of your browser.

Click Close to close the Build window.

Refer to the Getting Started (see EcoStruxure Augmented Operator Advisor, Quick Start Guide) for information on how to deploy the project.

EIO0000003006.12

Builder

Appendices

What’s in This Part

EIO0000003006.12

Builder

Additional Information

What’s in This Chapter

How to Choose Between Image and Tag Recognition .................84

Guidelines for Taking Photographs ............................................87

Tagging Equipment ..................................................................87

Limitations...............................................................................91

Translations.............................................................................93

How to Choose Between Image and Tag

Recognition

Overview

Depending on the nature of the equipment being imaged and its surrounding environment, the following detection methods can be utilized for the EcoStruxure Augmented Operator

Advisor App:

• Image recognition: compares the complete image used in the EcoStruxure Augmented

Operator Advisor Builder scene with the real scene.

• Tag recognition: used when image recognition is unsuccessful. The EcoStruxure

Augmented Operator Advisor App searches the real scene for a known, uniquely identifiable tag. These tags are built into the EcoStruxure Augmented Operator Advisor

Builder library.

There are a number of criteria that need to be considered when deciding if image or tag recognition should be used.

First, you should consider the environment. Is the environment stable or a changeable one?

Stability in this case refers to the equipment in the scene as viewed from this particular viewpoint. As we require a close match between the real scene and photo reference, a big object added to or missing from the real scene can impact the detection.

Another consideration is the detail in the image. Does the equipment have some identifiable and unique detail features in the scene that enable it to be both recognizable and correctly identified? Tag recognition should be considered in cases where there are few details, or if the equipment in the scene is similar to other scenes or objects.

84 EIO0000003006.12

CAUTION

FALSE SCENE DETECTION

• Use tags in situations where similar equipment and/or environments could result in false scene detection.

• Attach tags firmly to the equipment with sufficient protection against damage or deterioration of the tag.

Failure to follow these instructions can result in injury or equipment damage.

Builder

Image Recognition

In the image recognition method, the real image of the equipment is compared with the photo reference in the scene of the EcoStruxure Augmented Operator Advisor project.

Image recognition is suitable in the following instances:

• When the equipment being imaged and its environment are stable, which means:

◦ The equipment being imaged does not change.

◦ There is no movement of other objects or people around the equipment being imaged.

• When the equipment being imaged has some unique identifiable details that can enable correct identification.

• When the equipment or scene is significantly different from other objects or scenes in a project.

You can also take additional photos of parts of equipment to improve detection in the following instances:

• When the equipment being imaged is moving or in a changing environment.

• When there are people or other objects moving in the camera’s field of view.

Tag Recognition

In the tag recognition method, detection is made possible by attaching tags to the equipment being imaged. The tag is a uniquely identifiable object that is placed in the scene to enable detection.

Tag recognition method is suitable in the following instances:

• When image recognition or partial-image recognition methods do not yield satisfactory results.

EIO0000003006.12

Builder

Guidelines for Taking Photographs, page 87 .

• When some of the scenes or equipment being imaged may not be easily identified. For example, in a row of machines, tags must be printed and attached to the machines to assist EcoStruxure Augmented Operator Advisor to uniquely identify the scene and display the appropriate points of interest.

• When the equipment is in a poorly or very brightly lit area that prevents taking highcontrast photographs.

Procedure to Follow

Follow this procedure to get the best results for image recognition:

Step

Action

Take a sample photo of the equipment for the image recognition technique.

Consider taking additional sample photos if the equipment is kept outdoors or under a transparent roof, where shadows can be seen on the equipment.

For information on how to take photographs for the image recognition method, refer to

Place three points of interest inside the Builder scene placed in a triangular layout.

Build the project and copy it to the runtime device.

Go to the same position used to take the sample photo and try using EcoStruxure Augmented

Operator Advisor App to recognize the scene.

Recognition is attained when the points of interest are shown as overlaid on the scene and remain there in the correct position and in a stable manner.

Take new sample photographs of the equipment with a different background, and repeat steps 1 to

4. For example, if it is practical, you could rotate the equipment by 90° about the vertical axis.

Otherwise, you could take photographs of similar equipment in a different environment. Take a sample photo from a viewpoint with the same zoom, distance and height to confirm recognition.

If the equipment is not recognized after step 5, take additional sample photos of parts of the equipment (partial-image recognition), and perform steps 1 to 5 again.

If the equipment is not recognized after step 6, attach tags and repeat steps 1 to 5. For more information on tags, refer to

Tagging Equipment, page 87 .

86 EIO0000003006.12

Guidelines for Taking Photographs

Builder

Overview

The EcoStruxure Augmented Operator Advisor App recognizes items of equipment using

Augmented Reality.

Photograph Guidelines

The following guidelines apply to photographs:

• Take photographs using the integrated camera of the tablet. This means that the optical aspect of the objects should be similar when detection will take place. Detection generally works better if the detection point is at the same point or further away than the original image. If the detection point is closer, then parts of the detection are removed from the field-of-view and we reduce the match criteria.

• The equipment in the image should contain a number of identifiable and unique objects.

• Refer to

for information on the image resolution. The higher the resolution, the better the image recognition.

• On identical items of equipment,

attach tags, page 87

before taking the photograph.

• Take multiple photographs of the scene with a 30° horizontal angle of separation to improve the match criteria.

• Fill the scene with the primary object. This includes taking close up views of subassemblies or components of the equipment.

• Take photos at 1.6 m height. Take additional images if the user will be viewing the scene from lower down or higher up.

• The more detail, contrast, and sharp changes in color are available on the photo, the more successful detection will be.

NOTE: More photos will lead to better detection and tracking, especially with varying light conditions. A minimum of 300 lux is recommended.

Tagging Equipment

Overview

To avoid potential identification errors, you can attach tags to the items of equipment or place tags somewhere in the scene. When the EcoStruxure Augmented Operator Advisor

EIO0000003006.12

Builder

App running on the tablet scans a scene, it recognizes the tags and displays the correct points of interest.

EcoStruxure Augmented Operator Advisor is supplied with a tag library. The tags are numbered, and the tag number is both visible in clear text on the code and encoded into the graphic.

Calculating the Size of Tag to Print

The size of the printed tag you attach to the scene or item of equipment depends on several factors:

• The distance of the operator using the tablet from the tag.

• The viewing angle.

88 EIO0000003006.12

Use the following graphic to determine the print size to use:

Builder

For example, if the operator will be approximately 2.5 meters (approximately 8.2 ft ) away and directly in front of the item of equipment (0° viewing angle), use a 15 cm by 15 cm ( 5.9

inches by 5.9 inches ) tag.

Using a Tag

Follow these rules when using tags:

• Place the tag on a solid flat surface or on a window.

• Do not use a tag in an environment with a grid or a mesh: the detection can be very slow or impossible, as the software will have difficulty differentiating between the tag and the grid/mesh.

• Reference photos must be taken directly in front of the tag. The photo plane must be parallel to the tag plane for best results.

EIO0000003006.12

Builder

Calculating the Size of Tag to Print, page 88

• The detection camera plane must be also parallel to the tag plane. If a tag is placed at the top of a scene, consider tilting the tag downward to respect this parallelism. Any deviation from parallel of this photo will reduce the probability of tag detection.

• When identifying the tag placement in the images, align the dotted lines between the four red crosses with the edge of the tag itself, as follows:

Follow this procedure for using tags:

Step

Action

Identify all the scenes and items of equipment that require tags. Note that you cannot use the same tag in two different scenes within the same Area.

Select the tag number to use for each scene.

Access the relevant tag file by selecting Download Tags , which can be accessed by clicking on the icon in the EcoStruxure Augmented Operator Advisor Builder menu.

NOTE: Tags are available from previous versions of the EcoStruxure Augmented Operator

Advisor, but it is recommended to use the latest tags from the current version.

Print the file at the size calculated in

above.

Carefully cut out the tag using scissors. Cut just outside the black border.

Attach the tag to the front of the item of equipment.

Keep a record of which tag is attached to which item of equipment.

Repeat steps 1...6 for all other items of equipment to be tagged.

Take photographs of the items of equipment. Refer to

Guidelines for Taking Photographs, page 87 .

Import the images into EcoStruxure Augmented Operator Advisor Builder.

Identify the tag placement in the images by aligning the dotted lines between the four red crosses with the edge of the each tag.

Add points of interest as required.

EIO0000003006.12

Limitations

Builder

Overview

The following describes the maximum number of elements that you should use in a project to avoid issues with system performance. This is independent from license limitations.

Projects and Areas

Element

Areas in a project

Languages in a project

Project/Backup size

Characters in email addresses

Maximum Number

100

600 MB

255

Points of Interest

Element

Points of interest in a scene

Points of interest in a project

Variables in a project

List items in a List point of interest

Characters in labels/names

Characters in descriptions

Maximum Number

5000

1000

255

Scenes

Element

Scenes in a project

Subscene levels

Subscenes in a scene

EIO0000003006.12

Maximum Number

100 (1)

Builder

Element

2D images in a project

Tags in a project

Characters in labels/names

Characters in descriptions

(1) 100 images in 1 scene, or 100 scenes with 1 image

Maximum Number

100

255

Resources

Element

Image resolution

Image file

Supported document format

Supported video format

Supported audio format

Description

4096 x 4096 pixels maximum

PNG or JPG. 2 MB maximum, RGB color model only

PDF. 20 MB maximum

MP4. 20 MB maximum

Recommend AVC video codec (h264 or x 264) at 25 fps or 30 fps and Audio channel with AAC audio codec.

MP3. 20 MB maximum

Recommend variable bit rate (quality 0 to 9) or constant bit rate at 16 to 320 kb/s.

Procedures

Element

Procedures in a project

Subprocedures in a procedure

Branches in a procedure

Steps in a procedure

Characters in labels/names

Characters in descriptions

(1) Subprocedures cannot contain nested subprocedures

100

255

Maximum Number

100

10 (1)

92 EIO0000003006.12

EcoStruxure Augmented Operator Advisor App

Element

Notes added to a scene

Characters in a note

Attachments in a note

Favorites in an area

Maximum Number

255

Variables

Element

Characters in variable name

Characters in labels/names

Characters in descriptions

Maximum Number

128

255

Builder

Translations

Overview

You can translate the project into other languages, and can incorporate translations of all labels and texts in your project.

You can also incorporate translated versions of your documents if you already have translated versions of the files available.

The use of Arabic language is possible but with limited support.

Translating a Project

Follow this procedure to translate a project:

EIO0000003006.12

Builder

Step

Action

Open up the project in EcoStruxure Augmented Operator Advisor Builder. In the right sidebar, under Supported languages , select the country flag representing the language you want to add, and click .

Result: The flags of each of the chosen languages appear beside the reference language flag.

Click Validate to confirm your language selections.

Click the Translation icon under the AREAS tab to open the TRANSLATE PROJECT screen.

4 Use the Text translations tab to manage translations of all labels and texts in your project. Under

Export to translate , select the translation language and click Export .

EIO0000003006.12

Step Action

Builder

A .csv file is generated, which you can send to the translation agency.

NOTE: Do not modify the structure of the .csv file:

• You should only insert the translations of the relevant texts after the comma in each line.

• You may find some labels for elements that have been deleted from your project.

When the translated .csv file is returned by the translation agency, copy it to a known directory on your PC.

EIO0000003006.12

Builder

Step

Action

Upload the translated .csv file into the EcoStruxure Augmented Operator Advisor Builder, by clicking under Import translation .

If the .csv file selected is of a valid format, a message csv format is valid appears, you can continue to the next step.

If the .csv file is of an incorrect format, a message appears indicating that the file format is invalid, with some details on the reason why. In that case, you have to correct any format errors in the .csv

file before continuing.

NOTE: In .csv files, the comma character is used as separator between the source language text and the translated text. Do not use a comma as a normal character in the text. If you need to include a comma in the text, enter the escape character "\" before any comma.

Click Import .

The message Translations have been successfully imported appears on your screen to confirm that the translated texts have been imported into your project.

Importing the Translations of Project Documents

Follow this procedure to import the translations of the project documents:

96 EIO0000003006.12