Schneider Electric EcoStruxure Augmented Operator Advisor Quick Start Guide
Below you will find brief information for EcoStruxure Augmented Operator Advisor. This guide helps you get started with EcoStruxure Augmented Operator Advisor, a technology that uses augmented reality to optimize the operation and maintenance of industrial sites and equipment. You can monitor areas, scenes, and procedures using points of interest overlaid on a live scene, accessing process variables, documents, and more.
Advertisement
Advertisement
EcoStruxure Augmented Operator
Advisor
Quick Start Guide
EIO0000003000.12
06/2022 www.se.com
Legal Information
The Schneider Electric brand and any trademarks of Schneider Electric SE and its subsidiaries referred to in this guide are the property of Schneider Electric SE or its subsidiaries. All other brands may be trademarks of their respective owners.
This guide and its content are protected under applicable copyright laws and furnished for informational use only. No part of this guide may be reproduced or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), for any purpose, without the prior written permission of Schneider Electric.
Schneider Electric does not grant any right or license for commercial use of the guide or its content, except for a non-exclusive and personal license to consult it on an "as is" basis.
Schneider Electric products and equipment should be installed, operated, serviced, and maintained only by qualified personnel.
As standards, specifications, and designs change from time to time, information contained in this guide may be subject to change without notice.
To the extent permitted by applicable law, no responsibility or liability is assumed by
Schneider Electric and its subsidiaries for any errors or omissions in the informational content of this material or consequences arising out of or resulting from the use of the information contained herein.
As part of a group of responsible, inclusive companies, we are updating our communications that contain non-inclusive terminology. Until we complete this process, however, our content may still contain standardized industry terms that may be deemed inappropriate by our customers.
Table of Contents
Presentation of EcoStruxure Augmented Operator Advisor........................................ 11
Installing EcoStruxure Augmented Operator Advisor.................................................24
EcoStruxure Augmented Operator Advisor Builder....................................................27
Installing the EcoStruxure Augmented Operator Advisor Runtime ..............................30
Glossary
EIO0000003000.12
3
Safety Information
Important Information
Read these instructions carefully, and look at the equipment to become familiar with the device before trying to install, operate, service, or maintain it. The following special messages may appear throughout this documentation or on the equipment to warn of potential hazards or to call attention to information that clarifies or simplifies a procedure.
The addition of this symbol to a “Danger” or “Warning” safety label indicates that an electrical hazard exists which will result in personal injury if the instructions are not followed.
This is the safety alert symbol. It is used to alert you to potential personal injury hazards. Obey all safety messages that follow this symbol to avoid possible injury or death.
!
DANGER
DANGER indicates a hazardous situation which, if not avoided, will result in death or serious injury.
!
WARNING
WARNING indicates a hazardous situation which, if not avoided, could result in death or serious injury.
!
CAUTION
CAUTION indicates a hazardous situation which, if not avoided, could result in minor or moderate injury.
NOTICE
NOTICE is used to address practices not related to physical injury.
EIO0000003000.12
5
Please Note
Electrical equipment should be installed, operated, serviced, and maintained only by qualified personnel. No responsibility is assumed by Schneider Electric for any consequences arising out of the use of this material.
A qualified person is one who has skills and knowledge related to the construction and operation of electrical equipment and its installation, and has received safety training to recognize and avoid the hazards involved.
About the Book
Document Scope
This document describes how to get started with EcoStruxure Augmented Operator Advisor.
It is recommended that you undertake an EcoStruxure Augmented Operator Advisor training course before using the product.
6
Validity Note
This document is valid for Version 2.9 of EcoStruxure Augmented Operator Advisor.
For product compliance and environmental information (RoHS, REACH, PEP, EOLI, etc.), go to www.se.com/ww/en/work/support/green-premium/ .
The technical characteristics of the devices described in the present document also appear online. To access the information online, go to the Schneider Electric home page www.se.
com/ww/en/download/ .
The characteristics that are described in the present document should be the same as those characteristics that appear online. In line with our policy of constant improvement, we may revise content over time to improve clarity and accuracy. If you see a difference between the document and online information, use the online information as your reference.
Registered trademarks:
• EcoStruxure
™
, Vijeo
™
, and Harmony
™ are registered trademarks of Schneider Electric.
• Chrome
™
, Google Pixel C
™
, and Android
™ are registered trademarks of Google LLC.
• Microsoft Edge
™
, and Windows
™ are registered trademarks of Microsoft Corporation.
• Firefox
™ is a registered trademark of The Mozilla Foundation.
EIO0000003000.12
• iOS
™ and iPad
™ are registered trademarks of Apple.
• Samsung Galaxy
™ is a registered trademark of Samsung Electronics Co Ltd.
• Intel
®
Core
™ is a registered trademark of Intel Corporation.
• Linux
® is a registered trademark of Linus Torvalds.
EIO0000003000.12
7
8
Related Documents
Title of documentation
EcoStruxure Augmented Operator Advisor Builder
User Manual
EcoStruxure Augmented Operator Advisor Runtime
User Manual
EcoStruxure Augmented Operator Advisor App User
Manual
Reference number
EIO0000003006 (ENG)
EIO0000003007 (FRE)
EIO0000003008 (GER)
EIO0000003009 (SPA)
EIO0000003010 (ITA)
EIO0000003011 (CHS)
EIO0000003033 (JPN)
EIO0000003564 (KOR)
EIO0000003606 (ENG)
EIO0000003607 (FRE)
EIO0000003608 (GER)
EIO0000003609 (SPA)
EIO0000003610 (ITA)
EIO0000003611 (CHS)
EIO0000003612 (JPN)
EIO0000003613 (KOR)
EIO0000003598 (ENG)
EIO0000003599 (FRE)
EIO0000003600 (GER)
EIO0000003601 (ESP)
EIO0000003602 (ITA)
EIO0000003603 (CHS)
EIO0000003604 (JPN)
EIO0000003605 (KOR)
You can download these technical publications, the present document and other technical information from our website www.se.com/en/download/ .
EIO0000003000.12
Product Related Information
The application of this product requires expertise in the design and operation of control systems.
WARNING
LOSS OF CONTROL
• The designer of any control scheme must consider the potential failure modes of control paths and, for certain critical control functions, provide a means to achieve a safe state during and after a path failure. Examples of critical control functions are emergency stop and overtravel stop.
• Separate or redundant control and monitoring paths must be provided for critical control functions.
• System control and monitoring paths may include communication links. Consideration must be given to the implications of unanticipated transmission delays or failures of the link.
• EcoStruxure Augmented Operator Advisor must not be used as a primary means of monitoring critical control functions.
• Each EcoStruxure Augmented Operator Advisor implementation must be individually and thoroughly tested for proper operation before being placed into service.
Failure to follow these instructions can result in death, serious injury, or equipment damage.
WARNING
PROCEDURE NOT COMPLETED
Before launching a procedure, ensure that your battery is sufficiently charged to complete the operation.
Failure to follow these instructions can result in death, serious injury, or equipment damage.
WARNING
UNINTENDED EQUIPMENT OPERATION
• Allow only authorized personnel with expertise in the design and operation of control systems to program, install, alter, and apply this product.
• Follow local and national safety codes and standards.
Failure to follow these instructions can result in death, serious injury, or equipment damage.
EIO0000003000.12
9
WARNING
LOSS OF INFORMATION
Ensure that the information to be displayed to the operator is adapted to the size of the display device, especially for smartphones.
Failure to follow these instructions can result in death, serious injury, or equipment damage.
CAUTION
FALSE SCENE DETECTION
• Use tags in situations where similar equipment and/or environments could result in false scene detection.
• Attach tags firmly to the equipment with sufficient protection against damage or deterioration of the tag.
Failure to follow these instructions can result in injury or equipment damage.
NOTICE
UNAUTHORIZED OPERATOR ACCESS
• Keep user names and passwords secret.
• Protect tablet and runtime device access with a password or other security mechanism.
• Do not share access with others.
• Change default passwords upon first connection.
• Regularly update passwords.
• Apply relevant local IT rules.
• Do not save confidential information in post-its or notebooks.
• Do not attach confidential or sensitive user documents in projects.
Failure to follow these instructions can result in equipment damage.
Important Information
The following algorithms are used for encryption: RSA, AES, SHA-256.
10 EIO0000003000.12
Presentation of EcoStruxure Augmented Operator
Advisor
Overview
EcoStruxure Augmented Operator Advisor uses a technology called augmented reality to optimize the operation and maintenance of industrial sites and equipment:
• The operator points a tablet computer at the site or equipment to be monitored.
• EcoStruxure Augmented Operator Advisor uses special image comparison techniques to match the scene visible in the field of view of the tablet camera with previously stored photographs of the same scene.
• When a match is made, markers called points of interest are overlaid on the live scene visible on the tablet.
• The operator taps the point of interest markers to display information. A wide variety of information can be displayed, including:
◦ Process variables
◦ Values extracted from an SQL database
◦ Documents, instruction sheets or wiring diagrams
◦ Web pages
◦ Videos
◦ Audio
◦ Procedures
You can also view all the information overlaid on the stored images of the site or equipment to be monitored without being physically in front of it.
EIO0000003000.12
11
12
EcoStruxure Augmented Operator Advisor introduces a number of other key concepts:
• An area is a zone within each site or building (such as production lines, plant rooms, storage areas, workshops, laboratories, and office areas) that you want to monitor using
EcoStruxure Augmented Operator Advisor.
NOTE: The number of areas you can monitor depends on the
type of license you purchase, page 24 .
• Scenes are things to monitor within an area, for example, machines, electrical cabinets, or production lines.
• Subscenes are a part of a scene, typically a close up view of a particular area of the scene. A subscene can contain its own points of interest.
• Procedures are a set of instructions that the operator must carry out in a predefined order to complete the task. Instructions can include scenes that must be recognized by the EcoStruxure Augmented Operator Advisor App using augmented reality.
NOTE: Procedures are only available with particular
.
• A project is a container for all the information in areas, scenes, subscenes and procedures.
EIO0000003000.12
Components of EcoStruxure Augmented Operator
Advisor
EcoStruxure Augmented Operator Advisor is made up of the following main components:
• EcoStruxure Augmented Operator Advisor Builder, an application running in the cloud.
• EcoStruxure Augmented Operator Advisor Runtime, a server-based Windows software.
• EcoStruxure Augmented Operator Advisor App, an application running on a tablet computer.
SQL Server
Scada
Station
OR
Edge
HMI
Box
PLC
Harmony GTU, Box PC,
P6, or Standard PC
EcoStruxure
Augmented Operator
Advisor
Runtime and Manager
Tablet
EcoStruxure
Augmented Operator
Advisor
App
For the EcoStruxure Augmented Operator Advisor App to be able to communicate with the
EcoStruxure Augmented Operator Advisor Runtime component, both must be connected to the same WiFi network or 3G/4G mobile network.
To view the real-time values of process variables produced by the equipment being monitored, one of the following applications must also be installed:
•
•
EcoStruxure Operator Terminal Expert, page 20
The solution also includes a Web-based management tool, EcoStruxure Augmented
Operator Advisor Manager.
EcoStruxure Augmented Operator Advisor Builder
The EcoStruxure Augmented Operator Advisor Builder is an application running in the cloud. The user creates projects, within which areas, scenes and procedures are defined.
EIO0000003000.12
13
A scene is a high-resolution photograph, onto which points of interest are positioned and the information to be displayed is configured.
John Doe
Augmented Operator Advisor Builder
AREAS SCENES PROCEDURES REMOTE EXPERTS
Scene Subscene
IMG_0015 water_plant_outdoor water_plant_outd...
Triggers
Area 1
Cabinet
Cabinet_view
Text
Altivar
Subscene1
Subscene2
DocumentPic
MyList
MyList2
Subscene1
Cabinet02Open
Triggers
List Variable Image
List
Altivar
Show
Keep opened
0
Security Level
Properties
Background color:
Configure Information
Validate
Cancel
When all scenes have been defined, the project must be built and then imported to the device where the EcoStruxure Augmented Operator Advisor Runtime is installed.
EcoStruxure Augmented Operator Advisor Runtime
EcoStruxure Augmented Operator Advisor Runtime is installed on a Harmony GTU Open
Box PC, Harmony iPC / Industrial PC, or standard Windows PC. It gathers together all the information to be displayed in the points of interest and sends it to be displayed by the
EcoStruxure Augmented Operator Advisor App. It also manages the database containing the photographs of scenes and equipment contained in the project.
EcoStruxure Augmented Operator Advisor App
The EcoStruxure Augmented Operator Advisor App views reality (what the operator sees using the camera integrated in the tablet) and compares it to photographs of scenes stored in the EcoStruxure Augmented Operator Advisor project. The scene being viewed by the camera and the stored image must match for detection to occur.
14 EIO0000003000.12
After a scene has been recognized by the App, the following user interface controls can be used :
Scenes
3
2
1
3
4
5
Legend Name
1 Settings
2 Favorites
Document browser
Action
Note
EIO0000003000.12
4
5
6
7
Description
Tap to display the Settings menu.
Tap to display or hide the Favorites bar at the top of the screen. Information about the scene is updated in the Favorites bar even when the scene is frozen, or if the point of interest is closed, or if another scene is being viewed.
Tap to open or close the built-in document browser (see EcoStruxure Augmented
Operator Advisor, App, User Manual).
When the cross in the center of the screen is over a point of interest, tap to launch the corresponding action (display a document, open a subscene,...).
Tap to add a note on the scene. Tap and hold to add a note with your latest screenshot attached to it. This can be used, for example, to leave information for other operators. Tap the note attachment to display it in full screen.
Tap to edit the note if you want to modify or remove it. If you remove it from the App, the note remains available in the EcoStruxure Augmented Operator
Advisor Manager.
You can add up to 10 notes in a scene. Each note can contain up to 255 characters and up to 3 attachments (20 MB maximum).
NOTE: If the App is not connected to the EcoStruxure Augmented Operator
Advisor Runtime while creating the note, the note is saved locally on the tablet. A notification is available in the notification center to inform you about
15
6
7
Legend Name
Screenshot
Freeze
Description this temporary state. When the connection is reestablished, the note is uploaded automatically to the EcoStruxure Augmented Operator Advisor
Runtime.
Tap to make a screenshot of the scene. The screenshot is saved locally and it can be attached to a note.
Tap to freeze the display, this allows you to put down or lower the tablet and still see the scene and points of interest. Project actions continue and the
Favorites bar continues to be updated.
16 EIO0000003000.12
The other components of the user interface are as follows:
1
Scenes
2 3 4
Legend Name
1
2
3
4
Home
Notification center icon
Description
Tap to return to the Home page.
Indicates a message from the Notification center.
Tap to display the notification messages.
Indicates whether the App is connected to the runtime device (black icon on a white background) or not connected (flashes red).
Connection to the runtime device
Remote Assist icon
Tap to display the list of assigned experts.
Click an expert ID to open the Dynamics 365 Remote Assist application and contact the expert.
NOTE: The Dynamics 365 Remote Assist application has to be installed on the same tablet.
Remote Assist is available on Android and iOS tablets.
EIO0000003000.12
17
3
2
A point of interest is a position in a scene for which additional diagnostic or technical information is available. Various types of points of interest can be displayed as follows:
4
Scenes
5
6
1
18
4
5
6
1
2
3
Variable point of interest
Display the real-time value of the variable.
Tap next to the point of interest to add the information item to the Favorites bar at the top of the screen.
Tap to display the selected subscene.
Subscene
Favorite bar Regroups all your favorite points of interest and allows you to quickly access your information. You can add up to 10 favorites in an area.
NOTE: Information displayed in the favorite bar is not updated by points of interest settings such as font size, color, or theme.
List point of interest
Tap to display a list of information items, such as process variables or documents.
Procedure item Tap to launch the procedures (see EcoStruxure Augmented Operator Advisor,
App, User Manual).
Image point of interest
An image overlaid on the scene image.
EIO0000003000.12
Alternatively, if the tablet is not in front of the equipment to be monitored, the EcoStruxure
Augmented Operator Advisor App can view the available scenes and procedures contained in the project. When you open a scene, an image of the scene with the points of interest is displayed, the real-time values of process variables are generated and the triggers associated with the scenes are still active as if you are monitoring the equipment with a camera. It also displays the documents attached to an area or scenes in the document browser, in a split screen.
Area
Scene
EIO0000003000.12
19
Node-RED
Node-RED is an open source, visual programming tool that requires few or no programming skills. It uses pre-programmed, reusable blocks of code called nodes. Nodes are wired together to create flows of data.You can connect Node-RED flows to points of interest to display SQL database values in your augmented reality applications.
If you are going to use Node-RED, download it from nodered.org and install it on the runtime device (see EcoStruxure Augmented Operator Advisor, Runtime, User Manual).
The EcoStruxure Augmented Operator Advisor Runtime is compatible with the Node.js 14.
x
LTS, as recommended by Node-RED.
EcoStruxure Augmented Operator Advisor nodes can be found in Start > EcoStruxure
Augmented Operator Advisor > Runtime Nodes Folder
EcoStruxure Operator Terminal Expert (or Pro-face
BLUE)
EcoStruxure Operator Terminal Expert is human machine interface (HMI) configuration software that enables you to create and edit application panels to control automation systems for the Harmony HMI range, for example, the GTU terminal (Premium and Open boxes) and Harmony industrial PCs (panel and box).
20 EIO0000003000.12
You can display values from EcoStruxure Operator Terminal Expert / Pro-face BLUE variables in EcoStruxure Augmented Operator Advisor.
Supported versions are EcoStruxure Operator Terminal Expert / Pro-face BLUE 3.2.
If possible, do not modify the EcoStruxure Operator Terminal Expert / Pro-face BLUE localhost configuration. If modifications are required, you must install an SSL certificate that matches with your DNS name.
EIO0000003000.12
21
Getting Started
Overview
Proceed as follows to start using EcoStruxure Augmented Operator Advisor:
Step 1: Install Hardware and Software
First, ensure that the required environment is operational:
• Set up and test hardware components and network connections.
22 EIO0000003000.12
• Install the EcoStruxure Augmented Operator Advisor App and EcoStruxure Augmented
Operator Advisor Runtime.
Refer to
Installing EcoStruxure Augmented Operator Advisor, page 24
for details.
Step 2: Prepare Scenes and Equipment
The next step is to take high-resolution photographs of all the sites, buildings, and items of equipment to be monitored.
Refer to Guidelines for Taking Photographs (see EcoStruxure Augmented Operator Advisor,
Builder, User Manual) for details.
Some of the scenes or equipment may not be easily identifiable due to:
• Physically identical or very similar items of equipment that need to be monitored separately.
• Poorly or very brightly lit scenes that prevent taking the required high-contrast photographs.
To avoid potential identification errors, you can attach unique tags to these items of equipment or place a tag somewhere visible in the scene. When the EcoStruxure
Augmented Operator Advisor App running on the tablet scans the item of equipment or scene, it scans and identifies the tags and displays the corresponding points of interest.
Refer to Tagging Equipment (see EcoStruxure Augmented Operator Advisor, Builder, User
Manual) for details.
At this stage, you also need to identify all the external sources of information (documents, external programs, process variables, and SQL database fields) that are to be monitored.
This information will be needed when configuring points of interest in the EcoStruxure
Augmented Operator Advisor Builder project (see the next step).
Step 3: Create EcoStruxure Augmented Operator Advisor
Project
Next, create a project using EcoStruxure Augmented Operator Advisor Builder.
EcoStruxure Augmented Operator Advisor Builder is software that you use to:
• Organize and structure the areas, scenes, subscenes, and points of interest in a project.
• Create and position the points of interest on photographs.
• Attach documents directly to a scene or associate them with information in list points of interest.
EIO0000003000.12
23
• Define what happens when the operator taps the point of interest.
• Build procedures to explain a set of tasks the operator must carry out.
Refer to the EcoStruxure Augmented Operator Advisor Builder User Manual for details.
Step 4: Deploy the Project to EcoStruxure Augmented
Operator Advisor Runtime
Only authorized users are allowed to deploy the project.
When the project is complete, perform a build that will create a signed zip file of the project
(see EcoStruxure Augmented Operator Advisor, Builder, User Manual).
Then
import the built project zip file, page 36
to the Project tab of the EcoStruxure
Augmented Operator Advisor Runtime.
Step 5: Commission
Finally,
and test the project using the EcoStruxure
Augmented Operator Advisor App running on a tablet. If necessary, fine-tune the solution by modifying the EcoStruxure Augmented Operator Advisor project, retaking photographs, adding tags to scenes or subscenes, and so on.
When all scenes and items of equipment are being recognized by the EcoStruxure
Augmented Operator Advisor App and the correct items of information are appearing in all points of interest, the solution can be put into operation.
Installing EcoStruxure Augmented Operator
Advisor
License Requirements
Trial versions of EcoStruxure Augmented Operator Advisor Runtime and EcoStruxure
Augmented Operator Advisor Builder are available. They are free to download and use for up to 42 days. At any time during the trial period, you can purchase licenses and activate the software.
The following license types are available:
24 EIO0000003000.12
License Type Maximum number of...
Areas Points of interest Procedures
EcoStruxure Augmented Operator Advisor Builder
Trial
Essential
Unlimited
Unlimited
Performance Unlimited
EcoStruxure Augmented Operator Advisor Runtime
Trial Unlimited (1)
Unlimited
Unlimited
Unlimited
Unlimited (1)
Unlimited
0
Unlimited
Unlimited (1)
Essential Level 1
Essential Level 2
Essential Level 3
Performance Level 1
Performance Level 2
Performance Level 3
1
1
1
1
1
1
20
50
Unlimited
20
50
Unlimited
0
0
0
10
20
Unlimited
Multi-area Unlimited Unlimited Unlimited
(1) The EcoStruxure Augmented Operator Advisor Runtime Trial license has no limitation on the number of areas, points of interest, and procedures and remains active until the trial period expires. It is recommended that you delete the Trial license after you have activated a new license to avoid exceeding the license capabilities.
You can also purchase the Local projects add-on license, which allows you to build local projects without an expiration date. However, this license can be used with projects containing only one area.
License Activation
Use the License Manager to activate the license for:
• EcoStruxure Augmented Operator Advisor Runtime
• local EcoStruxure Augmented Operator Advisor Builder
• local EcoStruxure Augmented Operator Advisor Builder add-on
Remember to delete any Trial licenses after activating a new license.
The license and the add-on for the cloud EcoStruxure Augmented Operator Advisor Builder are online licenses that must be activated from the cloud Builder itself.
NOTE: Do not register or activate any cloud EcoStruxure Augmented Operator Advisor
Builder license from the License Manager.
To activate a license in the cloud EcoStruxure Augmented Operator Advisor Builder:
EIO0000003000.12
25
Step
1
2
3
4
5
6
Action
Log in to cloud EcoStruxure Augmented Operator Advisor Builder.
Click your login name in the top right corner of the main window.
Choose License information .
Click Change license .
If you want to activate an add-on, select the add-on and click Activate .
Type the activation ID in the empty text field.
Click Register .
EcoStruxure Augmented Operator Advisor App
The EcoStruxure Augmented Operator Advisor App is compatible with:
• iOS, version 14.4 or later:
◦ Compatible with: iPad (9th generation), iPad Pro (11–inch display, 5th generation), iPhone SE (64 GB)
• Android, version 7.0 or later:
◦ Compatible with: Samsung Galaxy Tab A7 and S7, Samsung A32 5G
• Tablet PCs running Windows 10 64-bit, version 1803 or later:
◦ Compatible with: Microsoft Surface Pro 8 (i7 processor, 8 GB RAM, 128 GB SSD),
Panasonic Toughbook FZ-G2
NOTE: Smartphones offer a limited user experience. Use a tablet to take full advantage of the EcoStruxure Augmented Operator Advisor App.
The EcoStruxure Augmented Operator Advisor App does not require a license.
For iOS and Android, it is available from the application store:
Step
1
2
3
Action
Search for EcoStruxure Augmented Operator .
Follow the download and installation instructions.
After installation is complete, launch the App. This will create the necessary local folders on your device.
For Windows:
26 EIO0000003000.12
6
7
4
5
Step
1
2
3
Action
Make sure that you have administrator rights on the tablet PC.
Go to the URL www.se.com
and search for EcoStruxure Augmented Operator Advisor.
Click the relevant link and follow the instructions to download EcoStruxure Augmented Operator
Advisor App for Windows.
Launch the installation file.
Follow the installation instructions to complete the installation process.
Click Finish to exit the installer after the installation process is completed.
After installation is complete, launch the App. This will create the necessary local folders on your device.
EcoStruxure Augmented Operator Advisor Builder
Overview
EcoStruxure Augmented Operator Advisor Builder is an application that runs in a web browser, also called Cloud Builder. No installation is required. The PC running EcoStruxure
Augmented Operator Advisor Builder must have internet access.
NOTE: Alternatively, you can install the software locally on your PC. Internet access is not required. To use the Local Builder, contact the sales department for the installation file.
The following web browsers can be used:
®
Chrome
™
(version 101 or later)
• Mozilla
®
Firefox
™
(version 100 or later)
• Microsoft
®
Edge
™
(version 101 or later)
Installing the Local Builder
The local EcoStruxure Augmented Operator Advisor Builder is installed on a standard
Windows PC.
EIO0000003000.12
27
28
The following minimum requirements must be met:
• Operating system: Windows 10 Pro 64–bit, version 1703 or later
• CPU: Intel
®
Core
™ i5 processor
• RAM: 8 GB
• BIOS-level hardware virtualization support
The following prerequisites must be satisfied before installing the local EcoStruxure
Augmented Operator Advisor Builder:
• Microsoft .NET Framework, version 4.7.2 or later must be installed.
• The hardware virtualization support must be turned on in the BIOS settings.
• Hyper-V must be turned on in Windows, for use by Docker Desktop.
• Docker Desktop for Windows, version 2.2.0.5 or later must be:
◦ installed,
◦ running, and
◦ using Linux containers
• The hard drive on which the local Builder is installed must be encrypted to secure the user database, for example, using BitLocker.
To configure Docker Desktop before installing the local Builder:
Step
1
2
3
4
Action
On the PC, open Docker Desktop and click Settings .
Click the General tab, then
• Select the Start Docker Desktop when you log in checkbox
• Clear the Use the WSL 2 based engine checkbox
Click Apply & Restart .
Verify if Docker Desktop runs with Linux containers:
1. Right-click the Docker Desktop icon in the Windows taskbar
2. In the list of items that opens, Switch to Windows containers...
must be available if you are using Linux containers. If not available, then click Switch to Linux containers...
to activate it.
To install the local Builder:
Step
1
2
3
Action
Verify that you have administrator rights on the PC.
Go to the URL www.se.com
and search for EcoStruxure Augmented Operator Advisor.
Click the relevant link and follow the instructions to download the local Builder.
EIO0000003000.12
Step
4
5
6
7
Action
On the PC, launch the installation file.
Result: The installation wizard starts.
Follow the installation wizard instructions to complete the installation process.
NOTE: When a Docker Desktop dialog box opens, accept to share the proposed location.
Click Finish to exit the installation wizard after the installation process is completed.
Apply relevant local IT rules and best practices to secure and backup your device.
User Management for Local Builder
Only one admin user profile is available in the local Builder.
All Windows users of the PC where the software is installed can log in if they were added by a Windows administrator to the list of authorized users.
To add users to the list (Windows administrator only):
5
6
3
4
Step
1
2
Action
On the PC, open a file explorer.
In the left sidebar, right-click This PC , then in the drop-down menu click Manage .
Result: The Computer Management window appears.
In the left sidebar, click Local Users and Groups , then double-click Groups .
In the list of groups, right-click docker-users , then in the drop-down menu click Properties .
Click Add and type the Windows identifier of the user, then click OK .
Click Apply to save your modifications.
To complete the configuration for each added Windows user:
Step
1
2
3
4
Action
On the PC, in the Windows session of the user, open Docker Desktop and click Settings .
Click the General tab, then
• Select the Start Docker Desktop when you log in checkbox
• Clear the Use the WSL 2 based engine checkbox
Click Apply & Restart .
Click the Resources tab, then click FILE SHARING .
EIO0000003000.12
29
Step
5
6
Action
Verify if the shared folder exists in drive C, or add the following:
C:\ProgramData\Schneider Electric\EcoStruxure Augmented Operator Advisor Builder
\LocalBuilder
Click Apply & Restart .
Result: This user can log in to the local Builder.
Launching the EcoStruxure Augmented Operator
Advisor Builder
To launch the cloud Builder:
Step
1
2
Action
Start a web browser and enter the following URL: https://app.schneider-electric.com/ecostruxureaugmented-operator-advisor .
Log in using email address and password, or request a new login by clicking Register here .
To launch the local Builder:
Step
1
2
Action
In the list of installed Windows programs, click EcoStruxure Augmented Operator Advisor
Local Builder .
>
Log in using your Username and Password .
If logging in for the first time, use the default username and password (admin/admin), then enter a new password.
Installing the EcoStruxure Augmented Operator
Advisor Runtime
Overview
The EcoStruxure Augmented Operator Advisor Runtime can be installed on any of the following:
• Harmony GTU: Harmony HMIG5U21, HMIG5U22 Open Box
30 EIO0000003000.12
• Harmony iPC: HMIBMI, HMIBMO, HMIBMU, HMIBMP, HMIPSP
• Harmony P6: HMIP6
• Standard Windows PC
Prerequisites
The following minimum requirements must be met:
• Operating system: Windows 10
• Hard disk space: 600 MB (minimum)
• RAM: 4 GB
• Screen resolution: 1024 x 768 (minimum)
The following web browsers can be used:
®
Chrome
™
(version 101 or later)
• Mozilla
®
Firefox
™
(version 100 or later)
• Microsoft
®
Edge
™
(version 101 or later)
The following prerequisites must be satisfied before installing the EcoStruxure Augmented
Operator Advisor Runtime:
• Microsoft .NET Framework version 4.7.2 or later must be installed.
• The physical access to the runtime device must be secured by installing it in a closed cabinet inside your site or building.
• The EcoStruxure Augmented Operator Advisor Runtime must be installed only by a user with administrator rights on the runtime device.
• All folders and files installed and used by the software must be stored in a location where administration rights are required.
• The hard drive on which EcoStruxure Augmented Operator Advisor Runtime is installed must be encrypted to secure the user database, for example, using BitLocker.
• Only authorized users are allowed to deploy the project. Setup permissions to restrict the access to the project data folder on the runtime device.
EIO0000003000.12
31
Installing EcoStruxure Augmented Operator Advisor
Runtime
NOTE:
• The OS logging can trace the access to the device.
• There is no specific mechanism to store events linked to deployment.
• The EcoStruxure Operator Terminal Expert signature is used to ensure consistency between the runtime device and EcoStruxure Operator Terminal Expert Runtime.
To install the EcoStruxure Augmented Operator Advisor Runtime:
Step
1
2
6
7
3
4
5
Action
Go to the URL www.se.com
and search for EcoStruxure Augmented Operator Advisor.
Click the relevant link and follow the instructions to download the EcoStruxure Augmented
Operator Advisor Runtime.
Unzip the downloaded file.
On the runtime device, launch the installation file.
Result: The installation wizard starts.
Follow the installation wizard instructions to complete the installation process.
When choosing the destination folder, you can click Next to install to default destination folder or
Change to change the destination folder.
If a message appears during installation, proceed as follows:
• If the message indicates that the Microsoft Visual C++ installation has failed, click Yes to continue. The installation will continue normally.
• If the message indicates an issue with the cabinet file Data1.cab, then close the message window and stop the installation. Restart the installation procedure again at step 3.
However, when unzipping, install to a different destination folder, or if possible, install to a different disk drive on your device.
Click Finish to exit the installer after the installation process ends.
Install an SSL certificate, page 33
to complete the installation.
Apply relevant local IT rules and best practices to secure and backup your device.
EcoStruxure Augmented Operator Advisor Runtime is started automatically each time the runtime device is restarted. When you close the runtime user interface, you can choose to stop the runtime background services, or to leave them running. To manually start
EcoStruxure Augmented Operator Advisor Runtime, click EcoStruxure Augmented
Operator Advisor > Runtime in the list of installed Windows programs.
32 EIO0000003000.12
Installing the SSL Certificate
Step
1
2
3
4
5
6
To use a secure connection (HTTPS), you must acquire and install an SSL certificate.
You can install:
• either a certificate, signed by a public certificate authority,
• or a self-signed certificate, signed by your certificate authority
Action
In the Windows menu, click EcoStruxure Augmented Operator Advisor .
Open the Runtime Certificate folder .
Copy the certificate and associated key files provided by the certificate authority in this folder.
Rename the certificate file to server.crt
and the key file to server.key
.
Launch the EcoStruxure Augmented Operator Advisor Runtime and click the Settings tab.
Define the Runtime (server) port to 443 and select the HTTPS checkbox.
Augmented Operator Advisor – Runtime Version x.y
Project
Port setting
Runtime (server)
Documents
HTTPS
Internal communication + Node-RED
Operator Terminal Expert / Blue
Settings
Diagnosis
Node-RED
EcoStruxure Machine Advisor
Status
Https Proxy
Language
443
8082
8080
Launch
Not available
Connect
Apply
AOA Manager
7
8
Server started
Click Apply .
If you are using a self-signed certificate, the certificate authority file must be installed on any tablets using EcoStruxure Augmented Operator Advisor App, and on any PCs using EcoStruxure
Augmented Operator Advisor Manager.
Contact your local IT department to install the certificate authority file.
EIO0000003000.12
33
Testing the Configuration
Step
1
2
Action
Launch the EcoStruxure Augmented Operator Advisor
Windows programs, and click Settings .
>
Runtime from the list of installed
Click Launch to run the configuration.
Check ports
Runtime (server)
Internal communcation + Node-RED 8082
Operator Terminal Expert / Blue
443
8080
Connection successful
Connection successful
Process stopped
• Take note of the Runtime (server) port number. This will be required by the operator user when configuring the application on the tablet (see EcoStruxure Augmented Operator
Advisor, App, User Manual).
• If you use Node-RED, the same Internal communication + Node-RED port number should be used while configuring Augmented Operator Server node in Node-RED editor to communicate with EcoStruxure Augmented Operator Advisor Runtime.
• Node-RED and Operator Terminal Expert / Blue need to be started separately.
• EcoStruxure Augmented Operator Advisor Runtime is running correctly when Runtime
(server) and Internal communication + Node-RED are indicated as Connection successful .
• If any port is not available it is highlighted in red and the process using that port is indicated.
Close the Check ports window.
34 EIO0000003000.12
Step
3
Action
You can then change the specific ports manually. If you modify, click Apply and wait until the confirmation message appears.
Augmented Operator Advisor – Runtime Version x.y
Project
Port setting
Runtime (server)
Documents
HTTPS
Internal communication + Node-RED
Operator Terminal Expert / Blue
Settings
Diagnosis
Node-RED
EcoStruxure Machine Advisor
Status
Https Proxy
Language
443
8082
8080
Launch
Not available
Connect
Apply
AOA Manager
4
Server started
Click OK to close the confirmation window.
Click Launch to verify if the newly requested ports are available.
To verify the secure connection, open a web browser and type this URL: https://localhost:<PORT> where <PORT> is the port number configured for Runtime (server) in Settings .
If the SSL connection and the certificate installation are successful, a lock icon the URL address field.
appears beside
Configuring the Windows Firewall
To configure the firewall when using the Windows Firewall, follow this procedure to open the required TCP port:
Step
1
2
Action
From the Windows Start menu, open Control Panel .
Select Windows Firewall .
EIO0000003000.12
35
8
9
10
Step
3
4
5
6
7
Action
Select Advanced settings in the left column of the Windows Firewall window.
Select Inbound Rules in the left column of the Windows Firewall with Advanced Security window.
Select New Rule in the right column.
Select Port in the New Inbound Rule Wizard and then click Next .
NOTE: You must create a Port rule. Do not create a Program rule.
Select which protocol this rule will apply to TCP , select Specific local ports , type the
port number configured for Runtime, page 34
in Settings , and then click Next .
Select Allow the connection and then click Next .
Select when this rule applies (check all of them for the port to always stay open) and then click
Next .
Give this rule a name and then click Finish to add the new rule.
If you are using a firewall other than the Windows Firewall, consult the documentation of the manufacturer.
Importing a Project to EcoStruxure Augmented Operator
Advisor Runtime
Before you can import a project, copy the built project .zip file created in EcoStruxure
Augmented Operator Advisor Builder to the EcoStruxure Augmented Operator Advisor runtime device.
To import a project:
Step
1
2
Action
Launch the EcoStruxure Augmented Operator Advisor Runtime and click Project .
Click Import New Project and browse the project zip file, then click Open .
Result : The project is imported to the EcoStruxure Augmented Operator Advisor Runtime. The project information is displayed.
NOTE: If you reinstall the EcoStruxure Augmented Operator Advisor Runtime, you need to import the project again.
36 EIO0000003000.12
Configuring the Connection with EcoStruxure Machine
Advisor
After you have created your project in EcoStruxure Augmented Operator Advisor Builder, and associated the project to a machine type in EcoStruxure Machine Advisor, connect the
EcoStruxure Augmented Operator Advisor Runtime to EcoStruxure Machine Advisor if you want to use the EcoStruxure Machine Advisor documents in your project.
If you are using a proxy:
Step
1
2
3
Action
Launch the EcoStruxure Augmented Operator Advisor Runtime and click Settings .
Enter the address of your proxy in the Https Proxy field.
Click Apply and wait until the confirmation message appears.
To configure the connection with EcoStruxure Machine Advisor:
Step
1
2
3
4
5
6
Action
Launch EcoStruxure Machine Advisor and open the FLEET OVERVIEW , then open the machine that you want to connect.
On the machine page, click CONNECT EDGE , then copy the One Time Password code that appears.
Launch the EcoStruxure Augmented Operator Advisor Runtime and click Settings .
Click Connect under EcoStruxure Machine Advisor.
Result: The Connect dialog box opens.
Enter the One Time Password code.
Click Connect .
Result: The EcoStruxure Augmented Operator Advisor Runtime is connected to EcoStruxure
Machine Advisor.
Configuring Users and Security Settings
Overview
There are three types of users of EcoStruxure Augmented Operator Advisor:
• Builder users
EIO0000003000.12
37
• Runtime/Manager administrators
• Operator users
Builder users are those who will access EcoStruxure Augmented Operator Advisor Builder.
Users without credentials can sign-up in the builder login screen.
Runtime/Manager administrators are those who are responsible for configuring users and security settings using the EcoStruxure Augmented Operator Advisor Manager. Runtime/
Manager administrators must have administrator rights (maximum security level).
Operator users are those who will use the EcoStruxure Augmented Operator Advisor App.
Based on their user rights (security level) they will have access to different objects in the app. In the builder project, objects are attributed with a security level numerical value.
Operator users with a security level numerical value equal to or greater than the objects security level may view and interact with the object. Otherwise, the object is hidden or not accessible.
You now need to create operator users for your project (see EcoStruxure Augmented
Operator Advisor, Runtime, User Manual).
Frequently Asked Questions (FAQs)
What can I do if the tag is not detected properly?
Follow these rules when using tags:
• Place the tag on a solid flat surface or on a window.
• Do not use a tag in an environment with a grid or a mesh: the detection can be very slow or impossible, as the software will have difficulty differentiating between the tag and the grid/mesh.
• Reference photos must be taken directly in front of the tag. The photo plane must be parallel to the tag plane for best results.
• The detection camera plane must be also parallel to the tag plane. If a tag is placed at the top of a scene, consider tilting the tag downward to respect this parallelism. Any deviation from parallel of this photo will reduce the probability of tag detection.
38 EIO0000003000.12
• When identifying the tag placement in the images, align the dotted lines between the four red crosses with the edge of the tag itself, as follows:
If the tag is not detected properly, do the following:
1. Print the tag in matt (non-glossy) finish.
2. Make sure the tag is attached on a flat surface of uniform color.
3. Try using a larger tag.
4. Try using a different tablet for tag detection.
Why are some characters missing in the field entries?
The EcoStruxure Augmented Operator Advisor Builder software does not recognize special characters, such as \, /, :,?, <, >, or |.
Why am I not able to install EcoStruxure Augmented
Operator Advisor Runtime?
To be able to install the EcoStruxure Augmented Operator Advisor Runtime:
• You must have administrator rights on your system.
• You must configure the Windows
• You must activate your license key.
• You must check if the
EIO0000003000.12
39
Why does my trigger fail?
If the trigger action does not occur when you expect an event, display the variable in a point of interest to check that the conditions of the trigger are fulfilled.
Why do I get a low memory warning from my web browser?
This can happen when Node-RED is running at the same time as EcoStruxure Augmented
Operator Advisor Manager. Close the Node-RED editor, or some of its flows, to free additional memory.
Why do I see a decrease in performance of detection and tracking?
Verify if your tablet has switched to power save mode. Reboot or switch back to normal mode to increase performance.
Why do some points of interest not react when I touch them?
Verify if you need to recalibrate the touch area of your tablet. Switch between landscape and portrait orientation, then retry touching the point of interest.
What can I do if I see a decrease in the performance of my runtime device?
Monitor and ensure that the following Windows services are running correctly:
• AOANginx
• AOANodeRed
• AOAPython
• AOAWatchdog
40 EIO0000003000.12
Glossary
A area:
An area is a zone within each site or building (such as production lines, plant rooms, storage areas, workshops, laboratories, and office areas) that you want to monitor using
EcoStruxure Augmented Operator Advisor. If you have the appropriate license type, you can create an area for each part of the site to monitor within an EcoStruxure Augmented
Operator Advisor project.
augmented reality:
Technology that superimposes a computer-generated image on a user view of the real world, providing a composite view of the image with points of interest superimposed.
D document browser:
Documents attached to an area, a scene, or a point of interest can be displayed in the document browser, in a split screen.
E
EcoStruxure Operator Terminal Expert:
EcoStruxure Operator Terminal Expert is human machine interface (HMI) configuration software that enables you to create and edit application panels to control automation systems for Harmony GTU terminal (Premium and Open boxes) and Harmony industrial
PCs (Panel and Box).
N
Node-RED:
Node-RED is an open source, visual programming tool that requires few or no programming skills. Instead, it uses pre-programmed, reusable blocks of code called nodes. Nodes can be wired together to create flows of data.
EIO0000003000.12
41
P point of interest:
A point of interest is a position in an area, scene or subscene for which additional diagnostic or technical information is available. Various types of points of interest can be defined, including technical documentation, design drawings, information contained in a spreadsheet, and the real-time values of process variables generated.
procedure:
Procedures are a set of instructions that the operator must carry out in a predefined order to complete the task. Instructions can include scenes that must be recognized by the
EcoStruxure Augmented Operator Advisor App using augmented reality.
process variable:
A process variable is the measured value of a particular part of a process being monitored or controlled, for example, temperature, pressure level, or flow rate.
project:
An EcoStruxure Augmented Operator Advisor project is made up of areas, scenes and procedures. Build the project and then import it to the EcoStruxure Augmented Operator
Advisor Runtime. The operator can then access the project on a tablet running the
EcoStruxure Augmented Operator Advisor App.
S scene:
A scene corresponds to an image overlaid with points of interest.
SQL:
Structured Query Language.
subscene:
A part of a scene, typically a close up view of a particular area of the scene. A subscene can contain its own points of interest.
42
T tag:
A two-dimensional matrix. Tags can be printed and attached to items of equipment that are physically identical or very similar. The tags are scanned as part of a scene by the
EcoStruxure Augmented Operator Advisor App and the correct points of interest for the item of equipment displayed.
EIO0000003000.12
Training mode:
In Training mode , you can test a procedure or train operators to use procedures in the
EcoStruxure Augmented Operator Advisor App, without needing to recognize the scene.
Training mode allows you to skip steps, to go through them in a different order, or to complete the procedure by directly jumping to the last step.
U
URI:
Uniform Resource Identifier. This is used to point to an object such as a file, and defines which application is used to open it. This may require the installation of third party applications.
V variable:
A variable is a type of a point of interest that is replaced by the real-time value of a software object from a process or database, for example, a system bit, when the scene containing the variable is displayed on the tablet.
EIO0000003000.12
43
Schneider Electric
35 rue Joseph Monier
92500 Rueil Malmaison
France
+ 33 (0) 1 41 29 70 00 www.se.com
As standards, specifications, and design change from time to time, please ask for confirmation of the information given in this publication.
© 2022 Schneider Electric . All rights reserved.
EIO0000003000.12
Download
Public link updated
The public link to your chat has been updated. You may view and manage your chat links after registration here.
Document public link
Advertisement
Key features
Augmented Reality for industrial operation
Points of Interest (variables, documents, etc.)
Areas, Scenes, and Procedures
Integration with Node-RED and Operator Terminal Expert
Frequently asked questions
EcoStruxure Augmented Operator Advisor uses augmented reality to optimize the operation and maintenance of industrial sites and equipment.
The main components include EcoStruxure Augmented Operator Advisor Builder, EcoStruxure Augmented Operator Advisor Runtime, and the EcoStruxure Augmented Operator Advisor App.
Scenes are things to monitor within an area, subscenes provide close-up views, and procedures are a set of instructions for the operator.
The available license types are Trial, Essential, Performance, and Multi-area for the EcoStruxure Augmented Operator Advisor Runtime and Builder.