SIEMENS ENERGY PROOF OF CONCEPT DEMOS

A collection of XR prototypes developed by Interspectral and Siemens Energy in the Visual Sweden Augmented Operator project.

AR is a core component in Industry 4.0 but has not yet reached its full potential due to technical limitations.

The transformation to Industry 4.0 is well under way and has been accelerated by the Covid-19 pandemic forcing companies to speed up digitalization efforts.

Manufacturing industries have become data-driven and value is currently created by capturing, analyzing and acting on large amounts of data about the product often called the Digital Twin.

Augmented Reality (AR) has proven to be a great interface between the digital twins and the operators working in production.

The technology is already in use at many larger companies but has not yet reached its full potential due to limitations in the performance of the existing hardware and software.

AR streaming reduce technical limitations and creates huge opportunities for the industrial manufacturing industry 

With the rise of cloud computing, streaming technology and high-speed wireless networks such as 5G it is now possible to do all computation for AR in the cloud and in a secure way stream it over wireless networks to thin clients like handheld devices and nontethered AR headsets.

This new streaming technology will suddenly make advanced interactive 3D-visualization and AR available for use within industrial manufacturing. When computation is no longer a problem the possibilities become endless and imagination is the only limit.

#1 - A raytraced massive SGT-800 CAD model streamed to a mobile device.

The Prototype in short:
The video features a 15+ million polygon ray-traced 3D model of a Siemens Energy SGT-800 gas turbine running in AR on an Iphone 12.

The prototype was developed with Nvidia Cloud XR and is running on NVIDIA RTX GPU server and a fast network. Possible to deploy in the cloud or on private servers.

Possible applications at Siemens Energy:
Suitable for all applications where there is need to make large CAD files accesible for basic applicatons on thin clients in a secure way e.g.

  • Sales
  • Marketing
  • Training

#2 - Additive Manufaturing monitoring data in Hololens 2 

The Prototype in short:
Monitoring data (synthetic data for confidentiality) from a metal additive manufacturing build job of Siemens Energy gasburners presented in a wearable see through AR headset (Hololens 2).

Data would be possible to overlay on the physical parts.

 

 

Possible applications at Siemens Energy:
The application makes it possible to convey complex data/information to operators in settings where its hard or impossible to use for example hand held devices.  One example is the AM production environment.

  • Production
  • Testing

#3 - Additive Manufaturing monitoring data mapped on physical parts

The Prototype in short:
Monitoring data (EOS printer) from a metal additive manufacturing build job of test parts from AMEXCI AB. Data is mapped on to the physical parts.

The demo illustrates the potential of overlaying complex data on physical parts,

 

Possible applications at Siemens Energy:
The application makes it possible to convey complex data/information to operators in settings where its hard or impossible to use for example hand held devices.  One example is the AM production environment.

  • Production
  • Testing

#4 Design review of massive SGT-800 CAD file streamed from cloud to AR headset

The Prototype in short:
15 Million polygon SGT-800 3D model in Hololens 2 application streamed from cloud server.

Possible applications at Siemens Energy:

  • Design & construction
  • Training
  • Sales and marketing

#5 Gas turbine testing operator support for with sensor readings, checklists and more

The Prototype in short:
Prototype application developed based on needs and requirements from Siemens Energys test rig for gas turbines. The application give the operator spatial relevant information through a wearble AR headset.

The  prototype reduces the need for operator to bring paper intructions/manuals on paper or mobile units and the need to be in contact with the control room,

By making the relevant infomation accesible in a handsfree manner the operator can perform carry out the work in a faster, more secure and time effiecient way.

Features in demo:

  • Access to live global machine process metrics
  • aasas
  • Training
  • Sales and marketing
Test 3

Use case example #1

A mock up of a gasturbine at the test rig at Siemens Energy.  QR codes are placed at important positions and check points on the turbine,

Turbine_HandDash

Use case example #2

With help of a Hololens 2 headset the operator can see global performance parameters by raising the left hand similar to looking at an wrist watch.

Turbine_QR_Highlight

Use case example #3

The AR application detects QR codes and display relevant information for that position/context e.g. sensor readings, check lists, alarms, warnings etc.s.

Test 1

Use case example #4

At any point the operator can bring up the full CAD model of the turbine to get an overview or to look at ta specific detail. All sensors, check lists and more are displayed.

Turbine_Checklist

Use case example #5

Virtual check lists are postioned at the relevant position. The operator can get instructions at each check list.

Turbine_Gauge

Use case example #6

The operator can get sensor readings from all sensors placed on turbine.

Test 2

Use case example #6

There is a connection bewteen the virtual digital twin and the physical object. The operator can access the digital twin from a physical location and vice versa.

Augmented Operator - an innovation project driven by  Nordic research groups, industry and technology companies

Partners

Supported by

Our goal: Creating innovation and inspiration

Innovation and growth 

Augmented Operator aims to support the development, innovation and growth of Swedish Industry companies. In the project companies will gain deeper knowledge and experience of streamed AR and its possibilities and limitations.  

Knowledge and Inspiration

The platform aims to inspire and share knowledge about AR for industrial use in general. Within the project we will host a webinar series and perform other outreach activities.

New products and services

The platform will allow the technology companies to develop new AR products and solutions.

Explorative AR Research

Within the project research groups at Linköping University within 3D Visualization and computer vision will work with a number of work explorative work packages, the findings will be shared in open publications. The work will include: "State-of-the-art analysis – AR hardware",  market, "Technology Proof of Concept - Visual mapping" and "Modeling and prediction of device and object motions"

ON-DEMAND 

Augmented Operator Webinar Series

Welcome to a webinar series that will focus on the opportunities that streamed XR is creating for manufacturing industries.  In a series of live and on demand webinars we will present thought leading experts from technology companies and research groups working in the forefront of XR.

Interested to partner up? Let us know!

unnamed

Augmented Operator is supported and partly funded by the Swedish Innovation network Visual Sweden.

Learn more about the partners

AR and Software:
Combitech
Interspectral
Voysys
Vobling

Industry companies
Saab AB
Siemens Energy
Image Systems

 

Research groups
Linköping university - Computer Vision Laboratory
Linköping university - Media and Information Technology

Supporting companies
Ericsson
Nvidia

Innovation platform
Visual Sweden

 

Learn more about Augmented Operator

Thomas Rydell

Thomas Rydell
Co-Founder, Business developer
within Industry


Industry News