AR is a core component in Industry 4.0 but has not yet reached its full potential due to technical limitations.
The transformation to Industry 4.0 is well under way and has been accelerated by the Covid-19 pandemic forcing companies to speed up digitalization efforts.
Manufacturing industries have become data-driven and value is currently created by capturing, analyzing and acting on large amounts of data about the product often called the Digital Twin.
Augmented Reality (AR) has proven to be a great interface between the digital twins and the operators working in production.
The technology is already in use at many larger companies but has not yet reached its full potential due to limitations in the performance of the existing hardware and software.
AR streaming reduce technical limitations and creates huge opportunities for the industrial manufacturing industry
With the rise of cloud computing, streaming technology and high-speed wireless networks such as 5G it is now possible to do all computation for AR in the cloud and in a secure way stream it over wireless networks to thin clients like handheld devices and nontethered AR headsets.
This new streaming technology will suddenly make advanced interactive 3D-visualization and AR available for use within industrial manufacturing. When computation is no longer a problem the possibilities become endless and imagination is the only limit.
#1 - A raytraced massive SGT-800 CAD model streamed to a mobile device.
The Prototype in short:
The video features a 15+ million polygon ray-traced 3D model of a Siemens Energy SGT-800 gas turbine running in AR on an Iphone 12.
The prototype was developed with Nvidia Cloud XR and is running on NVIDIA RTX GPU server and a fast network. Possible to deploy in the cloud or on private servers.
Possible applications at Siemens Energy:
Suitable for all applications where there is need to make large CAD files accesible for basic applicatons on thin clients in a secure way e.g.
- Sales
- Marketing
- Training
#2 - Additive Manufaturing monitoring data in Hololens 2
The Prototype in short:
Monitoring data (synthetic data for confidentiality) from a metal additive manufacturing build job of Siemens Energy gasburners presented in a wearable see through AR headset (Hololens 2).
Data would be possible to overlay on the physical parts.
Possible applications at Siemens Energy:
The application makes it possible to convey complex data/information to operators in settings where its hard or impossible to use for example hand held devices. One example is the AM production environment.
- Production
- Testing
#3 - Additive Manufaturing monitoring data mapped on physical parts
The Prototype in short:
Monitoring data (EOS printer) from a metal additive manufacturing build job of test parts from AMEXCI AB. Data is mapped on to the physical parts.
The demo illustrates the potential of overlaying complex data on physical parts,
Possible applications at Siemens Energy:
The application makes it possible to convey complex data/information to operators in settings where its hard or impossible to use for example hand held devices. One example is the AM production environment.
- Production
- Testing
#4 Design review of massive SGT-800 CAD file streamed from cloud to AR headset
The Prototype in short:
15 Million polygon SGT-800 3D model in Hololens 2 application streamed from cloud server.
Possible applications at Siemens Energy:
- Design & construction
- Training
- Sales and marketing
#5 Gas turbine testing operator support for with sensor readings, checklists and more
The Prototype in short:
Prototype application developed based on needs and requirements from Siemens Energys test rig for gas turbines. The application give the operator spatial relevant information through a wearble AR headset.
The prototype reduces the need for operator to bring paper intructions/manuals on paper or mobile units and the need to be in contact with the control room,
By making the relevant infomation accesible in a handsfree manner the operator can perform carry out the work in a faster, more secure and time effiecient way.
Features in demo:
- Access to live global machine process metrics
- aasas
- Training
- Sales and marketing

Use case example #1
A mock up of a gasturbine at the test rig at Siemens Energy. QR codes are placed at important positions and check points on the turbine,

Use case example #2
With help of a Hololens 2 headset the operator can see global performance parameters by raising the left hand similar to looking at an wrist watch.

Use case example #3
The AR application detects QR codes and display relevant information for that position/context e.g. sensor readings, check lists, alarms, warnings etc.s.

Use case example #4
At any point the operator can bring up the full CAD model of the turbine to get an overview or to look at ta specific detail. All sensors, check lists and more are displayed.

Use case example #5
Virtual check lists are postioned at the relevant position. The operator can get instructions at each check list.

Use case example #6
The operator can get sensor readings from all sensors placed on turbine.

Use case example #6
There is a connection bewteen the virtual digital twin and the physical object. The operator can access the digital twin from a physical location and vice versa.
Augmented Operator - an innovation project driven by Nordic research groups, industry and technology companies
Our goal: Creating innovation and inspiration
Innovation and growth
Knowledge and Inspiration
New products and services
The platform will allow the technology companies to develop new AR products and solutions.
ON-DEMAND
Augmented Operator Webinar Series
Welcome to a webinar series that will focus on the opportunities that streamed XR is creating for manufacturing industries. In a series of live and on demand webinars we will present thought leading experts from technology companies and research groups working in the forefront of XR.
Interested to partner up? Let us know!

Augmented Operator is supported and partly funded by the Swedish Innovation network Visual Sweden.
Learn more about the partners
AR and Software:
Combitech
Interspectral
Voysys
Vobling
Industry companies
Saab AB
Siemens Energy
Image Systems
Research groups
Linköping university - Computer Vision Laboratory
Linköping university - Media and Information Technology
Supporting companies
Ericsson
Nvidia
Innovation platform
Visual Sweden