eXtended Reality (XR) Development

Executive Summary

This pack is for software companies, Enterprise & MNO IT staff with limited experience in the field of eXtended Realities (XR). Utilizing industry experts, we have created a clear set of guidelines for software companies to develop and explore XR based applications.

We have structured this pack to enable the reader to Define their problem; Choose the appropriate technology and ultimately to provide the initial handholds to start their own XR journey. 

XR Devices will continue to evolve as the 5G technology transitions over time from the Non-Standalone (NSA) to Standalone (SA) core, becoming progressively more lightweight and energy-efficient. XR Software Applications will also continue to become significantly more sophisticated in tandem with these 5G technological developments.

Companies and examples listed in this pack are not endorsed by Digital Nasional Berhad but they do represent industry standards and power brands. Treat them as an excellent starting point for further discussion and exploration of your chosen use-case(s).

 

Defining the WHAT answers the HOW

• The virtuality continuum, as it is officially called, covers a variety of technologies under the umbrella term of eXtended Realities (XR).
• Each “reality” is consumed by different hardware form factors and has different user experiences.
• The first step in when assessing whether XR is the right solution is defining: what use-case are you trying to solve?

 

Device Examples

 

Assisted Reality

Gives users access to relevant information in their immediate field of view (FoV). Generally uses standard LCD / LED screens.

Augmented (Mixed Reality)

Uses computer-generated, digital content to create an interactive experience within real-world environments. Generally uses Wave-guide displays.

Virtual Reality

Uses computer-generated, digital content to create an interactive experience replacing real-world environments Available as stand-alone devices or PC connected.

Future – Synthetized Reality

Uses high resolution RGB cameras to merge AR and VR into a single form factor allowing users to chose consumption mode. Expected availability 2023-2025

 

Narrowing Down the Right Technology

 

A simplified decision tree helps narrow down your technology choice.

• A key variable is the Outdoor use-case. Wave-guide displays (AR/MR) are strongly impacted by natural light. Pass-through AR (aR/Mobile) utilises normal phone / tablet screens that are not impacted.
• When the XR use case is to be used in “office” locations Virtual Reality is preferred as it allows for more powerful visualisation and utility.
   

End-to-end Perspective 

 

Content creation

• Use industry standards; Proprietary visualisation engines or custom code libraries are not scalable and difficult to integrate.
• Decide up-front whether your use-cases is multi-player or single-player; This decision impacts greatly what type of hosting is required and how scalable the consumption is.
• If content is expected to evolve rapidly in the near future then prioritise a Do-It-Yourself platform that allows SMEs to customise experiences; Content creation is a time and resource consuming process. Vendors charge a premium for post-launch changes to software.

Hosting & Distribution

• Use a Platform as a Service (PaaS) approach;

 

• Manage content centrally; Traditional MDM (mobile device management) struggles to manage XR equipment. XR platforms are functioning as a central repository that allows content to be shared across devices and users in a seamless experience.

• Multi-player; XR hosting platforms offer ready-made source code that can be used during content creation. This automatically allows multiple devices, with multiple people, in the same experience.

• Analytics; When deploying any technology – insight into usage and utilisation is critical for change and deployment management.

Consumption

• Scalability is a key influencing factor when selecting technologies. If you are targeting >10.000 users, you might want to chose existing technologies such as phones or tablets instead of head mounted devices.

• Web remains the great equaliser! There are many industry standards ARKit, ARCore, WebXR, etc. allow for in-browser XR experiences greatly reducing user / device friction.

• Don’t build for a specific hardware! Hardware evolves at a yearly cycle. Build content agnostically unless requiring specific device feature (e.g. extreme high fidelity)

 

Industry Standards

Red Flags for Development

 

We want 10 different VR scenarios.

When you try to build a lot of content or features at the same time you will exponentially make it more difficult for change and deployment management. Start with a minimal viable product that is reduced in scope.

 

Operations are busy – just work with IT.

Without the actual end users involved at the start of a project you will design a beautiful product that will not get adopted.

 

It needs to look exactly like in the real world.

The more realistic the environment or object looks – the more users will notice the differences. Avoid unnecessary costs and abstract visualisation where applicable.

 

Our platforms does everything!

Every company has an IT eco-system that your solution is part of. It is more important to understand what is already available and integrate than to replace everything.

 

Make vs Buy XR Solutions

 

Hire In-House Resources

Advantages:

• Establish centre of excellence.
• Rapid prototyping and value analysis.
• Ability to modify experiences according to evolving needs.

Cons

• Increased overall cost.
• Slower to react to market changes.
   

Work with External Companies

Advantages:

• Deep product expertise.
• Lower proof of concept costs.
• Easier to scale deployment.

Cons

• Biased around product-market fit.
• Adaptation and changes come at a high premium cost.

 

Ultimately, a Compromise is the Preferred Approach.

 

Virtual Reality

Spatial Memory

Simulating modes of operation and abnormal situations to build cognitive muscle memory and improve instinctive responses.
 

Unlimited Re-Do's

Constructing “live” simulations that produce and deliver the experience to workers without the actual consequences, allowing them to master tasks through repetition.
 

High Stakes, Less Risk

Test scenarios in a “sandbox” to build fit for purpose mitigation plans, reducing risk and allowing our workforce to fail safe if an unfortunate incident occurs.

Value Drivers

• An Emotional Connection
• Immediate consequences of decisions
• Relate critical programs like the Life Saving Rules to actual day to day work
• The impact of intervening at the right time
   

Assisted Reality

Head mounted wearables enable automatic and autonomous data gathering while frontline workers focus on value adding activities.
 

Situational Awareness

Know where your workers are and the tasks they are performing; to improve performance and create a safer environment.

Computer Vision

Automatically detect anomalies and notify relevant systems for further investigation and action.

Automation

Unburden frontline worker processes, workflows and repetitive tasks are automatically completed allowing for higher productivity.

Value Drivers

• Reduction in Non-Productive-Time of frontline workers and remote subject matter experts.
• Reduction in travel required.
• Reduction in incidents.

 

Augmented Reality

 

• Augmented reality provides a visual comparison for users, aiding in the research process (and making it fun)
• It enables retailers to reach the user through multiple touchpoints throughout the journey
• AR encourages two-way conversations from the initial ‘research’ phase
• Creates in-app platforms that gather user data and provide hyper-personalised suggestions
   

Value Drivers

75% of consumers now expect retailers to offer an augmented reality experience*. The benefits are clear:

• AR enhances the customer experience
• It integrates the online and offline experience
• Reduces the need for shop floor staff
• Increases brand awareness