How to Integrate Virtual Try On to Mobile Devices

18 Feb, 13:49

There are thousands of players in the beauty industry. Those who want to differentiate should apply innovative methods to capture their audience’s attention and maintain customer loyalty. Beauty AR technology brings innovation into customer experience in that it enables customers to virtually try-on via mobile in the comfort of their home. That sounds great, right?

The technology behind the scenes has always been an intriguing point for our potential users, customers, and the people who have just explored virtual try-on solution. In this blog post, we will examine the mechanism and explain the technology behind our mobile integration solution.

Digitalization Process

Before integrating makeup products into mobile web and app platforms, PulpoAR experts begin the digitalization process in our studio. This process takes four steps as follows.

The product to be digitalized is applied to mannequins.
We convert the product’s original RGB to a new RGB value with a colour conversion algorithm. The converted RGB value and the image processing system have a dynamic structure that matches the colour of the light, lip and skin tone.
PulpoAR makeup consultants review the digitalized product for approval. Experts make interpretations according to the difference between the product’s reality and its digital version. Color, texture, light are tested in this step.
After approval, the tech team transfers the digitalized product to the PulpoAR Customer Management System.

Integration Process

After the digitalization process, the brand’s tech team integrates the system by following the documentation we provide for both web and app. This process is faster than digitalization, and our experts are always ready to provide guidance and support throughout.

Mechanism Behind the Scenes

Virtual try-on technology operates within WebView, meaning that the user interacts with the website in the background. The mechanism works like the following:

Opening a full-screen browser with a template.
Communicating with the application in a Webview on any product detail page or a specially created page.

These two ways make integration faster and usage by the customers more comfortable.

What is next?

There are exciting features that our experts are now working hard on. Real-time try on optimization is one of them to provide a better user experience. In addition to facial makeup, hair and nail color try-on will go live in April 2021. Even more exciting is skin analytics, which analyzes the user’s skin texture, mood, and health while offering customized products. Moreover, the brand will also see the number of trials, conversion rate and similar metrics thanks to our business analytics tool.