Perfect Corp’s augmented reality tech tracks body and facial movements with extreme precision

16 Feb 2022 --- Beauty tech company Perfect Corp is offering consumers accurate and realistic virtual try-on experiences with its AgileHand and AgileFace technology. The innovation has the potential to save users and brands time and money, reduce waste and returns and raise profits, says the company.

Perfect Corp’s AgileHand, offers virtual nail polish and jewelry try-ons, and AgileFace can help users choose fashion accessories like sunglasses or makeup.

Speaking to PersonalCareInsights, Alice Chang, CEO and founder of Perfect Corp, says that brands have already reported savings.

“AgileHand technology is a patent-pending new innovation powered by state-of-the-art AI algorithms to deliver hyper-realistic virtual try-on effects on hands and wrists,” she explains.

With AgileFace and AgileHand, consumers can match products to their preference using their phone.“Brand partners have reported impressive results with our beauty and fashion tech solutions showing an increase in 2.5 times conversion rate, as much as 300% increase in consumer engagement with our interactive AI and AR solutions, and an 8% decrease in returns which signifies a noteworthy cost savings eliminating wasteful returns.

Louis Chen, chief strategy officer and executive vice president of Perfect Corp, says that a virtual try-on element increases consumer satisfaction.

On the track for personalization
Chen says that with AgileHand, the company has created an “extremely precise” 3D hand tracking technology that brands can employ for virtual try-ons of products including watches, rings, bracelets and nail polish. 

According to Chen, the hand-mapping technology is trained by leveraging real-life hand models with an array of hand gestures and skin shades. He and Chang say Agile technology is an inclusive solution.

“This spans an inclusive range of personal hand differentiators and traits like skin tones and finger size for a truly universal virtual try-on solution for hands and wrists,” Chang affirms.

“The technology takes online shopping experiences to the next level and can be enabled on any smart devices with a camera (including iOS, Android, as well as PCs through web browsers), allowing consumers to try hyper-realistic AR versions of products out on their hands in real-time, increasing consumer confidence, decreasing returns, and driving sales,” Chen says.

Chen says AgileFace’s makeup try-on tool “offers high-touch, real-time product try-ons for everything from lipstick, to eyeshadow, to concealer.” 

According to Chang, “This advanced technology delivers over 200% improvement in jitter-free tracking and 20% increase in accuracy, for a true-to-life virtual try-on experience that rivals the physical one.” 

Auto pupillary distance detection
Using AgileFace, “We’re also able to provide realistic product try-ons for fashion accessories such as eyewear, headwear and earrings.”The technology means users can now be more sure of their purchases, increasing consumer confidence.

Chen says the company’s virtual try-on tool for glasses offers the most advanced and realistic real-time 3D try-on experience available. AgileFace includes a highly-accurate auto pupillary distance detection feature meaning unique users can get the perfect fit for digital and physical glasses.

“The technology empowers consumers to only purchase goods that they know are the right fit for them, thereby eliminating the unwitting purchase of unsuitable products which will only be wasted.”

He highlight’s that Perfect Corp’s hair color virtual try-on solution “removes the need for hair dye brands to use physical samplers.” He says this has a positive environmental impact and contributes to significant cost-reduction where savings that can be passed onto consumers.

Users can also match their foundation shade before buying or testing out the actual product with Perfect Corp’s AI Foundation Shade Finder technology. 

Chen informs that AgileFace also powers Perfect Corp’s Skin Diagnostic tool, which analyzes images of users’ skin to deliver a detailed overview of their unique skin concerns. He says the tool can highlight up to 14 problem areas, “such as spots, wrinkles, dark circles and more.”

Continuous innovation
Chen says Perfect Corp continues to hone its technology. “Our AI algorithms are frequently trained with new datasets to improve their accuracy and precision, allowing them to recognize a broader range of hand gestures, motions and angles.”

He adds, “We also continually improve the performance of our solutions in overexposed or low-lighting conditions and work to improve resistance to tracking instability against inconsistent or unpredictable backgrounds.”

Recently, the company partnered with Sally Hansen to use its AgileHand technology in virtual nail polish try-ons.

In January, L’Oréal launched its AI powered Coloright technology targeting at-home users.

By Olivia Nelson