MCC and Talkin’ Things combine AR and NFC

Multi-Color Corporation (MCC) and Talkin’ Things have claimed themselves as the first Internet of Things (IoT) packaging platform providers to combine augmented reality (AR) and NFC technology to create a unique customer experience in a connected product to help boost sales.

In the Black Beer project, Black – the skull character from the label – comes to life and ‘chats’ with the drinker using a mobile app

In the Black Beer project, Black – the skull character from the label – comes to life and ‘chats’ with the drinker using a mobile app. This allows it to ‘read the mood’ of the consumer. Watch a video demonstration below.

Talkin’ Things provided NFC technology, creative concept and artworks for AR and software development. The smart labels were produced by MCC.

The smart label produced by MCC becomes a trigger, with no additional marker implemented to launch an AR experience. When the customer scans the smart label with a mobile app, the skull presented on the label engages into interactive dialogue with the consumer. The face recognition feature detects if the customer is happy or sad and customizes the next part of the dialogue. Variable AR scenarios are also launched depending on answers provided to questions asked by the skull.

This label demonstrates how advanced smart packaging can be by interactng with consumers via AR facial recognition and incorporates dynamic scenarios dependent on users’ emotions

Craig Miller, president of NA CPG at MCC, said: ‘Thanks to our labeling production capabilities and Talkin’ Things technology combined with creative services, we are able to offer our clients a brand new solution that will completely transform a product and change the way end customers interact with it.’

Additionally, an NFC smart label applied to the bottle’s neck provides a proof of purchase option for 2-stage communication with end customers. It recognizes when the product has been opened to provide different messages to the customers.

Marcin Pilarz, CEO at Talkin’ Things, said: ‘With our technology it is also possible to provide completely new experience with AR technology before and after the purchase.’