AudioSense: Sound-based shopper behavior analysis system

This paper presents AudioSense, the system to monitor user-item interactions inside a store hence enabling precisely customized promotions. A shopper's smartwatch emits sound every time the shopper picks up or touches an item inside a store. This sound is then localized, in 2D space, by calcula...

Full description

Saved in:
Bibliographic Details
Main Authors: SHARMA, Amit, LEE, Youngki
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2017
Subjects:
AoA
Online Access:https://ink.library.smu.edu.sg/sis_research/3839
https://ink.library.smu.edu.sg/context/sis_research/article/4841/viewcontent/p488_sharma__1_.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
Description
Summary:This paper presents AudioSense, the system to monitor user-item interactions inside a store hence enabling precisely customized promotions. A shopper's smartwatch emits sound every time the shopper picks up or touches an item inside a store. This sound is then localized, in 2D space, by calculating the angles of arrival captured by multiple microphones deployed on the racks. Lastly, the 2D location is mapped to specific items on the rack based on the rack layout information. In our initial experiments conducted with a single rack with 16 compartments, we could localize the shopper's smartwatch with a median estimation error of 15.9 cm in 2-dimensional space.