Ubiquitous shortcuts : mnemonics by just taking photos

• Main Authors: Pang, Natalie, Rissanen, Mikko J., Foo, Schubert, Fernando, Owen Noel Newton, Iroshan, Horathalge, Vu, Samantha
• Other Authors: School of Humanities and Social Sciences
• Format: Conference or Workshop Item
• Language: English
• Published: 2013
• Subjects: DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
• Online Access: https://hdl.handle.net/10356/96043; http://hdl.handle.net/10220/10077
• Institution: Nanyang Technological University

Ubiquitous Shortcuts is an image processing based method for making and using mnemonics set onto the real world using smartphones or other computing systems. The mnemonics can be created by taking photos of the user's vicinity and by binding them onto command sequences. The mnemonic is triggered every time a similar photo is taken. Our method uses natural feature matching algorithms and end-user programming approaches. The mnemonics can be concatenated into more complex command sequences. Thus, limited user input is realized by just taking photos with a camera embedded into a finger-ring, which enables rapid, subtle and socially acceptable user interaction. Our method can be used as semi-automatic way of achieving location and context sensitive services, activity recognition or tangible interaction.