CURSOR CONTROL WITH OPENCV USING SMARTPHONE CAMERA

• Main Author: Johanes
• Format: Final Project
• Language: Indonesia
• Online Access: https://digilib.itb.ac.id/gdl/view/56085
• Institution: Institut Teknologi Bandung

With the current pandemic condition, most of the interaction process must be done remotely. One of the interactions that often occurs is the discussion process. There are many online discussion media, such as Google Jamboard or Microsoft Whiteboard. However, commonly used input devices such as the mouse and trackpad are not easy to use for digital drawing. Indeed, other input devices facilitate this interaction, such as a digital writing pad, but if needed in large quantities it will be expensive. Therefore, this final project proposed a solution to simulate the functionality of a digital writing pad with a more economical approach. This solution uses a smartphone and a pen for interactive media. The smartphone will act as a wireless camera that is connected to a computer via a local network with Wi-Fi. The computer will process the video sent from the smartphone and the results of which will be used to simulate the cursor action. Testing of this application was carried out by six volunteers who tried to prepare and use this application. At the testing, the application can run well to move and make the cursor click. However, there are several problems with the solution. First, the difficulty of preparing the environment that will be used to run this application. It is difficult to find a place with proper lighting from above and producing clear shadows. Second, the difficulty in detecting the user's movement while using the application. This problem is caused by the pen that is out of the observable area and shadows that are too small to be processed by the application. Lastly, the existence of a serif effect caused by the movement of the tip location of the shadow. The tip location of the shadow moves when the pen hits the surface which will cover the shadow's area. In the end, this application can be used to replace the mouse and trackpad for digital drawing at a more economical cost when compared to buying a new tool even though the preparation process is more complicated.