A semi-autonomous robotic system with alignment control for the occluded object using visual servoing and computational intelligence

• Main Author: Rogelio, Jayson P.
• Format: text
• Language: English
• Published: Animo Repository 2024
• Subjects: Robotics; Servomechanisms; Automatic control; Controls and Control Theory; Electrical and Computer Engineering; Engineering
• Online Access: https://animorepository.dlsu.edu.ph/etdd_ece/7; https://animorepository.dlsu.edu.ph/context/etdd_ece/article/1011/viewcontent/A_semi_autonomous_robotic_system_with_alignment_control_for_the_o.pdf
• Institution: De La Salle University

Aligning a mobile X-ray system in challenging environments, such as bomb-surrounded areas, poses difficulties due to safety concerns and occlusion. This study introduces a novel approach employing 6D object pose estimation and pose correction by integrating DeepLabV3 and iterative dense fusion into the visual servoing mechanism. The robotic system exhibits enhanced accuracy in detecting and aligning the occluded known 3D object model x-ray source to film. Evaluation metrics, including intersection-over-union and mean average, demonstrate high accuracy percentages for detecting the body (98.91%), handle (96.57%), and aperture (89.54%). The mean IoU for each part of the 3D model portable X-ray source ranges from 65.69% to 76.42%. Pose estimation accuracy, assessed through the ADD metric, indicates superior performance for static pose estimation closer to the camera. Dynamic pose estimation exhibits higher average ADD metrics in scenes with total occlusion. The robustness metric reveals lower lost tracking counts in scenes without occlusion, emphasizing the algorithm's challenges in fully occluded scenarios. The film handler alignment system, characterized by kinematic formulation and actuator calibration data, shows minimal errors in X and Y actuation (