Automation of scraping for conflict of interest in webpages

• Main Author: Lee, Ming Jia
• Other Authors: Sourav S Bhowmick
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Computer and Information Science; Web scraping
• Online Access: https://hdl.handle.net/10356/181181
• Institution: Nanyang Technological University

As the world advances in technology, researchers compete to submit their papers to gain recognition and to show advances in technology. However, just as these calls are held by people, some of these submissions could be submitted by those who had recent contact or relations with the organiser of the events. As a result, this could result in an unfair competition, leading to conflict of interest between the organisers and candidates. Hence, during the submission of a paper, the submission sites will request information about conflicts of interest of the paper's authors with program committee (PC) members. This project presents the development of an automation python-based application that can be used to extract for information relating to conflict of interest related to an event. The goal of this project is to automate the process so that it can be done on multiple webpages at the same time, hence not requiring the user to individually type down every webpage to be scraped from. Future work on the application will focus on optimising the code to prevent the code from extracting excessive information as well as improving its capabilities in scraping other information stored in the webpage.