Deep learning-based image captioning

A Common problem linking computer vision and natural language processing is the ability to generate an accurate caption for a given image. In this paper, various approaches of image captioning models towards achieving state of the art results are studied. After the various approaches are studied, th...

Full description

Saved in:
Bibliographic Details
Main Author: Chong, Kaydon
Other Authors: Zhang Hanwang
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2019
Subjects:
Online Access:https://hdl.handle.net/10356/136507
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:A Common problem linking computer vision and natural language processing is the ability to generate an accurate caption for a given image. In this paper, various approaches of image captioning models towards achieving state of the art results are studied. After the various approaches are studied, the best approaches are then extracted and then recombined into a new single model in hopes to achieve a new state of the art model. A comparison of each model’s result will be used to determine the best performing model to be implemented. In this paper, we study the model of 2 different groups that created their image captioning model. They are namely the Google Brain team and the team that won the 2017 Visual Question Answering (VQA) Challenge in 2017.