Handwritten mathematical expression recognition

As digital form has been used more and more frequently for text documents but typing mathematical expressions remains difficult, it is crucial to develop an effective system that can read handwritten mathematical expressions. In this project, we try to solve the problem of handwritten mathematical...

Full description

Saved in:
Bibliographic Details
Main Author: Hu, Zhuangyu
Other Authors: Loke Yuan Ren
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2022
Subjects:
Online Access:https://hdl.handle.net/10356/156608
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:As digital form has been used more and more frequently for text documents but typing mathematical expressions remains difficult, it is crucial to develop an effective system that can read handwritten mathematical expressions. In this project, we try to solve the problem of handwritten mathematical expression recognition by an encoder-decoder model with the help of neural networks, which can convert handwritten mathematical expressions in images to LaTeX representations. We also try to enhance the weight assignment of the attention mechanism in the decoder to improve the performance of the model on pairwise symbols. By training and testing with the CROHME 2019 dataset, the model achieves an expression recognition rate of 39.8% and our enhancement increases the expression recognition rate to 42.1%.