Towards effective graph representations by leveraging geometric concepts
The field of graph representation learning (GRL) is dedicated to the task of encoding graph-structured data into low-dimensional vectors, often referred to as embeddings. Obtaining effective representations for various graph-related tasks, such as node classification and link prediction, hinges on e...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Thesis-Doctor of Philosophy |
Language: | English |
Published: |
Nanyang Technological University
2024
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/177895 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-177895 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1778952024-06-03T05:15:59Z Towards effective graph representations by leveraging geometric concepts Lee, See Hian Tay Wee Peng School of Electrical and Electronic Engineering Shopee Singapore Private Limited wptay@ntu.edu.sg Computer and Information Science Graph neural networks Graph representation learning Machine learning The field of graph representation learning (GRL) is dedicated to the task of encoding graph-structured data into low-dimensional vectors, often referred to as embeddings. Obtaining effective representations for various graph-related tasks, such as node classification and link prediction, hinges on effectively leveraging both the attributes and structural aspects of the graph data. A prominent approach for acquiring these graph representations involves the utilization of Graph Neural Networks (GNNs), a specialized class of neural networks designed for learning from graph data. Existing GNNs have limitations that can be mitigated by tailoring refinements based on the graph data's characteristics, enabling a more effective capture of graph intricacies. These improvements stand to benefit various applications, such as recommendation systems and social networks, as the graph structure often unveils valuable latent information. This thesis investigates the application of geometric concepts in GNNs and proposes techniques inspired by these concepts to improve the embeddings learned. Firstly, we propose an approach that leverages multiple geometric spaces to embed nodes, guided by a hyperbolicity measure. This accounts for the diverse underlying geometry in different regions of a graph, minimizing distortion and yielding refined representations by selecting the more appropriate space. Secondly, we present a method that integrates geometric structures, such as triangles and tetrahedrons, into GNNs by incorporating the concept of simplicial complexes. This integration enriches the expressive power of GNNs, enabling them to capture complex interactions that extend beyond pairwise connections. Lastly, we present a method that leverages multiple graphs with different topologies and geometries during the learning process. These additional graphs are generated by introducing latent variables into the framework. Learning the distribution of these graphs reveals useful topologies and geometries, providing additional information for both training and inference. Besides novel designs, we have conducted empirical assessments on graph-related tasks using benchmark datasets and compared our approaches to relevant baselines, confirming their effectiveness in improving graph representations. In summary, this thesis contributes to the progress in GRL by introducing three enhanced GNNs based on geometric concepts. Doctor of Philosophy 2024-06-03T05:15:59Z 2024-06-03T05:15:59Z 2024 Thesis-Doctor of Philosophy Lee, S. H. (2024). Towards effective graph representations by leveraging geometric concepts. Doctoral thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/177895 https://hdl.handle.net/10356/177895 en This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). application/pdf Nanyang Technological University |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Computer and Information Science Graph neural networks Graph representation learning Machine learning |
spellingShingle |
Computer and Information Science Graph neural networks Graph representation learning Machine learning Lee, See Hian Towards effective graph representations by leveraging geometric concepts |
description |
The field of graph representation learning (GRL) is dedicated to the task of encoding graph-structured data into low-dimensional vectors, often referred to as embeddings. Obtaining effective representations for various graph-related tasks, such as node classification and link prediction, hinges on effectively leveraging both the attributes and structural aspects of the graph data. A prominent approach for acquiring these graph representations
involves the utilization of Graph Neural Networks (GNNs), a specialized class of neural networks designed for learning from graph data. Existing GNNs have limitations that can be mitigated by tailoring refinements based on the graph data's characteristics, enabling a more effective capture of graph intricacies. These improvements stand to benefit various applications, such as recommendation systems and social networks, as the graph structure often unveils valuable latent information.
This thesis investigates the application of geometric concepts in GNNs and proposes techniques inspired by these concepts to improve the embeddings learned. Firstly, we propose an approach that leverages multiple geometric spaces to embed nodes, guided by a hyperbolicity measure. This accounts for the diverse underlying geometry in different regions of a graph, minimizing distortion and yielding refined representations by selecting the more appropriate space. Secondly, we present a method that integrates geometric structures, such as triangles and tetrahedrons, into GNNs by incorporating the concept of simplicial complexes. This integration enriches the expressive power of GNNs, enabling them to capture complex interactions that extend beyond pairwise connections. Lastly, we present a method that leverages multiple graphs with different topologies and geometries during the learning process. These additional graphs are generated by introducing latent variables into the framework. Learning the distribution of these graphs reveals useful topologies and geometries, providing additional information for both training and inference.
Besides novel designs, we have conducted empirical assessments on graph-related tasks using benchmark datasets and compared our approaches to relevant baselines, confirming their effectiveness in improving graph representations. In summary, this thesis contributes to the progress in GRL by introducing three enhanced GNNs based on geometric concepts. |
author2 |
Tay Wee Peng |
author_facet |
Tay Wee Peng Lee, See Hian |
format |
Thesis-Doctor of Philosophy |
author |
Lee, See Hian |
author_sort |
Lee, See Hian |
title |
Towards effective graph representations by leveraging geometric concepts |
title_short |
Towards effective graph representations by leveraging geometric concepts |
title_full |
Towards effective graph representations by leveraging geometric concepts |
title_fullStr |
Towards effective graph representations by leveraging geometric concepts |
title_full_unstemmed |
Towards effective graph representations by leveraging geometric concepts |
title_sort |
towards effective graph representations by leveraging geometric concepts |
publisher |
Nanyang Technological University |
publishDate |
2024 |
url |
https://hdl.handle.net/10356/177895 |
_version_ |
1800916333830864896 |