Are vision language models multimodal learners?
Since the release of accessible vision language models (VLMs) such as GPT-4V and Gemini Pro in 2023, scholars have envisaged utilizing these artificial intelligence (AI) models to widely support instructors and learners. Particularly, their capability to simultaneously process visual and textual dat...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Conference or Workshop Item |
| Language: | English |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/181109 https://www.ntu.edu.sg/mae/ai-education-singapore-2024/activities/keynote-invited-talk#Content_C021_Col00 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Institution: | Nanyang Technological University |
| Language: | English |
| Summary: | Since the release of accessible vision language models (VLMs) such as GPT-4V and Gemini Pro in 2023, scholars have envisaged utilizing these artificial intelligence (AI) models to widely support instructors and learners. Particularly, their capability to simultaneously process visual and textual data and yield subsequent information is considered one of the most important features of these user-friendly VLMs. This capability is significant as human cognition benefits from multimodality, which has called for teaching, learning, and evaluation to be conducted in more diverse, sophisticated, and constructive ways. However, these multimodal educational practices are yet to be realized in everyday classrooms, while the integration of AI promises to facilitate this transformation.
In this talk, we will review the hypothesized parallelism between humans and VLMs as multimodal learners and its implications for the potential role of AI models in future education. Additionally, we will discuss the limitations, challenges, and possible remedies to effectively integrate these models into educational settings. |
|---|