Does BERT understand idioms? A probing-based empirical study of BERT encodings of idioms
Understanding idioms is important in NLP. In this paper, we study to what extent pre-trained BERT model can encode the meaning of a potentially idiomatic expression (PIE) in a certain context. We make use of a few existing datasets and perform two probing tasks: PIE usage classification and idiom pa...
Saved in:
Main Authors: | TAN, Minghuan, JIANG, Jing |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2021
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/6722 https://ink.library.smu.edu.sg/context/sis_research/article/7725/viewcontent/2021.ranlp_1.156.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
Similar Items
-
A BERT-based dual embedding model for Chinese idiom prediction
by: TAN, Minghuan, et al.
Published: (2020) -
Learning and evaluating Chinese idiom embeddings
by: TAN, Minghuan, et al.
Published: (2021) -
Chinese idiom understanding with transformer-based pretrained language models
by: TAN, Minghuan
Published: (2022) -
A BERT-based two-stage model for Chinese Chengyu recommendation
by: TAN, Minghuan, et al.
Published: (2021) -
Wav-BERT: Cooperative acoustic and linguistic representation learning for low-resource speech recognition
by: ZHENG, Guolin, et al.
Published: (2021)