Adjusting bilingual ratings by retest reliability improves estimation of translation quality
The quality of cross-language scale translations is often explored by having bilingual participants complete the scale in both languages and then correlating their scores. However, low cross-language correlations can be observed due to score unreliability rather than due to poor scale translation. M...
Saved in:
Main Authors: | , , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2020
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/137281 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-137281 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1372812020-03-13T05:58:07Z Adjusting bilingual ratings by retest reliability improves estimation of translation quality Wood, Dustin Qiu, Lin Lu, Jiahui Lin, Han Tov, William School of Social Sciences Social sciences::Psychology Scale Translation Translation Quality The quality of cross-language scale translations is often explored by having bilingual participants complete the scale in both languages and then correlating their scores. However, low cross-language correlations can be observed due to score unreliability rather than due to poor scale translation. McCrae, Yik, Trapnell, Bond, and Paulhus suggested that a better indicator of translation quality can be formed by dividing the raw cross-language correlation by the same-language retest correlations over a similar measurement interval. Here, we illustrate how this method can be extended to evaluate the translation quality of individual items. We translated the English version of the Inventory of Individual Differences in the Lexicon (IIDL) into Chinese, and within a single survey session participants either completed the instrument either in both languages (N = 151 bilingual participants) or twice in Chinese (N = 94) or in English (N = 82). Finally, additional bilingual participants (N = 46) rated the perceived translation quality of each item. Variation in the cross-language correlations across items predicted perceived translation quality, however, adjusting for same-language retest correlations resulted in significantly stronger indicators of perceived translation quality. The present study thus indicates the validity of McCrae et al.’s general method, and demonstrates that it can be extended to designs where all participants complete a single test session and can be applied to evaluate the quality of translations of single items. Accepted version 2020-03-13T05:58:07Z 2020-03-13T05:58:07Z 2018 Journal Article Wood, D., Qiu, L., Lu, J., Lin, H., & Tov, W. (2018). Adjusting bilingual ratings by retest reliability improves estimation of translation quality. Journal of Cross-Cultural Psychology, 49(9), 1325-1339. doi:10.1177/0022022118789773 0022-0221 https://hdl.handle.net/10356/137281 10.1177/0022022118789773 2-s2.0-85052593641 9 49 1325 1339 en Journal of Cross-Cultural Psychology © 2018 The Author(s). All rights reserved. This paper was published by SAGE Publications in Journal of Cross-Cultural Psychology and is made available with permission of The Author(s). application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
country |
Singapore |
collection |
DR-NTU |
language |
English |
topic |
Social sciences::Psychology Scale Translation Translation Quality |
spellingShingle |
Social sciences::Psychology Scale Translation Translation Quality Wood, Dustin Qiu, Lin Lu, Jiahui Lin, Han Tov, William Adjusting bilingual ratings by retest reliability improves estimation of translation quality |
description |
The quality of cross-language scale translations is often explored by having bilingual participants complete the scale in both languages and then correlating their scores. However, low cross-language correlations can be observed due to score unreliability rather than due to poor scale translation. McCrae, Yik, Trapnell, Bond, and Paulhus suggested that a better indicator of translation quality can be formed by dividing the raw cross-language correlation by the same-language retest correlations over a similar measurement interval. Here, we illustrate how this method can be extended to evaluate the translation quality of individual items. We translated the English version of the Inventory of Individual Differences in the Lexicon (IIDL) into Chinese, and within a single survey session participants either completed the instrument either in both languages (N = 151 bilingual participants) or twice in Chinese (N = 94) or in English (N = 82). Finally, additional bilingual participants (N = 46) rated the perceived translation quality of each item. Variation in the cross-language correlations across items predicted perceived translation quality, however, adjusting for same-language retest correlations resulted in significantly stronger indicators of perceived translation quality. The present study thus indicates the validity of McCrae et al.’s general method, and demonstrates that it can be extended to designs where all participants complete a single test session and can be applied to evaluate the quality of translations of single items. |
author2 |
School of Social Sciences |
author_facet |
School of Social Sciences Wood, Dustin Qiu, Lin Lu, Jiahui Lin, Han Tov, William |
format |
Article |
author |
Wood, Dustin Qiu, Lin Lu, Jiahui Lin, Han Tov, William |
author_sort |
Wood, Dustin |
title |
Adjusting bilingual ratings by retest reliability improves estimation of translation quality |
title_short |
Adjusting bilingual ratings by retest reliability improves estimation of translation quality |
title_full |
Adjusting bilingual ratings by retest reliability improves estimation of translation quality |
title_fullStr |
Adjusting bilingual ratings by retest reliability improves estimation of translation quality |
title_full_unstemmed |
Adjusting bilingual ratings by retest reliability improves estimation of translation quality |
title_sort |
adjusting bilingual ratings by retest reliability improves estimation of translation quality |
publishDate |
2020 |
url |
https://hdl.handle.net/10356/137281 |
_version_ |
1681034349967835136 |