Adjusting Bilingual Ratings by Retest Reliability Improves Estimation of Translation Quality
The quality of cross-language scale translations is often explored by having bilingual participants complete the scale in both languages and then correlating their scores. However, low cross-language correlations can be observed due to score unreliability rather than due to poor scale translation. M...
Saved in:
Main Authors: | , , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2018
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/soss_research/3845 https://ink.library.smu.edu.sg/context/soss_research/article/5103/viewcontent/wood_et_al_2018_adjusting_bilingual_ratings_by_retest_reliability_improves_estimation_of_translation_quality.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.soss_research-5103 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.soss_research-51032023-12-12T08:58:01Z Adjusting Bilingual Ratings by Retest Reliability Improves Estimation of Translation Quality WOOD, Dustin QIU, Lin LU, Jiahui LIN, Han TOV, William The quality of cross-language scale translations is often explored by having bilingual participants complete the scale in both languages and then correlating their scores. However, low cross-language correlations can be observed due to score unreliability rather than due to poor scale translation. McCrae, Yik, Trapnell, Bond, and Paulhus suggested that a better indicator of translation quality can be formed by dividing the raw cross-language correlation by the same-language retest correlations over a similar measurement interval. Here, we illustrate how this method can be extended to evaluate the translation quality of individual items. We translated the English version of the Inventory of Individual Differences in the Lexicon (IIDL) into Chinese, and within a single survey session participants either completed the instrument either in both languages (N = 151 bilingual participants) or twice in Chinese (N = 94) or in English (N = 82). Finally, additional bilingual participants (N = 46) rated the perceived translation quality of each item. Variation in the cross-language correlations across items predicted perceived translation quality, however, adjusting for same-language retest correlations resulted in significantly stronger indicators of perceived translation quality. The present study thus indicates the validity of McCrae et al.’s general method, and demonstrates that it can be extended to designs where all participants complete a single test session and can be applied to evaluate the quality of translations of single items. 2018-10-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/soss_research/3845 info:doi/10.1177/0022022118789773 https://ink.library.smu.edu.sg/context/soss_research/article/5103/viewcontent/wood_et_al_2018_adjusting_bilingual_ratings_by_retest_reliability_improves_estimation_of_translation_quality.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School of Social Sciences eng Institutional Knowledge at Singapore Management University scale translation translation quality scale reliability bilingual within-session retest Multicultural Psychology Social Psychology |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
scale translation translation quality scale reliability bilingual within-session retest Multicultural Psychology Social Psychology |
spellingShingle |
scale translation translation quality scale reliability bilingual within-session retest Multicultural Psychology Social Psychology WOOD, Dustin QIU, Lin LU, Jiahui LIN, Han TOV, William Adjusting Bilingual Ratings by Retest Reliability Improves Estimation of Translation Quality |
description |
The quality of cross-language scale translations is often explored by having bilingual participants complete the scale in both languages and then correlating their scores. However, low cross-language correlations can be observed due to score unreliability rather than due to poor scale translation. McCrae, Yik, Trapnell, Bond, and Paulhus suggested that a better indicator of translation quality can be formed by dividing the raw cross-language correlation by the same-language retest correlations over a similar measurement interval. Here, we illustrate how this method can be extended to evaluate the translation quality of individual items. We translated the English version of the Inventory of Individual Differences in the Lexicon (IIDL) into Chinese, and within a single survey session participants either completed the instrument either in both languages (N = 151 bilingual participants) or twice in Chinese (N = 94) or in English (N = 82). Finally, additional bilingual participants (N = 46) rated the perceived translation quality of each item. Variation in the cross-language correlations across items predicted perceived translation quality, however, adjusting for same-language retest correlations resulted in significantly stronger indicators of perceived translation quality. The present study thus indicates the validity of McCrae et al.’s general method, and demonstrates that it can be extended to designs where all participants complete a single test session and can be applied to evaluate the quality of translations of single items. |
format |
text |
author |
WOOD, Dustin QIU, Lin LU, Jiahui LIN, Han TOV, William |
author_facet |
WOOD, Dustin QIU, Lin LU, Jiahui LIN, Han TOV, William |
author_sort |
WOOD, Dustin |
title |
Adjusting Bilingual Ratings by Retest Reliability Improves Estimation of Translation Quality |
title_short |
Adjusting Bilingual Ratings by Retest Reliability Improves Estimation of Translation Quality |
title_full |
Adjusting Bilingual Ratings by Retest Reliability Improves Estimation of Translation Quality |
title_fullStr |
Adjusting Bilingual Ratings by Retest Reliability Improves Estimation of Translation Quality |
title_full_unstemmed |
Adjusting Bilingual Ratings by Retest Reliability Improves Estimation of Translation Quality |
title_sort |
adjusting bilingual ratings by retest reliability improves estimation of translation quality |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2018 |
url |
https://ink.library.smu.edu.sg/soss_research/3845 https://ink.library.smu.edu.sg/context/soss_research/article/5103/viewcontent/wood_et_al_2018_adjusting_bilingual_ratings_by_retest_reliability_improves_estimation_of_translation_quality.pdf |
_version_ |
1787136851509772288 |