Determining gender differential item functioning for mathematics in coeducational school culture

Purpose - In an attempt to explore item characteristics that behave differently between boys and girls, this comparative study examines gender Differential Item Functioning in a school culture that is noted to be ‘thriving’ mathematically.Methodology - Some 24 grade eight mathematics items from TIMS...

Full description

Saved in:
Bibliographic Details
Main Author: Shanmugam, S. Kanageswari Suppiah
Format: Article
Language:English
Published: Universiti Utara Malaysia Press 2018
Subjects:
Online Access:http://repo.uum.edu.my/25579/1/MJLI%2015%202%202018%2083-109.pdf
http://repo.uum.edu.my/25579/
http://www.mjli.uum.edu.my/index.php/cur-issues#a4
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Universiti Utara Malaysia
Language: English
id my.uum.repo.25579
record_format eprints
spelling my.uum.repo.255792019-02-14T06:41:54Z http://repo.uum.edu.my/25579/ Determining gender differential item functioning for mathematics in coeducational school culture Shanmugam, S. Kanageswari Suppiah L Education (General) Purpose - In an attempt to explore item characteristics that behave differently between boys and girls, this comparative study examines gender Differential Item Functioning in a school culture that is noted to be ‘thriving’ mathematically.Methodology - Some 24 grade eight mathematics items from TIMSS 2003 and TIMSS 2007 released items, with equal number of computation and word problem items were administered on 460 boys and 445 girls studying in Grade Eight from three secondary Chinese-medium coeducational schools. Word problem items were defined as items set in a real-world context. Content validity was established by constructing a table of specifications. By employing the software WINSTEPS version 3.67.0 that is based on the Rasch Model for dichotomous responses, Differential Item Functioning analysis was conducted by using Mantel-Haenszel Chi-square method. DIF items were flagged when the Mantel-Haenszel probability value was less than 0.05 and classified as negligible, moderate or large DIF based on the DIF size suggested by Educational Testing Service DIF category. The focal and reference groups were girls and boys respectively. The main delimitation was substantive analysis by using expert judgment was not conducted to identify biased items. Findings - Using Mantel-Haenszel chi-square, two moderate DIF items that assess subtraction favoured girls. They assessed Knowing from topics Whole Number and Fraction. Sources of DIF are linguistics density and item presentation style. The findings suggest that with only two moderate DIF mathematics items, there is insufficient evidence to suggest that the mathematics items functioned differently between boys and girls in school culture noted for successful mathematics learning, even though linguistics complexities of the test language cannot be ignored.Significance - While constructing Mathematics multiple choice items, careful considerations need to be given in selecting suitable numbers in composing the content of the item so that, only the correct algorithm would produce the correct answer ‘if and only if’ those numbers are used. The modest results of detecting two moderate DIF items nevertheless inform national testing agencies and teacher educators on the principles of building fair items as a part of their test improvement practice in the 21st Century. The novelty of this study is that gender Differential Item Functioning was studied in the context of school culture, which is notable for successful mathematics learning. Universiti Utara Malaysia Press 2018 Article PeerReviewed application/pdf en http://repo.uum.edu.my/25579/1/MJLI%2015%202%202018%2083-109.pdf Shanmugam, S. Kanageswari Suppiah (2018) Determining gender differential item functioning for mathematics in coeducational school culture. Malaysian Journal of Learning and Instruction (MJLI), 15 (2). pp. 83-109. ISSN 1675-8110 http://www.mjli.uum.edu.my/index.php/cur-issues#a4
institution Universiti Utara Malaysia
building UUM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Utara Malaysia
content_source UUM Institutionali Repository
url_provider http://repo.uum.edu.my/
language English
topic L Education (General)
spellingShingle L Education (General)
Shanmugam, S. Kanageswari Suppiah
Determining gender differential item functioning for mathematics in coeducational school culture
description Purpose - In an attempt to explore item characteristics that behave differently between boys and girls, this comparative study examines gender Differential Item Functioning in a school culture that is noted to be ‘thriving’ mathematically.Methodology - Some 24 grade eight mathematics items from TIMSS 2003 and TIMSS 2007 released items, with equal number of computation and word problem items were administered on 460 boys and 445 girls studying in Grade Eight from three secondary Chinese-medium coeducational schools. Word problem items were defined as items set in a real-world context. Content validity was established by constructing a table of specifications. By employing the software WINSTEPS version 3.67.0 that is based on the Rasch Model for dichotomous responses, Differential Item Functioning analysis was conducted by using Mantel-Haenszel Chi-square method. DIF items were flagged when the Mantel-Haenszel probability value was less than 0.05 and classified as negligible, moderate or large DIF based on the DIF size suggested by Educational Testing Service DIF category. The focal and reference groups were girls and boys respectively. The main delimitation was substantive analysis by using expert judgment was not conducted to identify biased items. Findings - Using Mantel-Haenszel chi-square, two moderate DIF items that assess subtraction favoured girls. They assessed Knowing from topics Whole Number and Fraction. Sources of DIF are linguistics density and item presentation style. The findings suggest that with only two moderate DIF mathematics items, there is insufficient evidence to suggest that the mathematics items functioned differently between boys and girls in school culture noted for successful mathematics learning, even though linguistics complexities of the test language cannot be ignored.Significance - While constructing Mathematics multiple choice items, careful considerations need to be given in selecting suitable numbers in composing the content of the item so that, only the correct algorithm would produce the correct answer ‘if and only if’ those numbers are used. The modest results of detecting two moderate DIF items nevertheless inform national testing agencies and teacher educators on the principles of building fair items as a part of their test improvement practice in the 21st Century. The novelty of this study is that gender Differential Item Functioning was studied in the context of school culture, which is notable for successful mathematics learning.
format Article
author Shanmugam, S. Kanageswari Suppiah
author_facet Shanmugam, S. Kanageswari Suppiah
author_sort Shanmugam, S. Kanageswari Suppiah
title Determining gender differential item functioning for mathematics in coeducational school culture
title_short Determining gender differential item functioning for mathematics in coeducational school culture
title_full Determining gender differential item functioning for mathematics in coeducational school culture
title_fullStr Determining gender differential item functioning for mathematics in coeducational school culture
title_full_unstemmed Determining gender differential item functioning for mathematics in coeducational school culture
title_sort determining gender differential item functioning for mathematics in coeducational school culture
publisher Universiti Utara Malaysia Press
publishDate 2018
url http://repo.uum.edu.my/25579/1/MJLI%2015%202%202018%2083-109.pdf
http://repo.uum.edu.my/25579/
http://www.mjli.uum.edu.my/index.php/cur-issues#a4
_version_ 1644284365821181952