Assessing critical thinking disposition through text analysis in traditional Chinese: An empirical study of tourism and gaming undergraduates in Macao

Critical thinking disposition (CTD) is increasingly recognized as an important trait in education, reflecting the inclination and habits necessary for addressing complex challenges in today's world. This study assessed the CTD of students enrolled in a tourism and gaming management programme, focusing on two key dimensions: Analyticity and Open-Mindedness. This study was conducted at a university in Macao and involved 65 participants. The students were presented with an article relevant to their major, written in Traditional Chinese, and were asked to provide their opinions on each statement in the article. A rubric was designed to analyze their responses and assess their Analyticity and Open-Mindedness within the CTD framework. The results demonstrated high reliability (Cronbach's α = 0.91) and revealed an association between Analyticity and Open-Mindedness. Using Python programming, the study analyzed the frequency of parts of speech (POS) in students' responses, introducing a novel approach for evaluating CTD in Traditional Chinese. Regression modeling showed that parallel and adversative conjunctions significantly predicted Analyticity, while the frequency of conjunction use varied across Open-Mindedness classifications. These findings highlighted an innovative and objective method for assessing CTD through text analysis, offering promising applications for educational research in Traditional Chinese-speaking contexts.