Email this article Psychometric Properties of the Course Interest Survey (CIS) : A Confirmatory Factor Analysis
Abstract
This study aims to evaluate the psychometric properties of the Indonesian version of the CIS using Confirmatory Factor Analysis (CFA). This research used an analytical approach and psychometric methods. Participants comprised 112 high school students aged 15 to 17 in Pekanbaru, Indonesia. CIS consists of 34 statement items with four subscales: attention, relevance, confidence, and satisfaction. Data analysis in Confirmatory Factor Analysis was carried out through Mplus 8.11 and SmartPLS. The results showed that CIS performed well on all psychometric indicators: CFI, TLI, RMSEA, outer loading, and AVE. The RMSEA value is 0.107 > 0.08, the CFI value is 0.710 < 0.90, the TLI value is 0.689 < 0.90, and the SRMR value is 0.098 > 0.08. All items and subscales in the motivation variable are valid with outer loading item values > 0.7 and AVE values > 0.5. Based on CFI and TLI, the CIS model is a good fit and can be accepted. Furthermore, the four dimensions or subscales of the CIS—namely, attention, relevance, confidence, and satisfaction—demonstrate adequate psychometric properties. Based on the findings of this study, it can be concluded that the Indonesian version of the CIS is a valid, reliable, and robust instrument for assessing motivation. The implication of this research is that educators can assess student motivation using the CIS instrument because it has been proven to be able to measure elements of motivation.
Keywords
Full Text:
PDFReferences
Alamri, Hamdan, Victoria Lowell, William Watson, and Sunnie Lee Watson. (2020). “Using Personalized Learning as an Instructional Approach to Motivate Learners in Online Higher Education: Learner Self-Determination and Intrinsic Motivation.” Journal of Research on Technology in Education 52(3):322–52.
Ali, Bayad Jamal, and Govand Anwar. (2021). “An Empirical Study of Employees’ Motivation and Its Influence Job Satisfaction.” Ali, BJ, & Anwar, G.(2021). An Empirical Study of Employees’ Motivation and Its Influence Job Satisfaction. International Journal of Engineering, Business and Management 5(2):21–30.
Amtu, Onisimus, Korlina Makulua, Jacoba Matital, and Claudia Monique Pattiruhu. (2020). “Improving Student Learning Outcomes through School Culture, Work Motivation and Teacher Performance.” International Journal of Instruction 13(4):885–902.
Anderman, Eric M. (2020). “Achievement Motivation Theory: Balancing Precision and Utility.” Contemporary Educational Psychology 61:101864.
Angelopoulou, Effrosyni, and Athanasios Drigas. (2021). “Working Memory, Attention and Their Relationship: A Theoretical Overview.” Research, Society and Development 10(5):e46410515288–e46410515288.
Bayes, Robin, James N. Druckman, Avery Goods, and Daniel C. Molden. (2020). “When and How Different Motives Can Drive Motivated Political Reasoning.” Political Psychology 41(5):1031–52.
Bhagat, Kaushal Kumar, Cheng-Nan Chang, and Chun-Yen Chang. (2016). “The Impact of the Flipped Classroom on Mathematics Concept Learning in High School.” Journal of Educational Technology & Society 19(3):134–42.
Blum, Alan F., and Peter McHugh. (2020). “The Social Ascription of Motives.” Pp. 491–509 in Toward a Sociology of Education. Routledge.
Brady, William J., Molly J. Crockett, and Jay J. Van Bavel. (2020). “The MAD Model of Moral Contagion: The Role of Motivation, Attention, and Design in the Spread of Moralized Content Online.” Perspectives on Psychological Science 15(4):978–1010.
Bureau, Julien S., Joshua L. Howard, Jane X. Y. Chong, and Frédéric Guay. (2022). “Pathways to Student Motivation: A Meta-Analysis of Antecedents of Autonomous and Controlled Motivations.” Review of Educational Research 92(1):46–72.
Cai, Li, Seung Won Chung, and Taehun Lee. (2023). “Incremental Model Fit Assessment in the Case of Categorical Data: Tucker–Lewis Index for Item Response Theory Modeling.” Prevention Science 24(3):455–66.
Caldeiira, Amélia, Sofia O. Lopes, Alexandra R. Costa, and Isabel Figueiredo. (2020). “The Effects of Motivation in Student Academic Success.” Pp. 1444–50 in 2020 IEEE Global Engineering Education Conference (EDUCON). IEEE.
Chengjun, Ma, and Siti Salina Mustakim. (2022). “Relationship Between Motivation and Learning Outcomes in E-Learning among University Students in Malaysia.” International Journal of Academic Research in Progressive Education and Development 11(2):666–76.
Chiu, Thomas K. F., Tzung-Jin Lin, and Kirsti Lonka. (2021). “Motivating Online Learning: The Challenges of COVID-19 and Beyond.” The Asia-Pacific Education Researcher 30(3):187–90.
Cook, David A., and Lee P. Skrupky. (2023). “Measuring Personalization, Embodiment, and Congruence in Online Learning: A Validation Study.” Academic Medicine 98(3):357–66.
Cook, David A., and Lee P. Skrupky. (2024). “Validation of the Motivated Strategies for Learning Questionnaire and Instructional Materials Motivation Survey.” Medical Teacher 1–11.
Cowan, Nelson, Chenye Bao, Brittney M. Bishop-Chrzanowski, Amy N. Costa, Nathaniel R. Greene, Dominic Guitard, Chenyuan Li, Madison L. Musich, and Zehra E. Ünal. (2024). “The Relation between Attention and Memory.” Annual Review of Psychology 75(1):183–214.
Crawford, Gemma, and Sharyn Burns. (2020). “Confidence and Motivation to Help Those with a Mental Health Problem: Experiences from a Study of Nursing Students Completing Mental Health First Aid (MHFA) Training.” BMC Medical Education 20:1–10.
Douglas, Kerrie A., Hillary E. Merzdorf, Nathan M. Hicks, Muhammad Ihsanulhaq Sarfraz, and Peter Bermel. (2020). “Challenges to Assessing Motivation in MOOC Learners: An Application of an Argument-Based Approach.” Computers & Education 150:103829.
Eccles, Jacquelynne S., and Allan Wigfield. (2020). “From Expectancy-Value Theory to Situated Expectancy-Value Theory: A Developmental, Social Cognitive, and Sociocultural Perspective on Motivation.” Contemporary Educational Psychology 61:101859.
Elizondo-Noriega, A., F. Salas-Diaz, A. Guerrero-Cerrano, C. Alcantar-Nieblas, N. Tiruvengadam, Luis C. Félix-Herrán, T. Tapia-Tlatelpa, L. Lozano-Taba, J. A. Castro-Echeverría, and O. Galindo-Hernández. (2024). “Adaptation of Keller’s IMMS Questionnaire to Measure Undergraduate Class Motivation.” Pp. 1–7 in 2024 Portland International Conference on Management of Engineering and Technology (PICMET). IEEE.
Esposito, Rosario, Stefania Prevete, Concetta Esposito, and Dario Bacchini. (2023). “Development and Validation of the Interpersonal Motivational Systems Questionnaire (IMS-Q).” Behavioral Sciences 13(9):784.
Fabrigar, Leandre R., and Duane T. Wegener. (2012). Exploratory Factor Analysis. Oxford University Press.
Gomes, Anabela, Wei Ke, Chan-Tong Lam, Maria José Marcelino, and António Mendes. (2018). “Student Motivation towards Learning to Program.” Pp. 1–8 in 2018 IEEE Frontiers in Education Conference (FIE). IEEE.
Greene, Moe D., and William M. Jones. (2020). “Analyzing Contextual Levels and Applications of Technological Pedagogical Content Knowledge (TPACK) in English as a Second Language Subject Area.” Educational Technology & Society 23(4):75–88.
Guay, Frédéric, Alexandre J. S. Morin, David Litalien, Joshua L. Howard, and William Gilbert. (2021). “Trajectories of Self-Determined Motivation during the Secondary School: A Growth Mixture Analysis.” Journal of Educational Psychology 113(2):390.
Hadi Mousavi, Majid Davoudi Nasr. (2020). “A New Decade for Social Changes.” Technium Social Sciences Journal 6(December):101–5.
Harefa, Darmawan, Murnihati Sarumaha, Kaminudin Telaumbanua, Tatema Telaumbanua, Baziduhu Laia, and Fatolosa Hulu. (2023). “Relationship Student Learning Interest to the Learning Outcomes of Natural Sciences.” International Journal of Educational Research & Social Sciences 4(2):240–46.
Hattie, John, Flaviu A. Hodis, and Sean H. K. Kang. (2020). “Theories of Motivation: Integration and Ways Forward.” Contemporary Educational Psychology 61:101865.
Hauze, Sean, and James Marshall. (2020). “Validation of the Instructional Materials Motivation Survey: Measuring Student Motivation to Learn via Mixed Reality Nursing Education Simulation.” Pp. 49–64 in International Journal on E-Learning. Association for the Advancement of Computing in Education (AACE).
Hava, Kevser. (2021). “Exploring the Role of Digital Storytelling in Student Motivation and Satisfaction in EFL Education.” Computer Assisted Language Learning 34(7):958–78.
Howard, Joshua L., Marylene Gagné, and Alexandre J. S. Morin. (2020). “Putting the Pieces Together: Reviewing the Structural Conceptualization of Motivation within SDT.” Motivation and Emotion 44:846–61.
Huang, Yueh-Min, Lusia Maryani Silitonga, and Ting-Ting Wu. (2022). “Applying a Business Simulation Game in a Flipped Classroom to Enhance Engagement, Learning Achievement, and Higher-Order Thinking Skills.” Computers & Education 183:104494.
Ify, Igbokwe Philomena. (2024). “Motivation and Job Performance.” International Research Journal of Economics and Management Studies IRJEMS 3(3).
Indarti, Indarti, Urip Wahyuningsih, Yulistiana Yulistiana, Ratna Suhartini, and Yuhri Inang Prihatina. (2021). “Faktor-Faktor Yang Mempengaruhi Kepuasan Belajar Jarak Jauh Mahasiswa Vokasi Di Masa Pandemi Covid-19.” Jurnal Pendidikan Teknologi Dan Kejuruan 18(2):226–36.
James, Phillip C. (2021). “What Determines Student Satisfaction in an E-Learning Environment? A Comprehensive Literature Review of Key Success Factors.” Higher Education Studies 11(3):1–9.
Keller, John M. (2009). Motivational Design for Learning and Performance: The ARCS Model Approach. Springer Science & Business Media.
Lai, Keke. (2021). “Fit Difference between Nonnested Models given Categorical Data: Measures and Estimation.” Structural Equation Modeling: A Multidisciplinary Journal 28(1):99–120.
Looney, Anne, Joy Cumming, Fabienne van Der Kleij, and Karen Harris. (2018). “Reconceptualising the Role of Teachers as Assessors: Teacher Assessment Identity.” Assessment in Education: Principles, Policy and Practice 25(5):442–67. doi: 10.1080/0969594X.2016.1268090.
Loorbach, Nicole, Oscar Peters, Joyce Karreman, and Michaël Steehouder. (2015). “Validation of the Instructional Materials Motivation Survey (IMMS) in a Self‐directed Instructional Setting Aimed at Working with Technology.” British Journal of Educational Technology 46(1):204–18.
Luong, Raymond, and Jessica Kay Flake. (2023). “Measurement Invariance Testing Using Confirmatory Factor Analysis and Alignment Optimization: A Tutorial for Transparent Analysis Planning and Reporting.” Psychological Methods 28(4):905.
Mandal, Nirmal. (2018). “Student Satisfaction–What It Means to Teaching and Learning of Undergraduate Engineering Units.” International Journal of Mechanical Engineering Education 46(3):210–26.
Manzano-León, Ana, Pablo Camacho-Lazarraga, Miguel A. Guerrero-Puerta, Laura Guerrero-Puerta, Antonio Alias, José M. Aguilar-Parra, and Rubén Trigueros. (2021). “Development and Validation of a Questionnaire on Motivation for Cooperative Playful Learning Strategies.” International Journal of Environmental Research and Public Health 18(3):960.
Marsh, Herbert W., Jiesi Guo, Theresa Dicke, Philip D. Parker, and Rhonda G. Craven. (2020). “Confirmatory Factor Analysis (CFA), Exploratory Structural Equation Modeling (ESEM), and Set-ESEM: Optimal Balance between Goodness of Fit and Parsimony.” Multivariate Behavioral Research 55(1):102–19.
Maslow, Abraham Harold. (2023). Motivation And Personality: Motivation And Personality: Unlocking Your Inner Drive and Understanding Human Behavior by AH Maslow. Prabhat Prakashan.
Maydeu-Olivares, Alberto. (2017). “Assessing the Size of Model Misfit in Structural Equation Models.” Psychometrika 82(3):533–58.
McNeish, Daniel, and Melissa G. Wolf. (2023). “Dynamic Fit Index Cutoffs for Confirmatory Factor Analysis Models.” Psychological Methods 28(1):61.
Montoya, Amanda K., and Michael C. Edwards. (2021). “The Poor Fit of Model Fit for Selecting Number of Factors in Exploratory Factor Analysis for Scale Evaluation.” Educational and Psychological Measurement 81(3):413–40.
Moreno-Medina, Irene, Manuel Peñas-Garzón, Carolina Belver, and Jorge Bedia. (2023). “Wooclap for Improving Student Achievement and Motivation in the Chemical Engineering Degree.” Education for Chemical Engineers 45:11–18.
Moshagen, Morten, and Martina Bader. (2024). “SemPower: General Power Analysis for Structural Equation Models.” Behavior Research Methods 56(4):2901–22.
Naveed, Tabassum, and Naveed Mazhar Bhatti. (2017). “Validation of Course Interest Survey Tool in MBBS Students of a Private Medical College of Pakistan.” Journal of Islamic International Medical College (JIIMC) 12(4):201–7.
Newton, Jazmin, Lauren Ochoa, Aly Reinschmidt, John Vassar, Allen Wellman, Minga Vargas, DenYelle Kenyon, and Marcus Frohm. (2024). “Is Beauty Worth the Risk? Self-Confidence Is the Key Motivating Factor Driving Tanning Bed Use among Undergraduate Students at South Dakota Universities.” International Journal of Women’s Dermatology 10(2):e128.
Padgett, R. Noah, and Grant B. Morgan. (2021). “Multilevel CFA with Ordered Categorical Data: A Simulation Study Comparing Fit Indices across Robust Estimation Methods.” Structural Equation Modeling: A Multidisciplinary Journal 28(1):51–68.
Parady, Giancarlos, David Ory, and Joan Walker. (2021). “The Overreliance on Statistical Goodness-of-Fit and under-Reliance on Model Validation in Discrete Choice Models: A Review of Validation Practices in the Transportation Academic Literature.” Journal of Choice Modelling 38:100257.
Pedler, Megan Louise, Royce Willis, and Johanna Elizabeth Nieuwoudt. (2022a). “A Sense of Belonging at University: Student Retention, Motivation and Enjoyment.” Journal of Further and Higher Education 46(3):397–408. doi: 10.1080/0309877X.2021.1955844.
Pedler, Megan Louise, Royce Willis, and Johanna Elizabeth Nieuwoudt. (2022b). “A Sense of Belonging at University: Student Retention, Motivation and Enjoyment.” Journal of Further and Higher Education 46(3):397–408.
Reeve, Johnmarshall. (2024). Understanding Motivation and Emotion. John Wiley & Sons.
Schunk, Dale H., and Maria K. DiBenedetto. (2021). “Self-Efficacy and Human Motivation.” Pp. 153–79 in Advances in motivation science. Vol. 8. Elsevier.
Seven, Mehmet Ali. (2020). “Motivation in Language Learning and Teaching.” African Educational Research Journal 8:62–71.
Shi, Dexin, Alberto Maydeu-Olivares, and Yves Rosseel. (2020). “Assessing Fit in Ordinal Factor Analysis Models: SRMR vs. RMSEA.” Structural Equation Modeling: A Multidisciplinary Journal 27(1):1–15.
Simanjuntak, Ermida. (2022). “Validation of the CIS Scale to Measure Students’ Extrinsic Learning Motivation in Indonesian Context.” in Proceedings of the 3rd International Conference of Education and Science, ICES 2021, November 17-18, 2021, Jakarta, Indonesia.
Sudibyo, Elok, Budi Jatmiko, and Wahono Widodo. (2016). “Pengembangan Instrumen Motivasi Belajar Fisika: Angket.” JPPIPA (Jurnal Penelitian Pendidikan IPA) 1(1):13–21.
Sureshchandar, G. S. (2023). “Quality 4.0–a Measurement Model Using the Confirmatory Factor Analysis (CFA) Approach.” International Journal of Quality & Reliability Management 40(1):280–303.
Tang, Tang, Valentina Vezzani, and Vikki Eriksson. (2020). “Developing Critical Thinking, Collective Creativity Skills and Problem Solving through Playful Design Jams.” Thinking Skills and Creativity 37:100696.
Toktas, Sermet, and Mustafa Bas. (2019). “Investigation of the Relationship between the Self-Confidence and Motivation of High School Students Participating School Sport Contests.” Universal Journal of Educational Research 7(2):472–79.
Torbergsen, Hanne, Britt Karin Utvær, and Gørill Haugan. (2023). “Nursing Students’ Perceived Autonomy-Support by Teachers Affects Their Intrinsic Motivation, Study Effort, and Perceived Learning Outcomes.” Learning and Motivation 81:101856.
Trisnawati, Teti. (2021). “ANALISIS CONFIRMATORY FACTOR ANALYSIS (CFA) DAN EXPLORATORY FACTOR ANALYSIS (EFA) PADA PENGEMBANGAN INSTRUMEN MOTIVASI BELAJAR SEKOLAH DASAR.” Abacus 2(2):1–8.
Vu, TuongVan, Lucía Magis-Weinberg, Brenda R. J. Jansen, Nienke van Atteveldt, Tieme W. P. Janssen, Nikki C. Lee, Han L. J. van der Maas, Maartje E. J. Raijmakers, Maien S. M. Sachisthal, and Martijn Meeter. (2022). “Motivation-Achievement Cycles in Learning: A Literature Review and Research Agenda.” Educational Psychology Review 34(1):39–71.
Watkins, Marley W. (2018). “Exploratory Factor Analysis: A Guide to Best Practice.” Journal of Black Psychology 44(3):219–46.
Wigfield, Allan, and Alison C. Koenka. (2020). “Where Do We Go from Here in Academic Motivation Theory and Research? Some Reflections and Recommendations for Future Work.” Contemporary Educational Psychology 61:101872.
Wolters, Christopher A., and Anna C. Brady. (2021). “College Students’ Time Management: A Self-Regulated Learning Perspective.” Educational Psychology Review 33(4):1319–51.
Wong, Wan Hoong, and Elaine Chapman. (2023). “Student Satisfaction and Interaction in Higher Education.” Higher Education 85(5):957–78.
Yates, Anne, Louise Starkey, Ben Egerton, and Florian Flueggen. (2021). “High School Students’ Experience of Online Learning during Covid-19: The Influence of Technology and Pedagogy.” Technology, Pedagogy and Education 30(1):59–73.
Yu, Zhonggen, Mingle Gao, and Lifei Wang. (2021). “The Effect of Educational Games on Learning Outcomes, Student Motivation, Engagement and Satisfaction.” Journal of Educational Computing Research 59(3):522–46.
Yuniarto, Eko. (2017). “Pengembangan Instrumen Penilaian Motivasi Belajar Mahasiswa Pendidikan Matematika.” Likhitaprajna 19(2):1–8.
Zheng, Fang. (2022). “Fostering Students’ Well-Being: The Mediating Role of Teacher Interpersonal Behavior and Student-Teacher Relationships.” Frontiers in Psychology 12:796728.
DOI: https://doi.org/10.33394/jk.v10i4.13420
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 The Author(s)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Jurnal Kependidikan : Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran, dan Pembelajaran
E-ISSN: 2442-7667
Published by LPPM Universitas Pendidikan Mandalika
Email: [email protected]
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.