The Certification Program Evaluation for Students in Vocational Schools using The CSE UCLA Model
Abstract
This research aims to get an overview of the evaluation results and various obstacles faced in the implementation of machining competency test certification in Vocational High Schools (VHS). The evaluation method of this program is a qualitative research approach that uses the analysis of Techniques for Sequence Preference with Ideal Solution Similarity (TOPSIS). This study uses the CSE-UCLA model in designing program evaluation, which consists of five evaluation components: system assessment, program planning, program implementation, program improvement, and certification. Data collection involved subjects who were researched by filling out questionnaires, including school principals, vice principals for curriculum, deputy principals for industrial relations, deputy principals for facilities and infrastructure, heads of machining programs, workshop heads, machining productive teachers, and competency certification institutions/professional certification institutions in schools. Participants involved in collecting information used survey forms in five Vocational High Schools (VHS) in the Province of the Special Capital Region of Jakarta. In this study, five subjects of State Vocational High Schools were selected The study resulted that the machining competency test certification program has a good level of effectiveness, with certain components assessed as sufficient. Considering the dimension of the system assessment program, the value program planning category needs to be maintained or improved. In the context of program implementation, program improvement, and program certification, efforts are needed to improve the criteria for the better. Therefore, the findings of this study can be considered for the improvement of sustainable certification programs.
Keywords
Full Text:
PDFReferences
Abdullah, M. N., Ahmad, A., & Gani, H. A. (2022). Development of Learning by doing Governance Model Industry based on Vocational Middle School in Makassar. Asian Journal of Applied Sciences, 10(1). https://doi.org/10.24203/ajas.v10i1.6850
Abdurrahman, Parmin, & Muryanto, S. (2022). Evaluation on the automotive skill competency test through ‘discontinuity’ model and the competency test management of vocational education school in Central Java, Indonesia. Heliyon, 8(2). https://doi.org/10.1016/j.heliyon.2022.e08872
Antonietti, C., Cattaneo, A., & Amenduni, F. (2022). Can teachers’ digital competence influence technology acceptance in vocational education? Computers in Human Behavior, 132. https://doi.org/10.1016/j.chb.2022.107266
Ariyani, L. F., Widjaja, S. U. M., Wahyono, H., Haryono, A., Rusdi, J. F., & Pratama, C. B. A. (2021). Vocational education phenomena research method. MethodsX, 8. https://doi.org/10.1016/j.mex.2021.101537
Arnita, V., & Chrisna, H. (2022). Accountings Students Following Test Certification Accounting Yunior Test In Indonesia. Economics, Business and Management Science Journal, 2(2). https://doi.org/10.34007/ebmsj.v2i2.289
Badan Pusat Statistik Indonesia. (2023, January 16). Proportion of Workforce in Manufacturing Sector (Percent), 2022. https://www.bps.go.id/id/statistics-table/2/MTIxNyMy/proporsi-tenaga-kerja-pada-sektor-industri-manufaktur--persen-.html
Billett, S. (2000). Defining the demand side of vocational education and training: Industry, enterprises, individuals and regions. Journal of Vocational Education and Training, 52(1), 5–31. https://doi.org/10.1080/13636820000200104
Burke, A. E., Benson, B., Englander, R., Carraccio, C., & Hicks, P. J. (2014). Domain of competence: Practice-based learning and improvement. Academic Pediatrics, 14(2 SUPPL.). https://doi.org/10.1016/j.acap.2013.11.018
CHIBA, Y., KOBAYASHI, R., OSHIDA, J., & ICHIKAWA, H. (2023). Analysis of Human Resource Development Issues in the Machining Industry. Journal of JSEE, 71(2). https://doi.org/10.4307/jsee.71.2_89
Dirim, Ş., Özener, O. Ö., & Sözer, H. (2023). Prioritization and parallel execution of test cases for certification testing of embedded systems. Software Quality Journal, 31(2). https://doi.org/10.1007/s11219-022-09594-1
Elakas, A., Tarlan, O., Safak, I., Kalkan, K., & Sozer, H. (2023). Towards Test Automation for Certification Tests in the Banking Domain. UBMK 2023 - Proceedings: 8th International Conference on Computer Science and Engineering. https://doi.org/10.1109/UBMK59864.2023.10286638
Finegold, D., & Soskice, D. (1988). The failure of training in Britain: Analysis and prescription. Oxford Review of Economic Policy, 4(3), 21–53. https://doi.org/10.1093/oxrep/4.3.21
Fullerton, A., & Leckie, G. (1999). Information literacy in science and engineering undergraduate education: faculty attitudes and pedagogical practices. College and Research Libraries, January 1999, 9–29.
Huang, F., Huang, B., Wang, Y., & Wang, Y. (2023). A Taxonomy of Software Defect Forms for Certification Tests in Aviation Industry. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14181 LNCS. https://doi.org/10.1007/978-3-031-40923-3_5
Knippa, S., Thompson-Brazill, K. A., Roller, A., & Mullen, J. (2023). Certification Test Prep: Professional Caring. In Critical Care Nurse (Vol. 43, Issue 5). https://doi.org/10.4037/ccn2023394
Kuntoro, T., Sudana, I. M., & Anis, S. (2019b). The Implementation of Competency Certification Test for Vocational Students of Light Vehicle Engineering Program by LSP-P3 in Banyumas. Journal of Vocational Career Education, 4(1), 74–82. https://doi.org/https://doi.org/10.15294/jvce.v4i2.23053
Li, J., & Pilz, M. (2023). International transfer of vocational education and training: a literature review. Journal of Vocational Education and Training, 75(2). https://doi.org/10.1080/13636820.2020.1847566
Ling, Y., Chung, S. J., & Wang, L. (2023). Research on the reform of management system of higher vocational education in China based on personality standard. Current Psychology, 42(2). https://doi.org/10.1007/s12144-021-01480-6
Mahmudah, F. N., & Santosa, B. (2021). Vocational School Alignment Based-on Industry Needs. 4(1), 36–45.
Majetic, C., & Pellegrino, C. (2018). Building Information Literacy Skills Using Science News Media. Journal of College Science Teaching, 48(1).
Makinde, W. A., & Bamiro, T. O. (2023). Service Quality of Teaching Vocational Education and Training (TVET) and Student’s Satisfaction in Nigeria. Journal of Pedagogy and Education Science, 2(01), 10–25. https://doi.org/10.56741/jpes.v2i01.157
Mason, R. B., Mbambo, S. N., & Pillay, M. A. (2018). Service quality at technical and vocational education and training colleges: Perception according to demographic factors. Journal of Technical Education and Training, 10(1), 15–29. https://doi.org/10.30880/jtet.2018.10.01.002
Muja, A., Blommaert, L., Gesthuizen, M., & Wolbers, M. H. J. (2019). The vocational impact of educational programs on youth labor market integration. Research in Social Stratification and Mobility, 64. https://doi.org/10.1016/j.rssm.2019.100437
Nurtanto, M., Sofyan, H., Pardjono, P., & Suyitno, S. (2020). Development model for competency improvement and national vocational qualification support frames in automotive technology. International Journal of Evaluation and Research in Education, 9(1). https://doi.org/10.11591/ijere.v9i1.20447
Pardjono, P., Sugiyono, S., & Budiyono, A. (2015). Developing A Model Of Competency And Expertise Certification Tests For Vocational High School Students. REID (Research and Evaluation in Education), 1(2). https://doi.org/10.21831/reid.v1i2.6517
Parkinson, J., & Mackay, J. (2016a). The literacy practices of vocational training in Carpentry and Automotive Technology. Journal of Vocational Education and Training, 68(1). https://doi.org/10.1080/13636820.2015.1104714
Parkinson, J., & Mackay, J. (2016b). The literacy practices of vocational training in Carpentry and Automotive Technology. Journal of Vocational Education and Training, 68(1), 33–50. https://doi.org/10.1080/13636820.2015.1104714
Priyanto, S., Soeprijanto, Badrujaman, A., & Sahara, S. (2024). Evaluation Approach Of The Mechanical Engineering Competency Test Certification Using The Assessment Evaluability And Performance Monitoring Model. Decision Science Letters, 13(1). https://doi.org/10.5267/j.dsl.2023.9.002
Republic of Indonesia Employment Law Number 13 of 2003. (n.d.).
Rodriguez, R., Svensson, G., & Wood, G. (2020a). Assessing corporate planning of future sustainability initiatives in private healthcare organizations. Evaluation and Program Planning, 83(August). https://doi.org/10.1016/j.evalprogplan.2020.101869
Rodriguez, R., Svensson, G., & Wood, G. (2020b). Assessing corporate planning of future sustainability initiatives in private healthcare organizations. Evaluation and Program Planning, 83. https://doi.org/10.1016/j.evalprogplan.2020.101869
Rofiq, Z., Surono, S., Bruri Triyono, M., & Setiyo Hari Purwoko, B. (2019a). Developing the Standard Competencies for Vocational Teacher Candidates of Mechanical Engineering. Journal of Physics: Conference Series, 1273(1). https://doi.org/10.1088/1742-6596/1273/1/012032
Stofkova, Z., & Sukalova, V. (2020). Sustainable Development of Human Resources in Globalization Period. Sustainabiliity Journal, 7681(12), 1–14. https://doi.org/https://doi.org/10.3390/su12187681
Suharno, Pambudi, N. A., & Harjanto, B. (2020). Vocational education in Indonesia: History, development, opportunities, and challenges. In Children and Youth Services Review (Vol. 115). https://doi.org/10.1016/j.childyouth.2020.105092
Vaganova, O. I., Bakharev, N. P., Kulagina, J. A., Lapshova, A. V., & Kirillova, I. K. (2020). Multimedia technologies in vocational education. Revista Amazonia Investiga, 9(26), 391–398. https://doi.org/10.34069/ai/2020.26.02.45
Wang, H., & Chen, S. (2023). Insights into the Application of Machine Learning in Reservoir Engineering: Current Developments and Future Trends. Energies, 16(3). https://doi.org/10.3390/en16031392
XU, Z., & WANG, Y. (2021). Electrochemical machining of complex components of aero-engines: Developments, trends, and technological advances. In Chinese Journal of Aeronautics (Vol. 34, Issue 2, pp. 28–53). https://doi.org/10.1016/j.cja.2019.09.016
Yildiz, F., & Yildirim, E. (2023). Important insect pests in winter vegetables grown in Beydere Seed Certification Test Directorate. Plant Protection Bulletin (Turkey), 63(3). https://doi.org/10.16955/bitkorb.1274312
Zhu, D., Feng, X., Xu, X., Yang, Z., Li, W., Yan, S., & Ding, H. (2020). Robotic grinding of complex components: A step towards efficient and intelligent machining – challenges, solutions, and applications. Robotics and Computer-Integrated Manufacturing, 65. https://doi.org/10.1016/j.rcim.2019.101908
DOI: https://doi.org/10.33394/jk.v10i4.12693
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 The Author(s)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Jurnal Kependidikan : Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran, dan Pembelajaran
E-ISSN: 2442-7667
Published by LPPM Universitas Pendidikan Mandalika
Email: [email protected]
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.