A Trial to Convert Graduation Competency Question-naire Data into Key Performance Indicators in Japanese Medical Schools
DOI:
https://doi.org/10.52731/lir.v004.264Keywords:
Institutional Research for Education, Key Performance Indicators (KPI), Graduation CompetenciesAbstract
Introduction: The monitoring of graduation competencies is a crucial issue for institutional research (IR) for medical schools in terms of accreditation. To enable the comparison of the acquisition of competencies across universities, the current study aimed to achieve better quality assurance by converting data disclosed in graduation competency questionnaires into key performance indicators (KPIs). Methods: First, we conducted a Google search of 82 Japanese universities regarding the disclosure of information on graduation competencies and examined the characteristics of universities that fit the criteria. The graduation competencies of the targeted universities were then examined and categorized into newly revised common national competencies followed by the ranking of data and the calculation of averages. Finally, comparisons of the competency data of the universities were conducted. Results: Twelve universities met the criteria and exhibited significant differences in characteristics such as foundation and name. One of the newly revised common national competencies was missing from the existing graduation competencies at most universities. The study observed significant differences in the level of mastery among the competencies, and variations in ranking between the university of the authors and the national average. Discussion and Conclusion: By examining data disclosed in graduation competency questionnaires for universities, converting them into KPIs became possible. This method may also be used to convert other monitoring data into KPIs.
References
Asada, Y., 2019, July. Investigation of the current situation of medical education in Japan based on the results of accreditation based on global standards. In 2019 8th International Congress on Advanced Applied Informatics, IIAI-AAI 2019: pp.342-346.
World Federation for Medical Education., 2015. "WFME global standards for quality im-provement basic medical education Copenhagen."; http://wfme.org/standards/bme/.
Tsunekawa, K., Suzuki, Y. and Shioiri, T., 2020. Identifying and supporting students at risk of failing the national medical licensure examination in Japan using a predictive pass rate. BMC medical education, 20, pp.1-9.
Ozeki, S., Kasamo, S., Inoue, H. and Matsumoto, S., 2022. Essential milestones in Japanese medical education and data utilization with practical cases from a regional medical university. International journal of institutional research and management, 6(1), 1-14.
Frank, J.R., Snell, L.S., Cate, O.T., Holmboe, E.S., Carraccio, C., Swing, S.R., Harris, P., Glas-gow, N.J., Campbell, C., Dath, D. and Harden, R.M., 2010. Competency-based medical educa-tion: theory to practice. Medical teacher, 32(8), pp.638-645.
Batalden, P., Leach, D., Swing, S., Dreyfus, H. and Dreyfus, S., 2002. General competencies and accreditation in graduate medical education. Health affairs, 21(5), pp.103-111.
Royal College of Physicans and Surgeons of Canada. CanMEDS 2000 project. Ottawa: RCPSC; 1996. http://rcpsc.medical.org/canmeds/index.php.
Accreditation Council for Graduate Medical Education. https://www.acgme.org/globalas-sets/pdfs/milestones/milestonesguidebookforresidentsfellows.pdf.
General Medical Council. Tomorrowʼs Doctors https://www.educacionmedica.net/pdf/doc-umentos/modelos/tomorrowdoc.pdf.
Kozu, T. 2006. Medical education in Japan. Academic medicine, 81(12), pp.1069-1075.
https://www.mext.go.jp/content/20230323-mxt_igaku-000028108_00003.pdf.
Tsunekawa, K., Suzuki, Y. and Shioiri, T., 2019. Current status and perspectives of institu-tional research in Japanese health professions: experience from workshops. 8th International Congress on Advanced Applied Informatics, IIAI-AAI 2019: pp.351-354.
Miyazaki, K., Takahashi, N. and Mori, R., 2019. Research on consistency between diploma policies and nomenclature of major disciplines: deep learning approach. 7th IEEE-ICIET, IIAI-AAI 2019: pp. 252-258.
Anegawa, K., 2015. Government subsidy impact on private university management in Japan. pp.1-15.
Kuroda, T., 2022. Extraction and recognition of competency components of the STEM Hu-man resources community: focusing on the cultural impacts of Japanese university students. Journal of pedagogical research, 6(2), pp.186-206.
Arnold, L. and Stern, D.T., 2006. What is medical professionalism. Measuring medical pro-fessionalism, Oxford university press, London, pp.15-37.
