Towards the Establishment of Program Evaluation System in Japanese Higher Education: Learning from the Quality Code Adopted in the United Kingdom
Abstract
Despite global trends in quality assurance emphasizing degree-specific learning outcomes, Japanese higher education has yet to develop an effective evaluation system at the degree-program level. Recent Japanese educational policies strongly suggest the need for ensuring program-level learning outcomes and corresponding evaluation systems. As such, this paper explores how to establish sound program evaluation processes in Japanese higher education by identifying an international example and examining its essential components. Firstly, this paper analyzes recent policy trends with survey results related to quality assurance systems in Japanese higher education. It explores the development and implementation of program-level evaluation practices, internal quality enhancement processes and external quality assurance mechanisms. Secondly, it will refer to the quality assurance systems adopted by higher education in the United Kingdom and discuss its key elements. The parallels between the recent reforms and the policies implemented by the United Kingdom suggest potential comparative value that could be a useful reference for the enhancement of the Japanese system. This transnational analysis will also elucidate the benefits and challenges of articulating program-level internal and external quality assurance frameworks. Lastly, this paper draws on the specific case of England to illustrate how a program evaluation framework could further the enhancement efforts of the Japanese system.
References
D. D. Dill, “Quality Assurance in Higher Education: Practices and Issues,” Interna-tional Encyclopedia of Education, Third Edition, P. P. Peterson, E. Baker, and B. McGaw eds., Oxford: Elsevier, 2010, pp.377-383.
UNESCO-IIEP, “Linking External and Internal Quality Assurance,” 2018; https://unesdoc.unesco.org/ark:/48223/pf0000263247/PDF/263247eng.pdf.multi.
S. Ozeki, T. Hayashi, P. Shorb, M. McLaughlin, and C. Hughes, “Implementing Program-Level Learning Outcomes in Japanese Higher Education: Insights from Quality Assurance Approaches Adopted by the United Kingdom,” in Proceedings of 11th International Congress, 2022, vol. 81, pp. 221–229.
The University Education Group in the Central Council for Education's Subdivi-sion on Universities, “Guidelines of Formulation and Operation of Diploma Policy, Curriculum Policy and Admission Policy”, 2016; https://www.mext.go.jp/b_menu/shingi/chukyo/chukyo4/houkoku/__icsFiles/afieldfile/2016/04/01/1369248_01_1.pdf.
The Central Council for Education, “Grand Design for Higher Education toward 2040”, 2020; https://www.mext.go.jp/content/20200312-mxt_koutou01-100006282_1.pdf.
The Central Council for Education's Subdivision on Universities, “Guidelines for the Management of Teaching and Learning,” 2020; https://www.mext.go.jp/content/20200206-mxt_daigakuc03-000004749_002.pdf.
T. Hayashi, “Twenty Years of University Evaluation in Japan,” The Japanese Jour-nal of Higher Education Research, vol. 23, 2020, pp.9-31.
The Central Council for Education's Subdivision on Universities, “Summary of Deliberations: Towards the Improvement of Evaluation and Accreditation Systems,” 2016; https://www.mext.go.jp/b_menu/shingi/chukyo/chukyo4/houkoku/__icsFiles/afieldfile/2016/03/25/1368868_01.pdf.
National Institution for Academic Degrees and Quality Enhancement of Higher Education, “Institutional Certified Evaluation and Accreditation of Universities Standards for Evaluation and Accreditation of Universities: 2019-2026,” 2018; http://www.niad.ac.jp/media/008/201901/NIAD-Standards%20for%20Evaluation.pdf.
The Quality Assurance System Group in the Central Council for Education's Sub-division on Universities, “Summary of Deliberations: On the Improvement and Systemization of a Quality Assurance System for a New Era,” 2022; https://www.mext.go.jp/kaigisiryo/content/20220325-mxt_koutou01-000021453_1-2.pdf.
The Japan Accreditation Council for Medical Education, “Basic Medical Educa-tion: Japanese Specifications WFME Global Standards for Quality Improvement (in Japanese),” 2020; https://www.jacme.or.jp/pdf/wfme-jp_ver2.35.pdf.
The Science Council of Japan, “(Investigative Committee) Responses Regarding the Current State of Discipline-Specific Quality Assurance,” 2021; https://www.scj.go.jp/ja/info/kohyo/pdf/kohyo-21-k100-1.pdf.
The Ministry of Education, Culture, Sports, Science and Technology, Education Division, “General Outline Regarding the State of Reforms in Educational Contents at Universities in 2019,” 2021; https://www.mext.go.jp/content/20211104-mxt_daigakuc03-000018152_1.pdf.
Standards and Guidelines for Quality Assurance in the European Higher Educa-tion Area (ESG). 2015. Brussels, Belgium.
The Quality Assurance Agency for Higher Education, “The revised UK Quality Code for Higher Education,” 2018; https://www.qaa.ac.uk/docs/qaa/quality-code/revised-uk-quality-code-for-higher-education.pdf?sfvrsn=4c19f781_8.
The Quality Assurance Agency for Higher Education, “Advice and Guidance,” https://www. qaa.ac.uk//en/quality-code/advice-and-guidance.
The Quality Assurance Agency for Higher Education, “UK Quality Code for Higher Education - Advice And Guidance: Monitoring And Evaluation”, 2018; https://www.qaa.ac.uk/docs/qaa/quality-code/advice-and-guidance-monitoring-and-evaluation.pdf?sfvrsn=702bc181_7.
The Quality Assurance Agency for Higher Education, “UK Quality Code for Higher Education - Advice And Guidance: Assessment”, 2018; https://www.qaa.ac.uk/docs/qaa/quality-code/advice-and-guidance-assessment.pdf?sfvrsn=ca29c181_7.
The Quality Assurance Agency for Higher Education, “UK Quality Code for Higher Education - Advice And Guidance: External Expertise”, 2018; https://www.qaa.ac.uk/docs/qaa/quality-code/advice-and-guidance-external-expertise.pdf?sfvrsn=6f2ac181_6 .
The Quality Assurance Agency for Higher Education, “UK Quality Code for Higher Education - Advice And Guidance: Student Engagement”, 2018; https://www.qaa.ac.uk/docs/qaa/quality-code/advice-and-guidance-student-engagement.pdf?sfvrsn=6224c181_3.
The Quality Assurance Agency for Higher Education, “Subject Benchmark Statements,” https://www.qaa.ac.uk/quality-code/subject-benchmark-statements.
The Office for Students, “Regulatory advice 1: The OfS approach to regulation,” 2018; https://www.officeforstudents.org.uk/media/1092/ofs2018_02.pdf.
The Office for Students, “Securing student success: Regulatory framework for higher education in England,” 2018; https://www.officeforstudents.org.uk/media/a32be394-72ba-4975-bd7e-5a9b5d8c0ece/regulatoryframework.pdf.
The Quality Assurance Agency for Higher Education, “UK Quality Code for Higher Education, Part A: Setting and maintaining threshold Academic Standards, The Frameworks for Higher Education Qualifications of UK Degree-Awarding Bodies,” 2014; https://www.qaa.ac.uk/docs/qaa/quality-code/qualifications-frameworks.pdf?sfvrsn=170af7 81_18.
D. Phoenix. “Higher Education co-regulation: Where do we go from here?” Higher Education Policy Institute, 28 August 2018. https://www.hepi.ac.uk/2018/08/28/6330/
S. Ozeki, T. Hayashi, Y. Saito, M. Fukano, and S. Yamazaki, “An Investigation into Curriculum Management to Accomplish Learning Outcomes in Diploma Poli-cy”, Journal of Japan Association for College and University Education, vol. 43, no. 1, 2021, pp. 140-148.
K. Matsushita, K. Ono, and Y. Saito, “Combining course-and program-level out-comes assessments through embedded performance assessments at key courses: A proposal based on the experience from a Japanese dental education program,” Tuning Journal for Higher Education, vol. 6 no.1, 2018, pp.111-142.
