Combining Key Performance Indicators and Signs of Changes in Students to improve the quality of education in Institutional Research based on Eduinformatics
DOI:
https://doi.org/10.52731/lir.v002.052Keywords:
Institutional Research (IR), higher education, Eduinformatics, Key Performance Indicators (KPI)Abstract
In recent years, most Japanese universities have started to operate departments of institutional research (IR). In IR fields, Key Performance Indicator (KPI) is important to evaluate the quality of education. Eduinformatics, a novel interdisciplinary field proposed by us, provides good analyses that will help us to solve educational problems. This paper emphasizes that we have to consider whether the evaluation of KPIs is the best method to check the quality of education in universities. We discuss the problem of evaluating KPIs to check the quality of higher education and suggest that we have to recognize and understand the limitations of evaluating KPIs. We propose that it is better to evaluate the combination of both KPIs and signs of changes in students to improve the quality of education.
References
Y. Aioi, S. Iseri, S. Imai, T. Oishi, S. Okada, N. Kondo, R. Sugihara, S. Tajiri, M. Tsu-bakimoto, K. Nishiyama, T. Matsuda, and M. Mori, Standard Guide book of Institu-tional Research in Universities. impress R&D, 2022.
J. L. Saupe, “The functions of institutional research. 2nd Edition.,” 1990, [Online]. Available: https://eric.ed.gov/?id=ED319327
I. Noda, K. Takamatsu, K. Nishiyama, K. Bannaka, Y. Saruwatari, T. Kirimura, Y. Na-kata, and M. Omori, “New visualization of competency-based education (CBE) in higher education institutional research (IR),” in Advanced Applied Informatics (IIAI-AAI), 2020 9th International Institute of Applied Informatics (IIAI) International Congress on. Institute of Electrical and Electronics Engineers (IEEE), 2020, pp. 391–396. doi: 10.1109/IIAI-AAI50415.2020.00085.
K. Takamatsu, K. Murakami, I. Noda, K. Bannaka, Y. Nakata, Y. Kozaki, A. Kishida, H. Kabutoya, K. Mitsunari, and M. Omori, “New Proposal of University Reform by Sig-nificant Other Groups in Eduinformatics,” Int. J. Institutional Res. Manag., vol. 5, no. 1, pp. 96–105, 2021, doi: 10.52731/ijirm.v5.i1.681.
K. Takamatsu, K. Murakami, T. Kirimura, K. Bannaka, I. Noda, L. R.-J. Wei, K. Mitsunari, M. Seki, E. Matsumoto, M. Bohgaki, A. Imanishi, M. Omori, R. Adachi, M. Yamasaki, H. Sakamoto, K. Takao, J. Asahi, T. Nakamura, et al., “‘Eduinformatics’: A new education field promotion,” Bull. kobe Tokiwa Univ., vol. 11, pp. 27–44, 2018, doi: 10.20608/00000958.
K. Takamatsu, Y. Kozaki, K. Murakami, A. Sugiura, K. Bannaka, K. Mitsunari, M. Omori, and Y. Nakata, “Review of Recent Eduinformatics Research,” in IEEE/IIAI In-ternational Congress on Applied Information Technology 2019, 2019, pp. 27–32. doi: 10.1109/AIT49014.2019.9144820.
K. Takamatsu, I. Noda, B. Kenya, T. Nakagawa, Y. Kozaki, K. Mitsunari, M. Omori, R. Adachi, and Y. Nakata, “A New Concept of ICT on Eduinformatics in Higher Educa-tion,” in Proceedings of Sixth International Congress on Information and Communi-cation Technology: ICICT 2021, London, Volume 1 (Lecture Notes in Networks and Systems Book 235), Springer Nature, 2022, pp. 693–700. doi: 10.1007/978-981-16-2377-6_64.
K. Takamatsu, M. Katsuhiko, Y. Kozaki, K. Bannaka, I. Noda, K. Mitsunari, M. Omori, and Y. Nakata, “Eduinformatics: A New Academic Field Needed in the Age of Infor-mation and Communication Technology,” in Intelligent Sustainable Systems: Selected Papers of WorldS4 2021, Volume 1 (Lecture Notes in Networks and Systems Book 333), 2022, pp. 139–147. doi: 10.1007/978-981-16-6309-3_15.
K. Takamatsu, I. Noda, K. Bannaka, K. Murakami, Y. Kozaki, K. Mitsunari, M. Omori, and Y. Nakata, “A new Concept of Digital transformation,Institutional Research,and Information and Communication Technology in Higher Education based on Eduinfor-matics,” in Proceedings of Seventh International Congress on Information and Com-munication Technology, Springer Nature, 2023, pp. 233–24. doi: 10.1007/978-981-19-2397-5_23.
K. Takamatsu, I. Noda, K. Bannaka, K. Murakami, Y. Kozaki, A. Kishida, H. Kabutoya, K. Mitsunari, R. Adachi, M. Omori, and Y. Nakata, “Sustainability of Digital transfor-mation (DX), Institutional Research (IR), and Information and Communication Tech-nology (ICT) in Higher Education based on Eduinformatics,” in Intelligent Sustainable Systems: Selected Papers of WorldS4 2022, 2022, p. in press.
K. Takamatsu, T. Oishi, S. Matsumoto, K. Nishiyama, I. Noda, S. Imai, K. Bannaka, K. Murakami, A. Kishida, Y. Nakata, and M. Mori, “Practice report of Feasibil-ity-Sustainability Analytics (FS Analytics) in Institutional Research (IR) based on Eduinformatics and new proposal to improve Sustainability in IR,” in Proceeding of the eleventh meeting on Japanese Institutional Research, 2022, pp. 12–17. doi: 10.50956/mjir.10.0_12_1.
T. Matsuda, M. Mori, Y. Aioi, and Anegawa, Collection of Standard Index of Institu-tional Research in Universities. Tamagawa University Press, 2017.
K. Takamatsu, K. Murakami, R.-J. W. Lim, and Y. Nakata, “Novel visualization for curriculum in silico using syllabus by a combination of cosine similarity, multidimen-sional scaling methods, and scatter plot: Dynamic curriculum mapping (DCM) for syl-labus,” Bull. Kobe Tokiwa Univ., vol. 10, pp. 99–106, 2017, doi: 10.20608/00000396.
K. Takamatsu, K. Murakami, T. Kirimura, K. Bannaka, I. Noda, M. Yamasaki, L. Rahpael-Joe, l Wei, K. Mitsunari, T. Nakamura, and Y. Nakata, “A new way of visual-izing curricula using competencies: Cosine similarity, multidimensional scaling meth-ods, and scatter plotting,” in Advanced Applied Informatics (IIAI-AAI), 2017 6th In-ternational Institute of Applied Informatics (IIAI) International Congress on. Institute of Electrical and Electronics Engineers (IEEE), 2017, pp. 192–197. doi: 10.1109/IIAI-AAI.2017.29.
K. Takamatsu, Y. Kozaki, K. Murakami, K. Bannaka, I. Noda, W. Lim, Raphael-Joel, K. Mitsunari, T. Nakamura, and Y. Nakata, “A New Way of Visualizing Curricula Using Competencies : Cosine Similarity and t-SNE,” in Advanced Applied Informatics (IIAI-AAI), 2018 7th International Institute of Applied Informatics (IIAI) International Congress on. Institute of Electrical and Electronics Engineers (IEEE), 2018, pp. 390–395. doi: 10.1109/IIAI-AAI.2018.00084.
N. Ichikawa, K. Takamatsu, K. Murakami, Y. Kozaki, I. Noda, K. Bannaka, A. Kishida, H. Kabutoya, K. Mitsunari, M. Omori, and Y. Nakata, “University Reform for Compe-tency-Based Education using Eduinformatics by Significant Other Groups,” in Ad-vanced Applied Informatics (IIAI-AAI), 2021 10th International Institute of Applied Informatics (IIAI) International Congress on. Institute of Electrical and Electronics Engineers (IEEE), 2021, pp. 225–230. doi: 10.1109/IIAI-AAI53430.2021.00040 225.
T. Kirimura, K. Takamatsu, K. Bannaka, I. Noda, K. Mitsunari, and Y. Nakata, “Inno-vate the management of teaching and learning at our own university through collabora-tion between academic faculty and administrative staff T,” Bull. Kobe Tokiwa Univ., vol. 10, pp. 23–32, 2017.
T. Kirimura, K. Mitsunari, T. Kunisaki, T. Gozu, K. Takamatsu, K. Bannaka, and Y. Nakata, “Effectiveness of first year experience’s course ‘Manaburu’ at Kobe Tokiwa University for university students by using textual analysis,” Bull. Kobe Tokiwa Univ., vol. 11, pp. 193–208, 2018, doi: 10.20608/00000972.
S. Kyogoku, T. Kirimura, K. Takamatsu, Y. Saruwatari, T. Kudo, T. Nakamura, and Y. Nakata, “The significance and possibility of course ‘Culture and Art’ in liberal arts based on the view of lifelog education,” Bull. kobe Tokiwa Univ., vol. 13, pp. 149–160, 2020, doi: 10.20608/00001104.
K. Takamatsu, M. Mori, S. Matsumoto, and S. Imai, “Keyword analysis in IR - new evaluation methods except KPI in Eduinformatics- (Japanese),” in 38th meeting of Ja-pan society of Educational Information, 2022, pp. 78–79.
UNESCO, “Learning Analytics,” 2012. [Online]. Available: https://iite.unesco.org/pics/publications/en/files/3214711.pdf
K. Narita, Y. Shimonaka, K. Nakazato, C. Kawaai, S. Sato, and Y. Osada, “A Japanese version of the generalized self-efficacy scale -scale utility from the life span perspec-tive- (Japanese),” Japanese J. Educ. Psychol., vol. 43, no. 3, pp. 306–314, 1995, doi: 10.5926/jjep1953.43.3_306.
A. Bandura, “Self-efficacy: toward a unifying theory of behavioral change.,” Psychol. Rev., vol. 84, no. 2, p. 191, 1977, doi: 10.1037/0033-295X.84.2.191.
M. Sherer, J. E. Maddux, B. Mercandante, S. Prentice-Dunn, B. Jacobs, and R. W. Rog-ers, “The self-efficacy scale: Construction and validation,” Psychol. Rep., vol. 51, no. 2, pp. 663–671, 1982, doi: 10.2466/pr0.1982.51.2.663.
M. Takafuji, N. Nakata, M. Fukuda, T. Shirokane, C. Hatakeyama, M. Sawada, M. Miyode, Y. Izumino, H. Uehaa, and J. Mizobe, “Educational Program Using Disasters as Teaching Materials -Crisis Response Practical Ability Training Program- Second Report (Japanese),” J. Japan Soc. Dent. Hyg. Educ., vol. 2, no. 1, p. 42, 2011.
H. Yanagihara, Creative O.D. Vol.1. Press time, 1976. [Online]. Available: http://creativeod.jp/abouts/
J. Kruger and D. Dunning, “Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments.,” J. Pers. Soc. Psychol., vol. 77, no. 6, p. 1121, 1999, doi: 10.1037/0022-3514.77.6.1121.
P. R. Clance and S. A. Imes, “The imposter phenomenon in high achieving women: Dynamics and therapeutic intervention.,” Psychother. Theory, Res. Pract., vol. 15, no. 3, p. 241, 1978, doi: 10.1037/h0086006.
H. Hattori and K. Kitamura, “Qualitative analysis of the proficiency process for univer-sity ski learners ― Practical research focusing on the sensory deviation ―,” J. Ski Sci., vol. 18, no. 1, pp. 37–46, 2022.
N. Fumoto, A new introduction to sports psychology (Japanese). syunjyunsya, 2000.
