Visualizing University Departments’ Research Achievements, Including in the Humanities and Social Sciences: A Non-Bibliometric Index Approach
DOI:
https://doi.org/10.52731/lir.v003.85Keywords:
humanities and social sciences, institutional data, research assessment, visualizationAbstract
In recent years, bibliometric indices have been used in various situations to conduct research evaluations, but the difficulties of using such methods for evaluation in the humanities and social sciences are evident. Here, we present a case study of a method for evaluating the research performance of departments in the humanities and social sciences without relying solely on bibliometric indices based on articles written in English. We introduce the process whereby we built our evaluation indices, as well as radar charts for each department, using the multiple indices we created.
References
M. Goto, “[Is quantitative evaluation of research possible for the humanities? -an attempt by the national institutes for the humanities] Kenkyu no ryotekihyoka wa jimbungaku ni taishite kano nanoka -Ningen bunka kenkyu kiko no kokoromi,” Gakujutsu no doko [Trends in the sciences], vol. 23, no.10, pp. 42-49, 2018(in Japa-nese).
T. Hayashi, “[Research evaluation of humanities and social sciences in the field of university evaluation] Daigakuhyoka no gemba ni okeru jimbun shakai kagaku no kenkyu hyoka no genjo,” Gakujutsu no doko [Trends in the sciences], vol. 23, no.10, pp. 16-23, 2018(in Japanese).
A. Bonaccorsi (ed.), “The evaluation of research in social sciences and humanities: Lessons from the italian experience,” Springer International Publishing, 2018.
J. Matsuura, “[Humanities and Research Evaluation] Jimbungaku to kenkyu hy-oka,” Newsletter -Science concil of Japan section I, vol. 24, no.5, pp. 10-16, 2019(in Japanese).
K. Yamamoto, M. Ishikawa, “A normalized index to quantify publication produc-tivity across disciplinary boundaries,” International Journal of Institutional Research and Management, pp.67-81, 2017.
T. Kubo, “[The holding status of specialized books in the humanities and social sciences in university libraries: a preliminary survey using CiNii Books and openBD] Daigaku tosyokan ni okeru zinbunsyakaike no senmonsyo no syozo jokyo - CiNii Books to openBD wo mochita yobiteki chosa,” 9th Meeting on Japanese Institutional Research, 2020(in Japanese).
Y. Sato (ed.), “[Research evaluation in the humanities and social sciences in east asia: institutions and changes] Higashiajia no jimbunshakaikagaku ni okeru kenkyu hyoka -Seido to sono henka-,” Institute of Developing Economies, Japan External Trade Organization, 2020(in Japanese).
N. Hamaguchi, “[Evaluation of research in the humanities and sociology] Jimbun shakaigaku no kenkyu hyoka ni tsuite,” [Economic and Management Research (Annual Report)] Keizai keiei kenkyu (nempo), no.69, pp.1-16, 2020 (in Japanese).
E. Garfield, “The agony and the ecstasy—the history and meaning of the journal Impact Factor”, International Congress on Peer Review and Biomedical Publication, 2005.
M. Goto, “[Quantitative evaluation of humanities and social sciences research] Jimbun shakai kekenkyu no keiryo hyoka ni tsuite,” [Report on the Research Analysis Indicators Project (2016-2017)] Kenkyuryoku bunseki shihyo purojekuto, 2017 (in Japanese).
The Institute of Statistical Mathematics, “[Enhancement of R function and devel-opment of cross-disciplinary indicators] IR kino no kyoka to ibunyayugo shihyo no kaihatsu”, https://www.ism.ac.jp/ism_info_j/labo/project/139.html, Retrived 28th April 2023 (in Japanese).
Y. Inoue, “[Attempts to properly evaluate the provision of research resources] Kenkyu shigen no teikyo wo tekisetsu ni hyoka suru kokoromi,” IR/IE seminer, Jap-anese Consortium of Accreditation Coordinators for Higher Education, 2023 (in Jap-anese).
REF2021, https://www.ref.ac.uk, Retrived 28th April 2023.
T. Hayashi, “[Expansion of research evaluation and diversification of evaluation indicators] Kenkyu hyoka no kakudai to hyoka shihyo no tayoka, The journal of In-formation Science and Technology, vol. 67, no. 4, 2017 (in Japanese).
Strategy Evaluation Protocol 2021-2027, https://www.universiteitenvannederland.nl/files/documenten/Domeinen/Onderzoek/SEP_2021-2027.pdf, Retrived 28th April 2023.
Y. Fujigaki, et al., “[Introduction to Scientific Metrology for Research Evaluation and Scientific Theory] Kenkyu hyoka kagakuron no tameno kagakukeiryogaku nyumon,” Maruzen Publishing, 2004 (in Japanese).
