Comparison of Research Performance by Institute based on Research Keywords
Abstract
To propose a new method of comparing performance between studies on the same subject at different institutions, this study obtained information on grant amounts, keywords related to the research, and the number of achievements for all projects from the Grants-in-Aid for Scientific Research (KAKENHI) Database. From this database, the information on research projects between FY 2012 and 2021 was obtained and classified into ten groups according to their budget amounts. Thereafter, 12 research institutes were focused and compared the number of research achievements in each group. Throughout all groups, the institute’s performance differences were not apparent based on the comparison of research projects. However, the results revealed that the method of comparing by keywords better indicates the differences in the performance of each institute. To clarify the causes of the differences, the authors compared achievements in common and unique words separately. Consequently, there tended to be significant differences in performance for unique words than common words. More reliable results are expected to be obtained by improving the determination accuracy of the same keywords.
References
H. Nomura, Y. Mitsuda, and M. Maeda, “An Attempt to Classify the Japanese Universities by Means of the Number of Adoption Subjects of Grants-in-Aid for Scientific Research,” The Journal of Finance and Management in Colleges and Universities, vol. 2, 2005, pp.55-76.
H. Nomura, M. Maeda, Y. Mitsuda, M. Negishi, M. Shibayama, M. Nishizawa, Y. Sun, and K. SHIGI, “Evaluation of Japanese Universities’ Research Activity based on the Number of Awards of Grants-in-Aid for Scientific Research from 1998 to 2002: I. Law, Economics and Literature,” NII Technical Reports, 2003, NII-2003-007J.
M. Nishizawa, M. Negishi, M. Shibayama, Y. Sun, H. Nomura, M. Maeda, and Y. Mitsuda, “Evaluation of Japanese Universities' Research Activity based on the Number of Awards of Grants-in-Aid for Scientific Research from 1998 to 2002 and in 2003,” Progress in Informatics, vol. 4, 2007, pp.79-101.
M. Nishizawa, Y. Sun, M. Shibayama, M. Negishi, and K. Watanabe, Analysis of Effect of Research Promotion by Grant-in-Aid for Scientific Research; https://www.nii.ac.jp/userdata/openhouse/h18/archive/pdf/414.pdf.
N. Yabuki, “Analysis of Research Activities at Yokohama National University: Fo-cusing on Research Projects adopted by KAKENHI,” The Journal of Information Science and Technology Association, vol. 67, 2017, pp.185-189.
K. Hirai, M. Okazaki, S. Okutsu, T. Kubo, N. Yabuki, and Y. Watanabe, “URA Community ‘Code for Research Administration’ to Streamline and Sophisticate Research Capability Analysis: Inter-institutional Collaboration,” The Journal of In-formation Science and Technology Association, vol. 71, no. 2, 2021, pp.80-86.
T. Kubo and K. Hirai, “Development of a Web Application to Improve the Effi-ciency of Grant-in-Aid Analysis in Research IR,” Journal of Institutional Research and University Evaluation, vol. 13, 2021, pp.3-12.
SciREX Center, SPIAS: SciREX Policymaking Intelligent Assistance System; https://scirex.grips.ac.jp/data/spiasscirex-scirex-policymaking-intelligent-assistance-system.html.
Cabinet Office, Analysis of Relation between Research Output and Researcher At-tribution; https://e-csti.go.jp/en/analysis/db7be729-faf3-4987-8b63-c56774325110.
Cabinet Office, Analysis of Relations between Research Funding Allocation and Research Output; https://e-csti.go.jp/en/analysis/1910a3a8-76ab-4895-b437-f40ba204979e.
Cabinet Office, Analysis of External Fundraising Productivity; https://e-csti.go.jp/en/analysis/6ed2899e-467e-429d-8310-3e857baa1700.
T. Shimbaru and N. Kai, 2022, A study of research performance against KAKEN, using Osaka University as a case study, IIAI Letters on Institutional Research, 1(LIR006), 1-10.
T. Shimbaru, “Proposal of support function related to organization of official documents,” Journal of the Records Management Society of Japan, 75, 2018, pp.48-59.
T. Shimbaru, “Identification of Administrative Document Titles Using Cosine Similarity,” Journal of the Records Management Society of Japan, 82, 2022, pp.61-63.
