CLE-UMA – A Creative Learning Environment Using Multimodal Analogies
DOI:
https://doi.org/10.52731/liir.v003.056Abstract
In this paper, we present a novel approach for applying multimodal analogies to creative learning scenarios. We have chosen Japanese language learning, in particular kanji acquisition, as the first application domain for our research. Our solution is based on a kanji dictionary which we enriched with visual, compositional, and semantic information. We have manually assigned images to 3,500 kanji and elaborately annotated the mappings from the lexical data to its visual representation. This knowledge enables us to find high-quality analogies for associations between the visual and textual dimensions. The analogies are integrated into our Web-based contextual language learning environment to empower several creative learning applications through augmented browsing technology including exercises, quizzes, and educational games.
References
C.J. Doughty and M.H. Long, The Handbook of Second Language Acquisition, Blackwell
Publishing Ltd, 2003.
B. VanPatten, M. Smith, and A.G. Benati, Key Questions in Second Language Acquisition,
Cambridge University Press, 2020.
H. Matsumoto, “Peak learning experiences and language learning: A study of American
learners of Japanese,” Language Culture and Curriculum – LANG CULT CURRIC,
vol. 20, 2007, pp. 195–208.
S. Paxton, “Kanji matters in a multilingual Japan,” The Journal of Rikkyo University
Language Center, vol. 42, 2019, pp. 29–41.
L.S.Watts and P. Blessinger, Creative Learning in Higher Education, Routledge, 2017.
D. Davies et al., “Creative learning environments in education – A systematic literature
review,” Thinking Skills and Creativity, vol. 8, 2013, pp. 80–91.
M. Kubota, “Post study abroad investigation of kanji knowledge in Japanese as a second
language learners,” System, vol. 69, 2017, pp. 143-152.
ELM Learning, The Difference Between Creativity vs. Creative Learning (and How
to Harness Both), elmlearning.com/blog/creativity-vs-creative-learning/, Accessed:
-08-18.
Y. Mori, “Review of recent research on kanji processing, learning, and instruction,”
Japanese Language and Literature, vol. 48, no. 2, 2014, pp. 403–430.
P. Aubusson, D. Treagust, and A. Harrison, Learning and Teaching Science with
Analogies and Metaphors, The World of Science Education: Handbook of Research
in Australasia, Sense Publishers, 2009, pp. 199–226.
H. Somers, S. Dandapat, and S.K. Naskar, “A review of EBMT using proportional
analogies,” EBMT 2009 – 3rd Workshop on Example-Based Machine Translation,
R. Fam and Y. Lepage, “Morphological predictability of unseen words using computational
analogy,” CEUR Workshop Proceedings, vol. 1815, 2016, pp. 51–60.
J. Breen, “Multiple indexing in an electronic kanji dictionary,” Proceedings of the
Workshop on Enhancing and Using Electronic Dictionaries, 2004, pp. 1–7.
G.A. Miller, “WordNet: A lexical database for English,” Commun. ACM, vol. 38, no.
, 1995, pp. 39–41.
J. Wielemaker, T. Schrijvers, M. Triska, and T. Lager, “SWI-Prolog,” Theory and
Practice of Logic Programming, Cambridge University Press, vol. 12, no. 1-2, 2012,
pp. 67–96.
W. Winiwarter and B. Wloka, “VISCOSE – A kanji dictionary enriched with VISual,
COmpositional, and SEmantic information,” Proceedings of the AACL-IJCNLP 7th
Workshop on Cognitive Aspects of the Lexicon (CogALex-VII), 2022, pp. 68–77.
H. Heuer and D. Buschek, “Methods for the design and evaluation of HCI+NLP systems,”
arXiv, vol. 2102.13461 [cs.CL], 2021.
