Error-Driven Learning: Development of Vocabulary Learning Support System that Utilizes Suggestibility of Error by Image Generation

Authors

  • kazuki sugita Japan Advanced Institute of Science and Technology
  • Wen Gu
  • 長谷川 忍

DOI:

https://doi.org/10.52731/liir.v003.078

Abstract

Vocabulary learning has long been taught as a basis for L2 English language learning. The use of visual clues is a widely recognized method in vocabulary learning. Several studies have applied automatic image caption generation, invented with computer vision and natural language processing, to English vocabulary learning in recent years. However, these vocabulary learning systems mainly use correct answers and their corresponding images. Another study focuses on the effectiveness of making errors, utilizing simulation to visualize the learner’s error, and its suggestibility contributes to the learning effectiveness of the physics task. We focus on the effectiveness of error with image generation implying suggestibility and hypothesize that errors encourage the students to memorize the vocabulary effectively. We propose a vocabulary learning support system with image generation corresponding to learner’s error for L2 English language learners. To accomplish the development, we defined three tasks and researched its possibility.

References

Michaud, Matthew & Colpitts, Bradley. (2015). English as a Lingua Franca: Globalization, Ownership, and the Diversification of English.

Laufer, Batia. (1989). A factor of difficulty in vocabulary learning: Deceptive transparency. AILA Review. 6. 10-20.

Nagy, W. (1995). On the Role of Context in First- and Second-Language Vocabulary Learning. Technical Report No. 627.

Hasnine, M.N.; Flanagan, B.; Akcapinar, G.; Ogata, H.; Mouri, K.; Uosaki, N. (2019) Vo-cabulary learning support system based on automatic image captioning technology. In Pro-ceedings of the International Conference on Human-Computer Interaction, Orlando, FL, USA, 26–31 July 2019; Springer: Cham, Switzerland, pp. 346–358

Shadiev, Rustam & Wu, Ting-Ting & Huang, Yueh-Min. (2020). Using image-to-text recognition technology to facilitate vocabulary acquisition in authentic contexts. ReCALL. 32. 1-18. 10.1017/S0958344020000038.

C. Kobayashi (2016) “Lexical Errors in the English Compositions of Japanese Learners,” Foreign language education: Theory and practice, vol42, pp39-51.

Laufer, Batia. (1988). The concept of “synforms” (similar lexical forms) in L2 vocabulary acquisition. Language and Education. 2. 113-132. 10.1080/09500788809541228.

C.Tsuda, & N.Takahashi (2014). Effects of English phonological awareness on English learning among native Japanese speakers, Developmental Psychology Research, vol. 25, no. 1, pp. 95-106.

M.Kimura, & H.Arao (2018), Vocabulary Learning for Japanese of English, GEN TEFL Journal, no.13, pp. 94-105.

Krishan. K. (2014), Fossilization Errors in Intermediate Japanese L2 Learners of English Speech: A Small-scale Inquiry, The Journal of Nagasaki University of Foreign Studies, no 18, pp161-172 [11] Vinyals, O., Toshev, A., Bengio, S., Erhan, D. (2017): Show and tell: lessons learned from the 2015 mscoco image captioning challenge. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 652–663

Kaplan-Rakowski, R., Lin L., & Wojdynski, T. (2021). Learning vocabulary using 2D pic-tures is more effective than using immersive 3D stereoscopic pictures. International Journal of Human-Computer Interaction, 37(12)

Wammes, J.D., Meade, M.E., & Fernandes, M.A. (2016). The drawing effect: Evidence for reliable and robust memory benefits in free recall. The Quarterly Journal of Experimental Psychology, 69, 1752–1776.

T. Horiguchi & T. Hirashima (2002) Simulation-Based Learning Environment for Assisting Error-Correction Management of Error-Based Simulation Considering the Cause of Errors, Transactions of the Japanese Society for Artificial Intelligence, vol. 17, no. 4, pp. 462–472

Lin, Tsung-Yi & Maire, Michael & Belongie, Serge & Hays, James & Perona, Pietro & Ramanan, Deva & Dollár, Piotr & Zitnick, C. (2014). Microsoft COCO: Common Objects in Context. [16] Honnibal, M., & Montani, I. (2017). spaCy 2: Natural language understanding with Bloomembeddings, convolutional neural networks and incremental parsing [17] The CEFR-J Wordlist Version 1.6. Compiled by Yukio Tono, Tokyo University of Foreign Studies. Retrieved from http://www.cefr-j.org/download.html on dd/09/2022.

Tono, Yukio. (2019). Coming Full Circle —From CEFR to CEFR-J and back. CEFR Journal - Research and Practice. 1. 5-67. 10.37546/JALTSIG.CEFR1-1.

Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., and Chen, M.(2022), “Hierarchical Text-Conditional Image Generation with CLIP Latents”, arXiv e-prints.

Dayma, B., Patil, S., Cuenca, P., Saifullah, K., Abraham, T., Lê Khắc, P., Melas, L. & Ghosh, R. (2021), DALL·E Mini. https://github.com/borisdayma/dalle-mini

Downloads

Published

2023-02-17