Developing an AR Pop-up Picture Book and its Effect Editor Based on Teaching Motions
Abstract
We propose an augmented reality (AR) pop-up picture book (AR book), which is a digital picture book using the AR technology. Digital picture books increase the interest of children in reading and are often used to encourage children to read. Conventional picture book writers have few technical skills and expertise in developing AR contents. We aim to develop an effect editor for AR books to aid the writers create expressive AR books. We propose a new intuitive method for obtaining editing effects in AR books using teaching motions based on demonstrations of writers using real-world objects. The results of our experimental evaluation demonstrate that the system can be effectively used to edit 3D motion effects in AR books.
References
J. Zhang, Y. Sasaki, T. Tsuruno, Y. Matsuura, N. Utsunomiya, and H. Yamamoto, “Investigation of Kansei Added Value in Book Publishing Filed by Using AR Contents” International Journal of Affective Engineering, vol. 14, no. 3, 2015, pp.151-155.
H. Kataoka, T. Ozono, and T. Shintani, “Realizing an Effect Editor for AR Pop-up Picture Books by Teaching Motions” IDDC2019, IEEE, 2019, pp. 989-994.
H. Stichnothe, “Engineering stories? A narratological approach to children’s book apps,” Nordic Journal of ChildLit Aesthetics, vol. 5, 2014, pp. 1-9.
B. Sargeant, “What is an ebook? What is a Book app? And why should we care? An analysis of contemporary digital picture books,” Children’s Literature in Education, vol. 46, no. 4, 2015, pp. 454-466.
F. Serafini, D. Kachorsky, and E. Aguilera, “Picture Books in the Digital Age,” The Reading Teacher, vol. 69, no. 5, 2016, pp. 509-512.
P. Lin, Y. Huang, and C. Chen, “Exploring imaginative capability and learning motivation difference through picture e-book,” IEEE Access, vol. 6, 2018, pp. 63416-63425.
R. C. Mota, R. A. Roberto, and V. Teichrieb, “Authoring tools in augmented reality: an analysis and classification of content design tools” Proceedings of the IEEE International Symposium on Mixed and Augmented Reality, 2015, pp. 164-167.
M. Nebeling, J. Nebeling, A. Yu, and R. Rumble, “ProtoAR: Rapid Physical-Digital Prototyping of Mobile Augmented Reality Applications” Proc. of CHI’18, no. 353, 2018, 12p.
C. Barnes, D. Jacobs, J. Sanders, D. Goldman, S. Rusinkiewicz, A. Finkelstein, and M. Agrawala, “Video Puppetry: A Performative Interface for Cutout Animation” ACM Transactions on Graphics (TOG), vol. 27, 5, no. 124, 2008, pp. 1-9.
R. T. Held, A. Gupta, V. Curless, and M. Agrawala, “3D Puppetry: A Kinect-based Interface for 3D Animation” Proceedings of the 25th annual ACM symposium on User interface software and technology, 2012, pp. 423-434.
R. Slyper, G. Hoffman, and A. Shamir, “Mirror Puppeteering: Animating Toy Robots in Front of a Webcam” Proceedings of the 9th International Conference on Tangible, Embedded and Embodied Interaction, 2015, pp. 241-248.
