Modeling Historical Landscape and Architectures Utilizing Open Data for Enhanced Sightseeing Experience
Keywords:
Virtual tour, Historical digital twins, Open data, Virtual cityscapes
Abstract
In this paper, we explore an application of digital twin technologies to the field of digital heritage preservation, focusing on the historical city of Aizu-Wakamatsu, Japan.
Leveraging open data and freely available software, we considered a methodology for the digital reconstruction of historical landscapes and architectural features, employing historical GIS data, 3D modeling, and virtual reality techniques. We applied our methodology to constructing a virtual representation of Aizu-Wakamatsu in the past time, with a specific attention to Tsuriga-jo, the latter being a famous castle in the North-Eastern Japan. These reconstructions enhance the cultural and educational experience of visitors, but also contribute to the broader goals of heritage conservation. We discuss the potential of virtual tours to offer enriched, immersive, and interactive narratives of the past. Our study underscores the importance of preserving cultural heritage through digital technology and demonstrates the potential of digital twins in understanding and experiencing historical landscapes. The methodology and findings of this paper contribute to the emerging field of digital humanities and offer a scalable framework for future research in digital heritage preservation and virtual tourism.
References
M. Shibazaki, Y. Isoda, A. Tsukamoto, Y. Kosaka, K. Hasegawa, S. Nakata, and S. Tanaka,
``Modeling, Viewing and Simulating Kyoto Street Models Created from GIS Data,''
Proc. 22nd CIPA Symposium, Kyoto, Japan. October 11-15,
2009.
\url{https://www.cipaheritagedocumentation.org/activities/conferences/proceedings_2009/}
Y. Isoda, A. Tsukamoto, Y. Kosaka, T. Okumura, M. Sawai, K. Yano, S. Nakata, and S. Tanaka,
``Reconstruction of Kyoto of the Edo era Based on Arts and Historical Documents: 3D Urban Model Based on Historical GIS Data,''
International Journal of Humanities and Arts Computing, vol. 3, no. 1-2, 2009,
pp. 21--38.
\doi{10.3366/ijhac.2009.0007}
Y. Kosaka, Y. Isoda, A. Tsukamoto, T. Okumura, G. Minato, S. Nakata, and S. Tanaka,
``Automatic Generation of Urban 3D Model of Kyoto in Edo Era Based on Period Map,''
Proc. IPSJ SIG Computers and the Humanities Symposium 2006, pp. 39-46.
Y. Kosaka, Y. Isoda, A. Tsukamoto, T. Okumura, S. Nakata, S. Tanaka,
``Automatic Generation of Urban 3D Model Based on GIS Data : Application in Generation of Kyoto in the Edo Era,''
Transactions of the Virtual Reality Society of Japan,
vol. 13, iss. 3, 2008, pp. 315-323.
\doi{10.18974/tvrsj.13.3_315}
Y. Kawai,
``Creating a Regional and Historical Streetscape Simulation System,''
Entertainment Computing – ICEC 2017, LNCS 10507, N. Munekata, et al., eds.,
Springer-Verlag, Berlin, Heidelberg, 2017, pp. 456–459.
\doi{10.1007/978-3-319-66715-7_62}
Y. Kawai,
``Development of Past General Townscape Simulation System Using Time Series Design and Ukiyo-e Style Rendering,''
Proc. 2019 International Conference on Cyberworlds (CW), Kyoto, Japan, 2019,
pp. 366-369.
\doi{10.1109/CW.2019.00068}
M. Husak,
``Old maps and its Usage with Contemporary Map in Environment of Geographical Information System (GIS),''
Proc. of the First ICA Symposium for Central and Eastern Europe,
Vienna, February 16-17, 2009, pp. 833-842.
\url{https://bib.irb.hr/datoteka/498364.58_husak.pdf}
T. Kakuta, T. Oishi, S. Ono, and K. Ikeuchi,
``Virtual Asukakyo: A Restoration of an Archeological Site with Mixed Reality Technology and Expansion into a Tour Guide System,''
Monthly journal of the Institute of Industrial Science, University of Tokyo, vol. 59, no. 3, 2007, pp. 172-175.
\doi{10.11188/seisankenkyu.59.172}
T. Kakuta, T. Oishi, and K. Ikeuchi,
``Virtual Asukakyo: Real-Time Soft Shadows in Mixed Reality using Shadowing Planes,''
Digitally Archiving Cultural Objects, K. Ikeuchi and D. Miyazaki ed., Springer, Boston, MA, 2008, pp. 457-471.
\doi{10.1007/978-0-387-75807_22}
D. Miyazaki et al.,
``The great Buddha Project: Modeling Cultural Heritage Through Observation,''
The Springer International Series in Engineering and Computer Science, vol 640,
K. Ikeuchi and Y Sato ed., Springer, Boston, MA, 2001, pp. 181-193.
\doi{10.1007/978-1-4615-0797-0_8}
K. Ikeuchi et al.,
``The Great Buddha Project: Digitally Archiving, Restoring, and Analyzing Cultural Heritage Objects,''
International Journal of Computer Vision, vol. 75, 2007, pp. 189–208.
\doi{10.1007/s11263-007-0039-y}
K. Okazaki and E. Pyshkin,
``Modeling Tsuruga-jo Castle Historical Landscape for Extending Sightseeing Experience,''
Proc. of the 14th International Congress on Advanced Applied Informatics (IIAI-AAI),
Koriyama, Japan, 2023,
pp. 76--81.
\doi{10.1109/IIAI-AAI59060.2023.00025}
(Present paper is the extended journal version of this document).
ADEAC,
``Aizu-Wakamatsu City Digital Archives,''
\url{https://adeac.jp/city-aizuwakamatsu/top/}
Accessed: Dec. 2023.
Aizu-Wakamatu Nanukamachi-dori,
``nanukamachi.com Digital Archives,''
\url{https://www.nanukamachi.com/digitalarchives/}
Accessed: Dec. 2023.
Aizu-Wakamatsu City,
``About the General Situation of the Number of Tourists in Aizu-Wakamatsu City in 2021,''
(in Japanese)
\url{https://www.city.aizuwakamatsu.fukushima.jp/docs/2022031400039/files/01kankoukyakuirikomi_gaiyou.pdf} Accessed: Dec. 2023
Aizu-Wakamatsu City,
``Status of Entry into Tourist Facilities,'' (in Japanese)
\url{https://www.city.aizuwakamatsu.fukushima.jp/docs/2022031400039/files/kannkousisetu.pdf}
Accessed: Dec. 2023.
blender.org - Home of the Blender project - Free and Open 3D Creation Software,
\url{https://www.blender.org}
Accessed: Dec. 2023.
Unity Real-Time Development Platform,
\url{https://unity.com}
Accessed: Dec. 2023.
H. Sato, M. Takeuchi, S. Imamura, and K. Yano,
``Creation and Release of the Gion Festival Digital Museum 2020,''
E-journal GEO, vol. 16, iss. 1, 2021, pp. 87-101.
\doi{10.4157/ejgeo.16.87}
The Geospatial Information Authority of Japan,
``Fundamental Geospatial Data Download Service,''
\url{https://fgd.gsi.go.jp/download/menu.php}
Accessed: Dec. 2023.
E. Pyshkin and M. Pyshkin,
``Towards better requirement definition for multimedia travel guiding applications,''
Proc. 2016 IEEE Symposium Series on Computational Intelligence (SSCI),
Athens, Greece, 2016, pp. 1-7.
\doi{10.1109/SSCI.2016.7850189}
E. Shimizu, T. Fuse, and S. Morichi,
``A Study on Geometric Correction of Historical Maps,''
Proc. Japan Society of Civil Engineers (JSCE),
vol. 625, 1999, pp. 89-98.
\doi{10.2208/jscej.1999.625_89}
S. Aronoff,
``Geographic Information System: A Management Perspective,''
WDL Publicaciones, Ottawa, Canada, 1989, pp. 177-180.
\doi{10.1080/10106048909354237}
H. Akima,
``A New Method of Interpolation and Smooth Curve Fitting Based on Local Procedures,''
Journal of the Association for Computing Machinery,
vol. 17, No.4, 1970, pp. 589-602.
\doi{10.1145/321607.321609}
A. Moneta,
``Architecture, Heritage, and the Metaverse,''
Traditional Dwellings and Settlements Review, vol. 32, no. 1, 2020, pp. 37-49.
\url{https://www.jstor.org/stable/27074915}
J. Lebied\'{z} and M. Szwoch,
``Virtual sightseeing in Immersive 3D Visualization Lab,''
Proc. 2016 Federated Conference on Computer Science and Information Systems (FedCSIS),
Gdansk, Poland, 2016, pp. 1641-1645.
\doi{10.15439/2016F227}
O. Benesch and R. Zwigenberg,
``Shuri Castle and Japanese Castles: A Controversial Heritage,''
The Asia-Pacific Journal: Japan Focus, vol. 17, iss. 24, no. 3, 2019,
Article ID 5334.
\url{https://apjjf.org/2019/24/Benesch}
G. Papagiannakis, S. Schertenleib, B. O'Kennedy, M. Arevalo-Poizat, N. Magnenat-Thalmann, A. Stoddart, D. ThalmannL,
``Mixing virtual and real scenes in the site of ancient Pompeii,''
Computer Animation and Virtual Worlds, vol. 16, iss. 1, 2005, pp. 11–-24.
\doi{10.1002/cav.53}
Z. Pervolarakis, Zacharias, E. Zidianakis, A. Katzourakis, T. Evdaimon, N. Partarakis, X. Zabulis, and C. Stephanidis. ``Three-Dimensional Digitization of Archaeological Sites—The Use Case of the Palace of Knossos,'' Heritage, vol. 6, no. 2, 2023, pp. 904--927.
\doi{10.3390/heritage6020050}
L. Ajili, H. Louati, and F. Ben Ameur,
``Augmented Reality Coupled with Deep Convolution Neural Networks to Enhance Archaeological Sites Experience,''
In Frontiers in Artificial Intelligence and Applications, vol. 371 ``New Trends in Intelligent Software Methodologies, Tools and Techniques,'' H. Fujita et al. (eds.), IOS Press, 2023, pp. 97–-108.
\doi{10.3233/FAIA230227}
``Modeling, Viewing and Simulating Kyoto Street Models Created from GIS Data,''
Proc. 22nd CIPA Symposium, Kyoto, Japan. October 11-15,
2009.
\url{https://www.cipaheritagedocumentation.org/activities/conferences/proceedings_2009/}
Y. Isoda, A. Tsukamoto, Y. Kosaka, T. Okumura, M. Sawai, K. Yano, S. Nakata, and S. Tanaka,
``Reconstruction of Kyoto of the Edo era Based on Arts and Historical Documents: 3D Urban Model Based on Historical GIS Data,''
International Journal of Humanities and Arts Computing, vol. 3, no. 1-2, 2009,
pp. 21--38.
\doi{10.3366/ijhac.2009.0007}
Y. Kosaka, Y. Isoda, A. Tsukamoto, T. Okumura, G. Minato, S. Nakata, and S. Tanaka,
``Automatic Generation of Urban 3D Model of Kyoto in Edo Era Based on Period Map,''
Proc. IPSJ SIG Computers and the Humanities Symposium 2006, pp. 39-46.
Y. Kosaka, Y. Isoda, A. Tsukamoto, T. Okumura, S. Nakata, S. Tanaka,
``Automatic Generation of Urban 3D Model Based on GIS Data : Application in Generation of Kyoto in the Edo Era,''
Transactions of the Virtual Reality Society of Japan,
vol. 13, iss. 3, 2008, pp. 315-323.
\doi{10.18974/tvrsj.13.3_315}
Y. Kawai,
``Creating a Regional and Historical Streetscape Simulation System,''
Entertainment Computing – ICEC 2017, LNCS 10507, N. Munekata, et al., eds.,
Springer-Verlag, Berlin, Heidelberg, 2017, pp. 456–459.
\doi{10.1007/978-3-319-66715-7_62}
Y. Kawai,
``Development of Past General Townscape Simulation System Using Time Series Design and Ukiyo-e Style Rendering,''
Proc. 2019 International Conference on Cyberworlds (CW), Kyoto, Japan, 2019,
pp. 366-369.
\doi{10.1109/CW.2019.00068}
M. Husak,
``Old maps and its Usage with Contemporary Map in Environment of Geographical Information System (GIS),''
Proc. of the First ICA Symposium for Central and Eastern Europe,
Vienna, February 16-17, 2009, pp. 833-842.
\url{https://bib.irb.hr/datoteka/498364.58_husak.pdf}
T. Kakuta, T. Oishi, S. Ono, and K. Ikeuchi,
``Virtual Asukakyo: A Restoration of an Archeological Site with Mixed Reality Technology and Expansion into a Tour Guide System,''
Monthly journal of the Institute of Industrial Science, University of Tokyo, vol. 59, no. 3, 2007, pp. 172-175.
\doi{10.11188/seisankenkyu.59.172}
T. Kakuta, T. Oishi, and K. Ikeuchi,
``Virtual Asukakyo: Real-Time Soft Shadows in Mixed Reality using Shadowing Planes,''
Digitally Archiving Cultural Objects, K. Ikeuchi and D. Miyazaki ed., Springer, Boston, MA, 2008, pp. 457-471.
\doi{10.1007/978-0-387-75807_22}
D. Miyazaki et al.,
``The great Buddha Project: Modeling Cultural Heritage Through Observation,''
The Springer International Series in Engineering and Computer Science, vol 640,
K. Ikeuchi and Y Sato ed., Springer, Boston, MA, 2001, pp. 181-193.
\doi{10.1007/978-1-4615-0797-0_8}
K. Ikeuchi et al.,
``The Great Buddha Project: Digitally Archiving, Restoring, and Analyzing Cultural Heritage Objects,''
International Journal of Computer Vision, vol. 75, 2007, pp. 189–208.
\doi{10.1007/s11263-007-0039-y}
K. Okazaki and E. Pyshkin,
``Modeling Tsuruga-jo Castle Historical Landscape for Extending Sightseeing Experience,''
Proc. of the 14th International Congress on Advanced Applied Informatics (IIAI-AAI),
Koriyama, Japan, 2023,
pp. 76--81.
\doi{10.1109/IIAI-AAI59060.2023.00025}
(Present paper is the extended journal version of this document).
ADEAC,
``Aizu-Wakamatsu City Digital Archives,''
\url{https://adeac.jp/city-aizuwakamatsu/top/}
Accessed: Dec. 2023.
Aizu-Wakamatu Nanukamachi-dori,
``nanukamachi.com Digital Archives,''
\url{https://www.nanukamachi.com/digitalarchives/}
Accessed: Dec. 2023.
Aizu-Wakamatsu City,
``About the General Situation of the Number of Tourists in Aizu-Wakamatsu City in 2021,''
(in Japanese)
\url{https://www.city.aizuwakamatsu.fukushima.jp/docs/2022031400039/files/01kankoukyakuirikomi_gaiyou.pdf} Accessed: Dec. 2023
Aizu-Wakamatsu City,
``Status of Entry into Tourist Facilities,'' (in Japanese)
\url{https://www.city.aizuwakamatsu.fukushima.jp/docs/2022031400039/files/kannkousisetu.pdf}
Accessed: Dec. 2023.
blender.org - Home of the Blender project - Free and Open 3D Creation Software,
\url{https://www.blender.org}
Accessed: Dec. 2023.
Unity Real-Time Development Platform,
\url{https://unity.com}
Accessed: Dec. 2023.
H. Sato, M. Takeuchi, S. Imamura, and K. Yano,
``Creation and Release of the Gion Festival Digital Museum 2020,''
E-journal GEO, vol. 16, iss. 1, 2021, pp. 87-101.
\doi{10.4157/ejgeo.16.87}
The Geospatial Information Authority of Japan,
``Fundamental Geospatial Data Download Service,''
\url{https://fgd.gsi.go.jp/download/menu.php}
Accessed: Dec. 2023.
E. Pyshkin and M. Pyshkin,
``Towards better requirement definition for multimedia travel guiding applications,''
Proc. 2016 IEEE Symposium Series on Computational Intelligence (SSCI),
Athens, Greece, 2016, pp. 1-7.
\doi{10.1109/SSCI.2016.7850189}
E. Shimizu, T. Fuse, and S. Morichi,
``A Study on Geometric Correction of Historical Maps,''
Proc. Japan Society of Civil Engineers (JSCE),
vol. 625, 1999, pp. 89-98.
\doi{10.2208/jscej.1999.625_89}
S. Aronoff,
``Geographic Information System: A Management Perspective,''
WDL Publicaciones, Ottawa, Canada, 1989, pp. 177-180.
\doi{10.1080/10106048909354237}
H. Akima,
``A New Method of Interpolation and Smooth Curve Fitting Based on Local Procedures,''
Journal of the Association for Computing Machinery,
vol. 17, No.4, 1970, pp. 589-602.
\doi{10.1145/321607.321609}
A. Moneta,
``Architecture, Heritage, and the Metaverse,''
Traditional Dwellings and Settlements Review, vol. 32, no. 1, 2020, pp. 37-49.
\url{https://www.jstor.org/stable/27074915}
J. Lebied\'{z} and M. Szwoch,
``Virtual sightseeing in Immersive 3D Visualization Lab,''
Proc. 2016 Federated Conference on Computer Science and Information Systems (FedCSIS),
Gdansk, Poland, 2016, pp. 1641-1645.
\doi{10.15439/2016F227}
O. Benesch and R. Zwigenberg,
``Shuri Castle and Japanese Castles: A Controversial Heritage,''
The Asia-Pacific Journal: Japan Focus, vol. 17, iss. 24, no. 3, 2019,
Article ID 5334.
\url{https://apjjf.org/2019/24/Benesch}
G. Papagiannakis, S. Schertenleib, B. O'Kennedy, M. Arevalo-Poizat, N. Magnenat-Thalmann, A. Stoddart, D. ThalmannL,
``Mixing virtual and real scenes in the site of ancient Pompeii,''
Computer Animation and Virtual Worlds, vol. 16, iss. 1, 2005, pp. 11–-24.
\doi{10.1002/cav.53}
Z. Pervolarakis, Zacharias, E. Zidianakis, A. Katzourakis, T. Evdaimon, N. Partarakis, X. Zabulis, and C. Stephanidis. ``Three-Dimensional Digitization of Archaeological Sites—The Use Case of the Palace of Knossos,'' Heritage, vol. 6, no. 2, 2023, pp. 904--927.
\doi{10.3390/heritage6020050}
L. Ajili, H. Louati, and F. Ben Ameur,
``Augmented Reality Coupled with Deep Convolution Neural Networks to Enhance Archaeological Sites Experience,''
In Frontiers in Artificial Intelligence and Applications, vol. 371 ``New Trends in Intelligent Software Methodologies, Tools and Techniques,'' H. Fujita et al. (eds.), IOS Press, 2023, pp. 97–-108.
\doi{10.3233/FAIA230227}
