Density-based Spatiotemporal Analysis System with Photo Image Classifier Using the BoF Model
Abstract
Recently, people have begun to diligently post situational updates, particularly during natural disasters, such as an earthquake, typhoon, heavy storm, and snowfall, on social media; therefore, the enhancement of situation awareness in the real world using social data is one of the most attractive research subjects. In our previous work, we developed a density-based spatiotemporal system to identify topic-related areas in which there are a huge number of geo-tagged tweets related to a topic are posted. In this paper, we propose a novel densitybased spatiotemporal system with a photo image classifier in order to enhance situation awareness by showing accurate topic-related photos. The photo image classifier using a support vector machine (SVM) based on the Bag-of-Features (BoF) model is integrated into the conventional density-based spatiotemporal system. To evaluate the proposed system, we used actual data sets related to weather topics, “heavy rain” and “heavy snow,” in Japan. The experimental results indicate that the proposed system can extract photo images related to these weather topics with high accuracy and recall levels.
References
Akshay Java, Xiaodan Song, Tim Finin, and Belle Tseng. Why we twitter: Understanding microblogging usage and communities. In Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 Workshop on Web Mining and Social Network Analysis, WebKDD/SNA-KDD ’07, pp. 56–65, 2007.
Bernard J. Jansen, Mimi Zhang, Kate Sobel, and Abdur Chowdury. Twitter power: Tweets as electronic word of mouth. J. Am. Soc. Inf. Sci. Technol., Vol. 60, No. 11, pp. 2169–2188, 2009.
Marcelo Mendoza, Barbara Poblete, and Carlos Castillo. Twitter under crisis: Can we trust what we rt? In Proceedings of the First Workshop on Social Media Analytics, SOMA ’10, pp. 71–79, 2010.
Mor Naaman. Geographic information from georeferenced social media data. SIGSPATIAL Special, Vol. 3, No. 2, pp. 54–61, 2011.
Tatsuhiro Sakai and Keiichi Tamura. Real-time analysis application for identifying bursty localareas related to emergency topics. SpringerPlus, Vol. 4, No. 162, 2015.
Gabriella Csurka, Christopher R. Dance, Lixin Fan, Jutta Willamowski, and Cedric Bray. Visual categorization with bags of keypoints. In In Workshop on Statistical Learning in Computer Vision, ECCV, pp. 1–22, 2004.
Jie Yin, Andrew Lampert, Mark Cameron, Bella Robinson, and Robert Power. Using social media to enhance emergency situation awareness. IEEE Intelligent Systems, Vol. 27, No. 6, pp. 52–59, 2012.
Mai Miyabe, Asako Miura, and Eiji Aramaki. Use trend analysis of twitter after the great east japan earthquake. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work Companion, CSCW ’12, pp. 175–178, 2012.
Akiko Murakami and Tetsuya Nasukawa. Tweeting about the tsunami?: Mining twitter for information on the tohoku earthquake and tsunami. In Proceedings of the 21st International Conference Companion on World Wide Web, WWW ’12 Companion, pp. 709–710, 2012.
Sarah Vieweg, Amanda L. Hughes, Kate Starbird, and Leysia Palen. Microblogging during two natural hazards events: What twitter may contribute to situational awareness. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’10, pp. 1079–1088, 2010.
Takeshi Sakaki, Makoto Okazaki, and Yutaka Matsuo. Earthquake shakes twitter users: Real-time event detection by social sensors. In Proceedings of the 19th International Conference on World Wide Web, WWW ’10, pp. 851–860, 2010.
Eiji Aramaki, Sachiko Maskawa, and Mizuki Morita. Twitter catches the flu: Detecting influenza epidemics using twitter. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, EMNLP ’11, pp. 1568–1576, 2011.
Karl Kreiner, Aapo Immonen, and Hanna Suominen. Crisis management knowledge from social media. In Proceedings of the 18th Australasian Document Computing Symposium, ADCS ’13, pp. 105–108, 2013.
David J. Crandall, Lars Backstrom, Daniel Huttenlocher, and Jon Kleinberg. Mapping the world’s photos. In Proceedings of the 18th International Conference on World Wide Web, WWW ’09, pp. 761–770, 2009.
Brendan C. Fruin, Hanan Samet, and Jagan Sankaranarayanan. Tweetphoto: Photos from news tweets. In Proceedings of the 20th International Conference on Advances in Geographic Information Systems, SIGSPATIAL ’12, pp. 582–585, 2012.
Tatsuhiro Sakai, Keiichi Tamura, and Hajime Kitakami. Emergency situation awareness during natural disasters using density-based adaptive spatiotemporal clustering. In Database Systems for Advanced Applications, DASFAA 2015 International Workshops, SeCoP, BDMS, and Posters, Hanoi, Vietnam, April 20-23, 2015, Vol. 9052, pp.155–169, 2015.
Herbert Bay, Andreas Ess, Tinne Tuytelaars, and Luc Van Gool. Speeded-up robust features (SURF). Computer Vision and Image Understanding (CVIU), Vol. 110, No. 3, pp. 346–359, 2008.
