A Dynamic Configuration Scheme of Storage Tiers for an Autonomous Distributed Storage System

Shingo Shimano; Atsushi Nunome; Yuta Yokoi; Kiyoshi Shibayama; Hiroaki Hirata

doi:10.52731/iee.v3.i4.275

Shingo Shimano Kyoto Institute of Technology
Atsushi Nunome Kyoto Institute of Technology
Yuta Yokoi Kyoto Institute of Technology
Kiyoshi Shibayama Kyoto College of Graduate Studies for Informatics
Hiroaki Hirata Kyoto Institute of Technology

DOI: https://doi.org/10.52731/iee.v3.i4.275

Keywords: block relocation, distributed storage system, storage tiering

Abstract

We have proposed a distributed storage system which dynamically makes storage tiers and optimizes location of data blocks autonomously. This aims to enhance the I/O performance of the storage system without remarkable network overhead. Our system dynamically organizes storage tiers considering device characteristics. And the data blocks will be placed in a suitable storage tier according to their access pattern.
In this paper, we propose a method to select the destination storage node for migration using an access characteristic of a data block to be migrated. This method dynamically ranks the storage nodes, and autonomously configures storage tiers based on relative performance to the migration initiator. Simulation results show that our scheme can shorten the execution time of a program with file I/O by 80% at maximum, in comparison with the static migration without considering the access characteristics of the migration data.

Author Biographies

Atsushi Nunome, Kyoto Institute of Technology

Assistant Professor, Faculty of Information and Human Sciences

Kiyoshi Shibayama, Kyoto College of Graduate Studies for Informatics

Professor

Hiroaki Hirata, Kyoto Institute of Technology

Associate Professor, Faculty of Information and Human Sciences

References

A. Nunome, H. Hirata, and K. Shibayama, “A Distributed Storage System with Dynamic Tiering for iSCSI Environment,” Int’l Journal of Networked and Distributed Computing, vol. 3, no. 1, pp. 42–50, Jan. 2015.

S. Shimano, A. Nunome, H. Hirata, and K. Shibayama, “An Information Propagation Scheme for an Autonomous Distributed Storage System in iSCSI Environment,” Proc. the 3rd Int’l Conf. Applied Computing and Information Technology (ACIT 2015), Jul. 2015, pp. 149–154.

A. Nunome, H. Hirata, and K. Shibayama, “An Interval Control Method for Status Propagation in an Autonomous Distributed Storage System,” Proc. the 15th IEEE/ACIS Int’l Conf. Computer and Information Science (ICIS 2016), Jun. 2016, pp. 723–728.

S. Shimano, A. Nunome, Y. Yokoi, K. Shibayama, and H. Hirata, “An Autonomous Configuration Scheme of Storage Tiers for Distributed File System,” Proc. the 18th IEEE/ACIS Int’l Conf. Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD 2017), Jun. 2017, pp. 453–458.

D. Anderson, J. Dykes, and E. Riedel, “More than an interface — SCSI vs. ATA,” Proc. the 2nd USENIX Conf. File and Storage Technology, Mar. 2003, pp. 245–257.

R. Coker, “Bonnie++,” http://www.coker.com.au/bonnie++/experimental/.

OpenZFS Project, “OpenZFS,” http://www.open-zfs.org/.

J.R. Douceur and W.J. Bolosky, “A Large-Scale Study of File-System Contents,” Proc. the 1999 ACM SIGMETRICS Int’l Conf. Measurement and Modeling of Computer Systems, May 1999, pp. 59–70.

H. Huang, W. Hung, and K.G. Shin, “FS2: Dynamic Data Replication in Free Disk Space for Improving Disk Performance and Energy Consumption,” Proc. the 20th ACM Symp. Operating Systems Principles (SOSP ’05), Oct. 2005, pp. 263–276.

B. Dufrasne, B.A. Barbosa, P. Cronauer, D. Demarchi, H.-P. Drumm, R. Eliahu, X. Liu, and M. Stenson, IBM System Storage DS8000 Easy Tier. IBM Corp., 2013, available at ibm.com/redbooks.

“EMC VNX FAST VP A Detailed Review,” http://www.emc.com/collateral/software/white-papers/h8058-fast-vp-unified-storage-wp.pdf, EMC Corp., Dec. 2013.

“btier,” http://sourceforge.net/projects/tier/.

K. Oe, T. Nanri, and K. Okamura, “On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration,” Proc. the 3rd Int’l Symp. Computing and Networking. IEEE, Dec. 2015, pp. 371–377.

G. Lipetz, E. Hazan, A. Natanzon, and E. Bachmat, “Automated Tiering in a QoS Environment using Coarse Data,” Proc. 2013 IEEE 10th Int’l Conf. High Performance Computing and Communications & 2013 IEEE Int’l Conf. Embedded and Ubiquitous Computing. IEEE, Nov. 2013, pp. 1022–1030.