Migration algorithm for Ceph block device cross clusters

doi:10.3969/j.issn.0253-2778.2018.09.009

Abstract

Abstract: The migration time of huge image files is vital to the efficiency of the whole-system on-line migration of a virtual machine. Therefore, optimizing the migration time has become a hot research area in virtual-machine migration technology. For virtual machines based on a distributed storage system, in which the more common one is Ceph block device, image data must go from the source storage nodes to the source client nodes, then to the destination client nodes, and finally to the destination storage nodes. This way ignores the benefit from the storage system to the migration. Given the above problems, a migration algorithm for Ceph block device cross clusters is effective. Image data go from the source storage nodes to the destination storage nodes in parallel, which uses the network of storage nodes.The result of the experiment shows that this algorithm shortens the migration time,and a few more storage nodes can improve efficiency of this algorithm.

Key words: virtual machine, live migration, whole-system, distributed storage, Ceph block device

CLC Number:

TP393

SHAO Xiyu, LI Jing, ZHOU Zhiqiang. Migration algorithm for Ceph block device cross clusters[J]. Journal of University of Science and Technology of China, 2018, 48(9): 748-754.

References

［1］
CLARK C, FRASER K, HAND S, et al. Live migration of virtual machines[C]// Proceedings of the 2nd Conference on Symposium on Networked Systems Design & Implementation. Berkeley, USA: USENIX Association, 2005: 273-286.
[2] NELSON M, LIM B H, HUTCHINS G. Fast transparent migration for virtual machines[C]// Proceedings of the USENIX Annual Technical Conference. Berkeley, USA: USENIX Association, 2005: 391-394.
[3] HANSEN J G, JUL E. Self-migration of operating systems[C]// Proceedings of the 11th Conference on ACM SIGOPS European Workshop. Leuven, Belgium: ACM Press, 2004: No.23(1-5) .
[4] ZHANG B, LUO Y, WANG X, et al. Whole-system live migration mechanism for virtual machines [J]. Acta Electronica Sinica, 2009,37(4): 894-899.
[5] HIROFUCHI T, NAKADA H, OGAWA H, et al. A live storage migration mechanism over wan and its performance evaluation[C]// Proceedings of the 3rd International Workshop on Virtualization Technologies in Distributed Computing. New York: ACM Press, 2009: 67-74.
[6] BRADFORD R, KOTSOVINOS E, FELDMANN A, et al. Live wide-area migration of virtual machines including local persistent state[C]// Proceedings of the 3rd International Conference on Virtual Execution Environments. San Diego, USA: ACM Press, 2007: 169-179.
[7] WEIL S A, BRANDT S A, MILLER E L, et al. Ceph: A scalable, high-performance distributed file system[C]// Proceedings of the 7th Symposium on Operating Systems Design and Implementation. Seattle, USA: USENIX Association, 2006: 307-320.
[8] WEIL S A. Ceph: Reliable, scalable, and high-performance distributed storage[D]. Santa Cruz: University of California, 2007.
[9] LIANG X Y, GUAN Z G. Ceph CRUSH data distribution algorithms[J]. Applied Mechanics & Materials, 2014 596: 196-199.
[10] 王远洋，周渊平，郭焕丽. Linux下基于socket多线程并发通信的实现[J]. 微计算机信息, 2009, 25(3-5): 70-72.
WANG Yuanyang, ZHOU Yuanping, GUO Huanli. The accomplishment of multi-pthread communication based on socket model in the Linux [J]. Microcomputer Information, 2009, 25(3-5): 70-72.

（上接第717页）

[11] ROBERTS R S, BROWN W A, LOOMIS H H. Computationally efficient algorithms for cyclic spectral analysis[J]. IEEE Signal Processing Magazine, 1991, 8(2): 38-49.
[12] ANTONI J, XIN G, HAMZAOUI N. Fast computation of the spectral correlation[J]. Mechanical Systems and Signal Processing, 2017, 92: 248-277.
[13] NAPOLITANO A, PERNA I. Cyclic spectral analysis of the GPS signal[J]. Digital Signal Processing, 2014, 33: 13-33.
[14] GARDNER W A. Measurement of spectral correlation[J]. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1986, 34(5): 1111-1123.
[15] RAMKUMAR B. Automatic modulation classification for cognitive radios using cyclic feature detection[J]. IEEE Circuits and Systems Magazine, 2009, 9(2): 27-45.
[16] 赵宇峰, 曹玉健, 纪勇, 等. 基于循环频率特征的单信道混合通信信号的调制识别[J]. 电子与信息学报, 2014, 36(5): 1202-1208.
ZHAO Yufeng, CAO Yujian, JI Yong, et al. Modulation identification for single-channel mixed communication signals based on cyclic frequency features[J]. Journal of Electronics & Information Technology, 2014, 36(5): 1202-1208.
[17] HU Y, SONG M, and MENG B. GPS signal availability augmentation utilizing the navigation signal retransmission via the GEO Comsat[J]. Wireless Personal Communications, 2015, 82(4): 2655-2671.
[18] KAPLAN E D, HEGARTY C J. Understanding GPS: Principles and Applications[M]. 2ed, Boston, USA: Artech House Publishers, 2006: 153-200.

()
()

[1]	HU Wanbao, HU Shuai, CHEN Wenwen, CUI Liangwu. Repairing multiple failures for algebraic geometry codes [J]. Journal of University of Science and Technology of China, 2020, 50(2): 140-145.
[2]	LAI Yingxu, HU Shaolong, YANG Zhen. Research of security technology based on virtualization [J]. Journal of University of Science and Technology of China, 2011, 41(10): 907-914.
[3]	LIU Fang-fang, FEI Ye-tai, JIANG Min-lan. Research on the theory of the accuracy loss equality of dynamic measurement system [J]. Journal of University of Science and Technology of China, 2009, 39(4): 414-418.