The week's pick
Reseach Article
Proactive and Adaptive Data Migration in Hierarchical Storage Systems using Reinforcement Learning Agent
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 94 - Number 9 |
| Year of Publication: 2014 |
| Authors: T. G. Lakshmi, R. R. Sedamkar |
10.5120/16375-5844
|
T. G. Lakshmi, R. R. Sedamkar . Proactive and Adaptive Data Migration in Hierarchical Storage Systems using Reinforcement Learning Agent. International Journal of Computer Applications. 94, 9 ( May 2014), 46-52. DOI=10.5120/16375-5844
Abstract
With the data generation rates growing exponentially, businesses are having a difficult time maintaining data center infrastructure. Hierarchical storage systems has evolved as a better alternate to managing data, as frequently accessed data is placed on higher tiers and the least frequently accessed data on lower tiers. But the data arrangement is not always static. Data Migration is an operation in which the selected data is physically moved, or migrated, to different storage components. The existing method of data migration in hierarchical storage systems has several shortcomings – reactive, heuristic policies and proprietary software. This paper attempts to overcome the above limitations by applying a reinforcement learning (RL) agent in the data migration of hierarchical storage systems. By the addition of RL agent the data migration which earlier was responsive, is made proactive and adaptive. Experimental results demonstrate the effectiveness of the proposed RL agent. The results indicate that: (i) the average queue size of storage devices is reduced to almost zero as the RL agent proactively migrates data and (ii) at 95 % confidence level the RL agent has no affect on the read and write operation of certain file sizes.
References
- Somasundaram, G. , & Shrivastava, A. (2009), "Information storage and management", Wiley Publishing, Inc.
- Clark, Tom (2003), "Designing Storage Area Networks: A Practical Reference for Implementing Storage Area Networks", Addison-Wesley Longman Publishing Co. , Inc. ,
- Morse, E. A. , & Raval, V. (2008), "PCI DSS: Payment card industry data security standards in context", Computer Law & Security Review, 24(6), 540-554.
- IBM Redbook(1999), "Hierarchical Storage Management - AS/400e" IBM
- Sutton, R. S. , & Barto, A. G. (1998), "Reinforcement learning: An intro-duction", Cambridge, MA: MIT Press
- L. P. Kaelbling, L. M. Littman, and A. W. Moore (1996), "Reinforcementlearning: A survey," Journal of Artificial Intelligence Research, vol. 4, pp. 237–285
- Puterman, M. L. (2009),"Markov decision processes: discrete stochastic dynamic programming" (Vol. 414), New Jersey, John Wiley & Sons.
- Lodzimierz Funika, W. , & Szura, F. (2013), "Data Storage Using AI Methods". Computer Science, 14, 2.
- Qiang, W. , & Zhongli, Z. (2011, August), "Reinforcement learning model, algorithms and its application", In Mechatronic Science, Electric Engineering and Computer (MEC), 2011 International Conference on (pp. 1143-1146). IEEE.
- Rao, J. , Bu, X. , Xu, C. Z. , Wang, L. , & Yin, G. (2009, June), "VCONF: a reinforcement learning approach to virtual machines auto-configuration", In Proceedings of the 6th international conference on Autonomic computing (pp. 137-146). ACM.
- Vengerov, D. (2008)," A reinforcement learning framework for online data migration in hierarchical storage systems" The Journal of Supercomputing, 43(1), 1-19.
- Lakshmi T. G. , Sedamkar R. R. , Patil H (Nov. -Dec. , 2013), "Reinforcement Learning Approach for Data Migration in Hierarchical Storage Systems", International Journal of Enhanced Research in Management & Computer Applications, ISSN: 2319-7471,Vol. 2 Issue 9, pp: (30-35)
Index Terms
Keywords