New approach for load rebalancer, scheduler in big data with security mechanism in cloud environment

Abstract

In cloud applications, distributed file system is very core technology. Many functionalities of computing applications can be performed with the help of file system, such applications is rely on the distributed programming and having a number of distributed chunks are assign to each nodes; node receive each separate chunk that performs in parallel. But failure of node is the major issue, this issue may be recovered in cloud also replaced and added to the nodes. Facing load imbalance problem; that is, the file chunks are not assigning correctly among all the nodes. For that purpose the load rebalancing technique comes into picture, load rebalancing has the more efficiency that makes system more efficient. For load imbalance we use a secure load rebalancing algorithm that merges with the MD5 with DES encryption algorithm. The result shows performs the system in terms of security parameters message overhead and the movement cost for our proposed scheme. For this work we are implementing in distributed file system of the EC2.