An Efficiency Optimization Strategy for Huge-Scale Data Handling

Abstract

This paper discussed the efficiency optimization of handling huge scale data and analyzed the relationship of the factors and the efficiency. The cost of the whole access procedure has been analyzed as well. It proposed overhead shifting strategy to optimize the performance of handling these problems. The main idea of this overhead shifting method is to reduce the critical factor—communication overhead. It shifts the logic process code to the client. This strategy deals with the dirty data, which is the result of itself, are by implement a state notification protocol. The protocol notifies the client whether its data becomes dirty so that the client can easily decide how to behave. An experiment was done to prove the superiority of the new strategy. The results showed that this overhead shifting strategy improves most accesses and operations and makes the user experience being satisfied.