TY  - EJOU
AU  - Yang, Ye 
AU  - Li, Xiaofang 
AU  - Zhu, Dongjie 
AU  - Hu, Hao 
AU  - Du, Haiwen 
AU  - Sun, Yundong 
AU  - Tian, Weiguo 
AU  - Wang, Yansong 
AU  - Cao, Ning 
AU  - O’Hare, Gregory M.P. 

TI  - A Resource-constrained Edge IoT Device Data-deduplication Method with Dynamic Asymmetric Maximum
T2  - Intelligent Automation \& Soft Computing

PY  - 2021
VL  - 30
IS  - 2
SN  - 2326-005X

AB  - Smart vehicles use sophisticated sensors to capture real-time data. Due to the weak communication capabilities of wireless sensors, these data need to upload to the cloud for processing. Sensor clouds can resolve these drawbacks. However, there is a large amount of redundant data in the sensor cloud, occupying a large amount of storage space and network bandwidth. Deduplication can yield cost savings by storing one data copy. Chunking is essential because it can determine the performance of deduplication. Content-Defined Chunking (CDC) can effectively solve the problem of chunk boundaries shifted, but it occupies a lot of computing resources and has become a bottleneck in deduplication technology. This paper proposes a Dynamic Asymmetric Maximum algorithm (DAM), which uses the maximum value as the chunk boundaries and reducing the impact of the low-entropy string. It also uses the perfect hash algorithm to optimize the chunk search. Experiments show that our solution can effectively detect low-entropy strings in redundant data, save storage resources, and improve sensor clouds system throughput.
KW  - Internet of Things; Sensor clouds; Intelligent transportation; Data deduplication

DO  - 10.32604/iasc.2021.019201