Open Access iconOpen Access

ARTICLE

crossmark

Enhanced Best Fit Algorithm for Merging Small Files

Adnan Ali1, Nada Masood Mirza1,2, Mohamad Khairi Ishak1,*

1 School of Electrical and Electronic Engineering, Universiti Sains Malaysia (USM), Nibong Tebal, Pulau Pinang, 14300, Malaysia
2 University College, United Arab Emirates University, Al Ain, UAE

* Corresponding Author: Mohamad Khairi Ishak. Email: email

Computer Systems Science and Engineering 2023, 46(1), 913-928. https://doi.org/10.32604/csse.2023.036400

Abstract

In the Big Data era, numerous sources and environments generate massive amounts of data. This enormous amount of data necessitates specialized advanced tools and procedures that effectively evaluate the information and anticipate decisions for future changes. Hadoop is used to process this kind of data. It is known to handle vast volumes of data more efficiently than tiny amounts, which results in inefficiency in the framework. This study proposes a novel solution to the problem by applying the Enhanced Best Fit Merging algorithm (EBFM) that merges files depending on predefined parameters (type and size). Implementing this algorithm will ensure that the maximum amount of the block size and the generated file size will be in the same range. Its primary goal is to dynamically merge files with the stated criteria based on the file type to guarantee the efficacy and efficiency of the established system. This procedure takes place before the files are available for the Hadoop framework. Additionally, the files generated by the system are named with specific keywords to ensure there is no data loss (file overwrite). The proposed approach guarantees the generation of the fewest possible large files, which reduces the input/output memory burden and corresponds to the Hadoop framework’s effectiveness. The findings show that the proposed technique enhances the framework’s performance by approximately 64% while comparing all other potential performance-impairing variables. The proposed approach is implementable in any environment that uses the Hadoop framework, not limited to smart cities, real-time data analysis, etc.

Keywords


Cite This Article

APA Style
Ali, A., Mirza, N.M., Ishak, M.K. (2023). Enhanced best fit algorithm for merging small files. Computer Systems Science and Engineering, 46(1), 913-928. https://doi.org/10.32604/csse.2023.036400
Vancouver Style
Ali A, Mirza NM, Ishak MK. Enhanced best fit algorithm for merging small files. Comput Syst Sci Eng. 2023;46(1):913-928 https://doi.org/10.32604/csse.2023.036400
IEEE Style
A. Ali, N.M. Mirza, and M.K. Ishak "Enhanced Best Fit Algorithm for Merging Small Files," Comput. Syst. Sci. Eng., vol. 46, no. 1, pp. 913-928. 2023. https://doi.org/10.32604/csse.2023.036400



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 949

    View

  • 426

    Download

  • 0

    Like

Share Link