Open Access iconOpen Access

ARTICLE

crossmark

Data Layout and Scheduling Tasks in a Meteorological Cloud Environment

Kunfu Wang, Yongsheng Hao, Jie Cao*

School of Mathematics and Statistics, Nanjing University of Information Science & Technology, Nanjing, 210044, China

* Corresponding Author: Jie Cao. Email: email

Intelligent Automation & Soft Computing 2023, 37(1), 1033-1052. https://doi.org/10.32604/iasc.2023.038036

Abstract

Meteorological model tasks require considerable meteorological basis data to support their execution. However, if the task and the meteorological datasets are located on different clouds, that enhances the cost, execution time, and energy consumption of execution meteorological tasks. Therefore, the data layout and task scheduling may work together in the meteorological cloud to avoid being in various locations. To the best of our knowledge, this is the first paper that tries to schedule meteorological tasks with the help of the meteorological data set layout. First, we use the FP-Growth-M (frequent-pattern growth for meteorological model datasets) method to mine the relationship between meteorological models and datasets. Second, based on the relation, we propose a heuristics algorithm for laying out the meteorological datasets and scheduling tasks. Finally, we use simulation results to compare our proposed method with other methods. The simulation results show that our method reduces the number of involved clouds, the sizes of files from outer clouds, and the time of transmitting files.

Keywords


Cite This Article

K. Wang, Y. Hao and J. Cao, "Data layout and scheduling tasks in a meteorological cloud environment," Intelligent Automation & Soft Computing, vol. 37, no.1, pp. 1033–1052, 2023.



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 535

    View

  • 259

    Download

  • 0

    Like

Share Link