Open Access
ARTICLE
PanopticUAV: Panoptic Segmentation of UAV Images for Marine Environment Monitoring
Yuling Dou1, Fengqin Yao1, Xiandong Wang1, Liang Qu2, Long Chen3, Zhiwei Xu4, Laihui Ding4, Leon Bevan Bullock1, Guoqiang Zhong1, Shengke Wang1,*
1 School of Computer Science and Technology, Ocean University of China, Qingdao, 266100, China
2 North China Sea Environmental Monitoring Center, State Oceanic Administration, Qingdao, 266000, China
3 Department of Informatics, University of Leicester, Leicester, LE1 7RH, UK
4 Research and Development Department, Shandong Willand Intelligent Technology Co., Ltd., Qingdao, 266102, China
* Corresponding Author: Shengke Wang. Email:
(This article belongs to the Special Issue: Deep Learning for Marine and Underwater Environment: Theory, Method, and Applications)
Computer Modeling in Engineering & Sciences 2024, 138(1), 1001-1014. https://doi.org/10.32604/cmes.2023.027764
Received 14 November 2022; Accepted 19 April 2023; Issue published 22 September 2023
Abstract
UAV marine monitoring plays an essential role in marine environmental protection because of its flexibility and convenience, low cost and convenient maintenance. In marine environmental monitoring, the similarity between objects such as oil spill and sea surface,
Spartina alterniflora and algae is high, and the effect of the general segmentation algorithm is poor, which brings new challenges to the segmentation of UAV marine images. Panoramic segmentation can do object detection and semantic segmentation at the same time, which can well solve the polymorphism problem of objects in UAV ocean images. Currently, there are few studies on UAV marine image recognition with panoptic segmentation. In addition, there are no publicly available panoptic segmentation datasets for UAV images. In this work, we collect and annotate UAV images to form a panoptic segmentation UAV dataset named UAV-OUC-SEG and propose a panoptic segmentation method named PanopticUAV. First, to deal with the large intraclass variability in scale, deformable convolution and CBAM attention mechanism are employed in the backbone to obtain more accurate features. Second, due to the complexity and diversity of marine images, boundary masks by the Laplacian operator equation from the ground truth are merged into feature maps to improve boundary segmentation precision. Experiments demonstrate the advantages of PanopticUAV beyond the most other advanced approaches on the UAV-OUC-SEG dataset.
Keywords
Cite This Article
APA Style
Dou, Y., Yao, F., Wang, X., Qu, L., Chen, L. et al. (2024). Panopticuav: panoptic segmentation of UAV images for marine environment monitoring. Computer Modeling in Engineering & Sciences, 138(1), 1001-1014. https://doi.org/10.32604/cmes.2023.027764
Vancouver Style
Dou Y, Yao F, Wang X, Qu L, Chen L, Xu Z, et al. Panopticuav: panoptic segmentation of UAV images for marine environment monitoring. Comput Model Eng Sci. 2024;138(1):1001-1014 https://doi.org/10.32604/cmes.2023.027764
IEEE Style
Y. Dou et al., "PanopticUAV: Panoptic Segmentation of UAV Images for Marine Environment Monitoring," Comput. Model. Eng. Sci., vol. 138, no. 1, pp. 1001-1014. 2024. https://doi.org/10.32604/cmes.2023.027764