TY - EJOU AU - Zhao, Zheda AU - Xu, Tao AU - Yang, Tong AU - Wu, Yunpeng AU - Guo, Fengxiang TI - Automatic Potential Safety Hazard Detection for High-Speed Railroad Surrounding Environment Using Lightweight Hybrid Dual Tasks Architecture T2 - Structural Durability \& Health Monitoring PY - 2025 VL - 19 IS - 6 SN - 1930-2991 AB - Utilizing unmanned aerial vehicle (UAV) photography to timely detect and evaluate potential safety hazards (PSHs) around high-speed rail has great potential to complement and reform the existing manual inspections by providing better overhead views and mitigating safety issues. However, UAV inspections based on manual interpretation, which heavily rely on the experience, attention, and judgment of human inspectors, still inevitably suffer from subjectivity and inaccuracy. To address this issue, this study proposes a lightweight hybrid learning algorithm named HDTA (hybrid dual tasks architecture) to automatically and efficiently detect the PSHs of UAV imagery. First, this HDTA architecture seamlessly integrates both detection and segmentation branches within a unified framework. This design enables the model to simultaneously perform PSH detection and railroad parsing, thereby providing comprehensive scene understanding. Such joint learning also lays the foundation for PSH assessment tasks. Second, an innovative lightweight backbone based on the shuffle selective state space model (S4M) is incorporated into HDTA. The state space model approach allows for global contextual information extraction while maintaining linear computational complexity. Furthermore, the incorporation of shuffle operation facilitates more efficient information flow across feature dimensions, enhancing both feature representation and fusion capabilities. Finally, extensive experiments conducted on a railroad environment dataset constructed from UAV imagery demonstrate that the proposed method achieves high detection accuracy while maintaining efficiency and practicality. KW - Railroad inspection; hybrid architecture; drone image; pixel-level segmentation DO - 10.32604/sdhm.2025.069611