A Hybrid Pyramid and Strip Pooling Network for Accurate Building Extraction from Remote Sensing Images
DOI:
https://doi.org/10.54097/gz73jc92Keywords:
Building Extraction, Remote Sensing Imagery, Semantic Segmentation, Multi-Scale Feature Fusion, Strip Pooling, Attention MechanismAbstract
Accurate extraction of building footprints from remote sensing imagery is important for urban planning, disaster management, and geographic information systems. However, complex building shapes, occlusions, and scale variation continue to challenge conventional segmentation models. This paper presents SRB-Net, a U-Net-based framework that combines three complementary components: (1) strip pooling (SP) for long-range horizontal and vertical context; (2) residual multi-scale atrous spatial pyramid pooling (RMASPP) with squeeze-and-excitation (SE) blocks for multi-scale and channel-aware feature learning; and (3) a bottleneck attention module (BAM) for refining skip-connection features. The model was trained with the Adam optimizer and evaluated on the aerial and Satellite Dataset II subsets of the WHU Building Dataset. Among the evaluated baselines, SRB-Net achieved the best overall performance, reaching 98.83% accuracy and 90.12% Intersection over Union (IoU) on the aerial dataset and 98.28% accuracy and 70.89% IoU on Satellite Dataset II. These results show consistent performance improvements across the two evaluated WHU subsets while avoiding claims beyond the within-dataset experimental setting.
Downloads
References
[1] Ji, S., Wei, S., & Lu, M. (2019). Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery data set. IEEE Transactions on Geoscience and Remote Sensing, 57(1), 574-586. https://doi.org/10.1109/tgrs.2018.2858817
[2] Ji, S., Wei, S., & Lu, M. (2019). A scale robust convolutional neural network for automatic building extraction from aerial and satellite imagery. International Journal of Remote Sensing, 40(9), 3308-3322. https://doi.org/10.1080/01431161.2018.1528024
[3] Lin, J., Jing, W., Song, H., & Chen, G. (2019). ESFNet: Efficient network for building extraction from high-resolution aerial images. IEEE Access, 7, 54285-54294. https://doi.org/10.1109/access.2019.2912822
[4] Zhu, Q., Liao, C., Hu, H., Mei, X., & Li, H. (2021). MAP-net: Multiple attending path neural network for building footprint extraction from remote sensed imagery. IEEE Transactions on Geoscience and Remote Sensing, 59(7), 6169-6181. https://doi.org/10.1109/tgrs.2020.3026051
[5] Cai, J., & Chen, Y. (2021). MHA-net: Multipath hybrid attention network for building footprint extraction from high-resolution remote sensing imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 14, 5807-5817. https://doi.org/10.1109/jstars.2021.3084805
[6] Wu, G., Guo, Z., Shi, X., Chen, Q., Xu, Y., Shibasaki, R., & Shao, X. (2018). A boundary regulated network for accurate roof segmentation and outline extraction. Remote Sensing, 10(8), 1195. https://doi.org/10.3390/rs10081195
[7] Wu, G., Shao, X., Guo, Z., Chen, Q., Yuan, W., Shi, X., Xu, Y., & Shibasaki, R. (2018). Automatic building segmentation of aerial imagery using multi-constraint fully convolutional networks. Remote Sensing, 10(3), 407. https://doi.org/10.3390/rs10030407
[8] Wei, S., Ji, S., & Lu, M. (2020). Toward automatic building footprint delineation from aerial images using CNN and regularization. IEEE Transactions on Geoscience and Remote Sensing, 58(3), 2178-2189. https://doi.org/10.1109/tgrs.2019.2954461
[9] Kang, W., Xiang, Y., Wang, F., & You, H. (2019). EU-net: An efficient fully convolutional network for building extraction from optical remote sensing images. Remote Sensing, 11(23), 2813. https://doi.org/10.3390/rs11232813
[10] Deng, W., Shi, Q., & Li, J. (2021). Attention-gate-based encoder–decoder network for automatical building extraction. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 14, 2611-2620. https://doi.org/10.1109/jstars.2021.3058097
[11] Jing, H., Sun, X., Wang, Z., Chen, K., Diao, W., & Fu, K. (2021). Fine building segmentation in high-resolution SAR images via selective pyramid dilated network. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 14, 6608-6623. https://doi.org/10.1109/jstars.2021.3076085
[12] Zhou, D., Wang, G., He, G., Yin, R., Long, T., Zhang, Z., Chen, S., & Luo, B. (2021). A large-scale mapping scheme for urban building from gaofen-2 images using deep learning and hierarchical approach. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 14, 11530-11545. https://doi.org/10.1109/jstars.2021.3123398
[13] Li, X., Yao, X., & Fang, Y. (2018). Building-A-Nets: Robust building extraction from high-resolution remote sensing images with adversarial networks. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11(10), 3680-3687. https://doi.org/10.1109/jstars.2018.2865187
[14] Xia, L., Zhang, X., Zhang, J., Yang, H., & Chen, T. (2021). Building extraction from very-high-resolution remote sensing images using semi-supervised semantic edge detection. Remote Sensing, 13(11), 2187. https://doi.org/10.3390/rs13112187
[15] Chen, J., He, F., Zhang, Y., Sun, G., & Deng, M. (2020). SPMF-net: Weakly supervised building segmentation by combining superpixel pooling and multi-scale feature fusion. Remote Sensing, 12(6), 1049. https://doi.org/10.3390/rs12061049
[16] Liu, H., Luo, J., Huang, B., Hu, X., Sun, Y., Yang, Y., Xu, N., & Zhou, N. (2019). DE-net: Deep encoding network for building extraction from high-resolution remote sensing imagery. Remote Sensing, 11(20), 2380. https://doi.org/10.3390/rs11202380
[17] Chen, M., Wu, J., Liu, L., Zhao, W., Tian, F., Shen, Q., Zhao, B., & Du, R. (2021). DR-net: An improved network for building extraction from high resolution remote sensing image. Remote Sensing, 13(2), 294. https://doi.org/10.3390/rs13020294
[18] Guo, M., Liu, H., Xu, Y., & Huang, Y. (2020). Building extraction based on U-net with an attention block and multiple losses. Remote Sensing, 12(9), 1400. https://doi.org/10.3390/rs12091400
[19] Hou, X., Wang, P., & An, W. (2022). Multi-scale residual network for building extraction from satellite remote sensing images. In IGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium (pp. 1348-1351). IEEE. https://doi.org/10.1109/igarss46834.2022.9883509
[20] Wang, H., & Miao, F. (2022). Building extraction from remote sensing images using deep residual U-net. European Journal of Remote Sensing, 55(1), 71-85. https://doi.org/10.1080/22797254.2021.2018944
[21] Li, Z., Zhang, X., Xiao, P., & Zheng, Z. (2021). On the effectiveness of weakly supervised semantic segmentation for building extraction from high-resolution remote sensing imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 14, 3266-3281. https://doi.org/10.1109/jstars.2021.3063788
[22] Yuan, Y., Shi, X., & Gao, J. (2025). Building extraction from remote sensing images with deep learning: A survey on vision techniques. Computer Vision and Image Understanding, 251, 104253. https://doi.org/10.1016/j.cviu.2024.104253
[23] Li, Q., Mou, L., Sun, Y., Hua, Y., Shi, Y., & Zhu, X. X. (2024). A review of building extraction from remote sensing imagery: Geometrical structures and semantic attributes. IEEE Transactions on Geoscience and Remote Sensing, 62, 1-15. https://doi.org/10.1109/tgrs.2024.3369723
[24] Xu, B., Xu, J., Xue, N., & Xia, G. (2023). HiSup: Accurate polygonal mapping of buildings in satellite imagery with hierarchical supervision. ISPRS Journal of Photogrammetry and Remote Sensing, 198, 284-296. https://doi.org/10.1016/j.isprsjprs.2023.03.006
[25] Li, W., Zhao, W., Yu, J., Zheng, J., He, C., Fu, H., & Lin, D. (2023). Joint semantic–geometric learning for polygonal building segmentation from high-resolution remote sensing images. ISPRS Journal of Photogrammetry and Remote Sensing, 201, 26-37. https://doi.org/10.1016/j.isprsjprs.2023.05.010
[26] Li, Q., Mou, L., Hua, Y., Shi, Y., & Zhu, X. X. (2022). Building footprint generation through convolutional neural networks with attraction field representation. IEEE Transactions on Geoscience and Remote Sensing, 60, 1-17. https://doi.org/10.1109/tgrs.2021.3109844
[27] Zhang, L., Bai, M., Liao, R., Urtasun, R., Marcos, D., Tuia, D., & Kellenberger, B. (2018). Learning deep structured active contours end-to-end. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 8877-8885). IEEE. https://doi.org/10.1109/cvpr.2018.00925
[28] Girard, N., Smirnov, D., Solomon, J., & Tarabalka, Y. (2021). Polygonal building extraction by frame field learning. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 5887-5896). IEEE. https://doi.org/10.1109/cvpr46437.2021.00583
[29] Woo, S., Park, J., Lee, J., & Kweon, I. S. (2018). CBAM: Convolutional block attention module. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 3-19). Springer. https://doi.org/10.1007/978-3-030-01234-2_1
[30] Hou, Q., Zhang, L., Cheng, M., & Feng, J. (2020). Strip pooling: Rethinking spatial pooling for scene parsing. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 4002-4011). IEEE. https://doi.org/10.1109/cvpr42600.2020.00406
[31] Cheng, D., Liao, R., Fidler, S., & Urtasun, R. (2019). DARNet: Deep active ray network for building segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 7431-7439). IEEE.
[32] Chen, S., Shi, W., Zhou, M., Zhang, M., & Xuan, Z. (2022). CGSANet: A contour-guided and local structure-aware encoder–decoder network for accurate building extraction from very high-resolution remote sensing imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15, 1526-1542. https://doi.org/10.1109/jstars.2021.3139017
[33] Chen, J., Zhang, D., Wu, Y., Chen, Y., & Yan, X. (2022). A context feature enhancement network for building extraction from high-resolution remote sensing imagery. Remote Sensing, 14(9), 2276. https://doi.org/10.3390/rs14092276
[34] Fang, F., Zheng, D., Li, S., Liu, Y., Zeng, L., Zhang, J., & Wan, B. (2022). Improved pseudomasks generation for weakly supervised building extraction from high-resolution remote sensing imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15, 1629-1642. https://doi.org/10.1109/jstars.2022.3144176
[35] Borba, P., De Carvalho Diniz, F., Da Silva, N. C., & De Souza Bias, E. (2021). Building footprint extraction using deep learning semantic segmentation techniques: Experiments and results. In 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS (pp. 4708-4711). IEEE. https://doi.org/10.1109/igarss47720.2021.9553855
[36] Miao, Y., Jiang, S., Xu, Y., & Wang, D. (2022). Feature residual analysis network for building extraction from remote sensing images. Applied Sciences, 12(10), 5095. https://doi.org/10.3390/app12105095
[37] Ronneberger, O., Fischer, P., & Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI) (pp. 234-241). Springer. https://doi.org/10.1007/978-3-319-24574-4_28
[38] Yu, F., & Koltun, V. (2016). Multi-scale context aggregation by dilated convolutions. In International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1511.07122
[39] Hu, J., Shen, L., & Sun, G. (2018). Squeeze-and-excitation networks. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 7132-7141). IEEE. https://doi.org/10.1109/CVPR.2018.00745
[40] Park, J., Woo, S., Lee, J.-Y., & Kweon, I. S. (2018). BAM: Bottleneck attention module. In British Machine Vision Conference (BMVC). https://arxiv.org/abs/1807.06514
[41] Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017). SegNet: A deep convolutional encoder–decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), 2481-2495. https://doi.org/10.1109/TPAMI.2016.2644615
[42] Zhou, Z., Siddiquee, M. M. R., Tajbakhsh, N., & Liang, J. (2020). UNet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Transactions on Medical Imaging, 39(6), 1856-1867. https://doi.org/10.1109/TMI.2019.2959609
[43] Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018). Encoder–decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 801-818). Springer. https://doi.org/10.1007/978-3-030-01234-2_49
[44] Li, R., Zheng, S., Zhang, C., Duan, C., & Wang, L. (2022). A2-FPN for semantic segmentation of fine-resolution remotely sensed images. International Journal of Remote Sensing, 43(3), 1131-1155. https://doi.org/10.1080/01431161.2022.2030071
[45] Wang, L., Li, R., Zhang, C., Fang, S., Duan, C., Meng, X., & Atkinson, P. M. (2022). UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 190, 196-214. https://doi.org/10.1016/j.isprsjprs.2022.06.008
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Journal of Computing and Electronic Information Management
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
