• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Zhou, Wen (Zhou, Wen.) [1] | Persello, Claudio (Persello, Claudio.) [2] | Li, Mengmeng (Li, Mengmeng.) [3] (Scholars:李蒙蒙) | Stein, Alfred (Stein, Alfred.) [4]

Indexed by:

EI Scopus SCIE

Abstract:

Assigning detailed use categories to buildings is a challenging and relevant task in urban land use classification with applications in urban planning, digital city modelling and twinning. This study aims to provide the categorisation of buildings with detailed use information by considering the possibilities of mixed-use. Mixed-use combines different use forms, and serves as a new type of use category. We obtain attributive information by combining satellite imagery that reflects spatial information and textual information from publicly available point-of-interest data collected by citizens and available on online maps. We propose a multimodal transformerbased building-use classification method to capture and fuse these different data sources within an end-to-end learning workflow. We evaluate the effectiveness of our proposed method on four urban areas in China. Experiments show that the proposed method effectively maps building use according to eight types of fine-grain categories, with a Micro F-1 score equal to 80.9%, and a Macro F-1 score equal to 62% for Wuhan research area. The proposed method is able to harness the relationship between the features obtained from the different data sources and results in higher accuracy than the state-of-the-art fusion-based multimodal integration methods. The proposed method can effectively increase the attributive grain of building use resulting in high classification accuracy.

Keyword:

Building use classification Data fusion Mixed-use classification Multimodal deep learning Natural language processing Remote sensing Transformers

Community:

  • [ 1 ] [Zhou, Wen]Univ Twente, Fac Geoinformat Sci & Earth Observat ITC, Dept Earth Observat Sci, NL-7500 AE Enschede, Netherlands
  • [ 2 ] [Persello, Claudio]Univ Twente, Fac Geoinformat Sci & Earth Observat ITC, Dept Earth Observat Sci, NL-7500 AE Enschede, Netherlands
  • [ 3 ] [Stein, Alfred]Univ Twente, Fac Geoinformat Sci & Earth Observat ITC, Dept Earth Observat Sci, NL-7500 AE Enschede, Netherlands
  • [ 4 ] [Li, Mengmeng]Fuzhou Univ, Minist Educ, Key Lab Spatial Data Min & Informat Sharing, Acad Digital China Fujian, Fuzhou, Peoples R China

Reprint 's Address:

Show more details

Related Keywords:

Source :

REMOTE SENSING OF ENVIRONMENT

ISSN: 0034-4257

Year: 2023

Volume: 297

1 1 . 1

JCR@2023

1 1 . 1 0 0

JCR@2023

JCR Journal Grade:1

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 7

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:180/10008947
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1