A machine learning-based method for the large-scale evaluation of the qualities of the urban environment

• Published in: Computers, environment and urban systems Vol. 65; pp. 113 - 125
• Main Authors: Liu, Lun, Silva, Elisabete A., Wu, Chunyang, Wang, Hui
• Format: Journal Article
• Language: English
• Published: Oxford Elsevier Ltd 01.09.2017; Elsevier Science Ltd
• Subjects: Architecture; Artificial intelligence; Cities; Computer vision; Machine learning; Physical quality; Planners; Residents; Street view image; Urban areas; Urban design; Urban planning; Urban regeneration; Street view image; Physical quality; Architecture; Urban design; Machine learning
• ISSN: 0198-9715; 1873-7587
• DOI: 10.1016/j.compenvurbsys.2017.06.003

Given the present size of modern cities, it is beyond the perceptual capacity of most people to develop a good knowledge about the qualities of the urban space at every street corner. Correspondingly, for planners, it is also difficult to accurately answer questions such as ‘where the quality of the physical environment is the most dilapidated in the city that regeneration should be given first consideration’ and ‘in fast urbanising cities, how is the city appearance changing’. To address this issue, in the present study, we present a computer vision method that contains three machine learning models for the large-scale and automatic evaluation on the qualities of the urban environment by leveraging state-of-the-art machine learning techniques and wide-coverage street view images. From various physical qualities that have been identified by previous research to be important for the urban visual experience, we choose two key qualities, the construction and maintenance quality of building facade and the continuity of street wall, to be measured in this research. To test the validity of the proposed method, we compare the machine scores with public rating scores collected on-site from 752 passers-by at 56 locations in the city. We show that the machine learning models can produce a medium-to-good estimation of people's real experience, and the modelling results can be applied in many ways by researchers, planners and local residents. •Machine learning models on the construction and maintenance quality of building facade and the continuity of street wall based on street images.•Deep convolutional features outperform conventional SIFT features on our tasks.•The evaluation made by the computer models is moderately to highly correlated with the public opinions, which we collected from a field survey.•Beijing urban physical quality evaluation maps are produced.