Multi-label building functions classification from ground pictures using convolutional neural networks

S. Srivastava, John E. Vargas Muñoz, David Swinkels, D. Tuia

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

1 Citation (Scopus)

Abstract

We approach the problem of multi building function classification for buildings from the city of Amsterdam using a collection of Google Street View (GSV) pictures acquired at multiple zoom levels (field of views, FoV) and the corresponding governmental census data per building. Since buildings can have multiple usages, we cast the problem as multilabel classification task. To do so, we trained a CNN model end-to-end with the task of predicting multiple co-occurring building function classes per building. We fuse the individual features of three FoVs by using volumetric stacking. Our proposed model outperforms baseline CNN models that use either single or multiple FoVs.
LanguageEnglish
Title of host publicationProceedings of the 2nd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery
Place of PublicationNew York
PublisherACM
Pages43-46
ISBN (Print)9781450360364
DOIs
Publication statusPublished - 6 Nov 2018
Event2nd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery - Seattle, United States
Duration: 6 Nov 20186 Nov 2018
https://udi.ornl.gov/geoai

Conference

Conference2nd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery
Abbreviated titleGeoAI'18
CountryUnited States
CitySeattle
Period6/11/186/11/18
Internet address

Fingerprint

Labels
Neural networks
Electric fuses

Cite this

Srivastava, S., Vargas Muñoz, J. E., Swinkels, D., & Tuia, D. (2018). Multi-label building functions classification from ground pictures using convolutional neural networks. In Proceedings of the 2nd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery (pp. 43-46). New York: ACM. https://doi.org/10.1145/3281548.3281559
Srivastava, S. ; Vargas Muñoz, John E. ; Swinkels, David ; Tuia, D. / Multi-label building functions classification from ground pictures using convolutional neural networks. Proceedings of the 2nd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery. New York : ACM, 2018. pp. 43-46
@inproceedings{ff0605f6e6c1486fbea45b78aa65bde7,
title = "Multi-label building functions classification from ground pictures using convolutional neural networks",
abstract = "We approach the problem of multi building function classification for buildings from the city of Amsterdam using a collection of Google Street View (GSV) pictures acquired at multiple zoom levels (field of views, FoV) and the corresponding governmental census data per building. Since buildings can have multiple usages, we cast the problem as multilabel classification task. To do so, we trained a CNN model end-to-end with the task of predicting multiple co-occurring building function classes per building. We fuse the individual features of three FoVs by using volumetric stacking. Our proposed model outperforms baseline CNN models that use either single or multiple FoVs.",
author = "S. Srivastava and {Vargas Mu{\~n}oz}, {John E.} and David Swinkels and D. Tuia",
year = "2018",
month = "11",
day = "6",
doi = "10.1145/3281548.3281559",
language = "English",
isbn = "9781450360364",
pages = "43--46",
booktitle = "Proceedings of the 2nd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery",
publisher = "ACM",

}

Srivastava, S, Vargas Muñoz, JE, Swinkels, D & Tuia, D 2018, Multi-label building functions classification from ground pictures using convolutional neural networks. in Proceedings of the 2nd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery. ACM, New York, pp. 43-46, Seattle, United States, 6/11/18. https://doi.org/10.1145/3281548.3281559

Multi-label building functions classification from ground pictures using convolutional neural networks. / Srivastava, S.; Vargas Muñoz, John E.; Swinkels, David; Tuia, D.

Proceedings of the 2nd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery. New York : ACM, 2018. p. 43-46.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Multi-label building functions classification from ground pictures using convolutional neural networks

AU - Srivastava, S.

AU - Vargas Muñoz, John E.

AU - Swinkels, David

AU - Tuia, D.

PY - 2018/11/6

Y1 - 2018/11/6

N2 - We approach the problem of multi building function classification for buildings from the city of Amsterdam using a collection of Google Street View (GSV) pictures acquired at multiple zoom levels (field of views, FoV) and the corresponding governmental census data per building. Since buildings can have multiple usages, we cast the problem as multilabel classification task. To do so, we trained a CNN model end-to-end with the task of predicting multiple co-occurring building function classes per building. We fuse the individual features of three FoVs by using volumetric stacking. Our proposed model outperforms baseline CNN models that use either single or multiple FoVs.

AB - We approach the problem of multi building function classification for buildings from the city of Amsterdam using a collection of Google Street View (GSV) pictures acquired at multiple zoom levels (field of views, FoV) and the corresponding governmental census data per building. Since buildings can have multiple usages, we cast the problem as multilabel classification task. To do so, we trained a CNN model end-to-end with the task of predicting multiple co-occurring building function classes per building. We fuse the individual features of three FoVs by using volumetric stacking. Our proposed model outperforms baseline CNN models that use either single or multiple FoVs.

U2 - 10.1145/3281548.3281559

DO - 10.1145/3281548.3281559

M3 - Conference contribution

SN - 9781450360364

SP - 43

EP - 46

BT - Proceedings of the 2nd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery

PB - ACM

CY - New York

ER -

Srivastava S, Vargas Muñoz JE, Swinkels D, Tuia D. Multi-label building functions classification from ground pictures using convolutional neural networks. In Proceedings of the 2nd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery. New York: ACM. 2018. p. 43-46 https://doi.org/10.1145/3281548.3281559