This dataset includes data and codes underlying the PhD thesis of Wen Zhou: Deep Learning Methods for Multiple Building Use and Urban Livability Evaluation from Multimodal Geospatial Data. This data set contains four research works. Research one is building use and mixed use classification. Research two is hierarchical building use classification considering mixed-use. Research three is impact of building spatial and functional information on Urban Livability. Research four is Urban livability evaluation based upon multimodal deep learning.