Virtual Reality & Intelligent Hardware (Jun 2023)

A Spatiotemporal Intelligent Framework and Experimental Platform for Urban Digital Twins

  • Jinxing Hu,
  • Zhihan Lv,
  • Diping Yuan,
  • Bing He,
  • Wenjiang Chen,
  • Xiongfei Ye,
  • Donghao Li,
  • Ge Yang

Journal volume & issue
Vol. 5, no. 3
pp. 213 – 231

Abstract

Read online

This work emphasizes the current research status of the urban Digital Twins to establish an intelligent spatiotemporal framework. A Geospatial Artificial Intelligent (GeoAI) system is developed based on the Geographic Information System and Artificial Intelligence. It integrates multi-video technology and Virtual City in urban Digital Twins. Besides, an improved small object detection model is proposed: YOLOv5-Pyramid, and Siamese network video tracking models, namely MPSiam and FSSiamese, are established. Finally, an experimental platform is built to verify the georeferencing correction scheme of video images. The experimental results show that the Multiply-Accumulate value of MPSiam is 0.5B, and that of ResNet50-Siam is 4.5B. Besides, the model is compressed by 4.8 times. The inference speed has increased by 3.3 times, reaching 83 Frames Per Second. 3% of the Average Expectation Overlap is lost. Therefore, the urban Digital Twins-oriented GeoAI framework established here has excellent performance for video georeferencing and target detection problems.

Keywords