I presented work by Neha Bhat on how to leverage object detection algorithms to build spatial mental models at the 2019 London Reasoning Workshop. The abstract is here:
We describe a novel computational system that processes images in order to dynamically construct and update iconic spatial simulations of the world — the equivalent of perceptual mental models. The system couples two existing technologies: an advanced machine-learning technique for real-time object-recognition (the YOLO algorithm) along with a computational model for representing and reasoning about spatial mental models (built in the mReasoner system). The system is capable of extracting qualitative spatial relations from perceptual inputs in real-time. We describe how it can be used to investigate dynamic spatial thinking and reasoning.