Single-Image Based Interactively Progressive Modeling for 3D Architectures

Based on the input single architecture image, a novel 3D reconstruction approach for urban architecture is presented in this paper, which can create real-world buildings in an interactively progressive manner. Upon the sketching plane defined by the input image, the users firstly mark two main faces of the target architecture for image rectification. Due to the fact that the parallel lines under perspective projection always intersect at a vanishing point, the perspective distortions can be removed and the parallel relations among sketch lines can be restored by a special projection transformation. Then, the users interactively sketch the visible primary profiles of target object on the rectified image, and the system automatically identifies different kinds of parallel or vertical relations of the sketch lines. All of these relations and co-plane properties can be regarded as the geometric constrains for calculating the z-depths of sketch lines. Owing to the property of symmetry, the coarse model can thus be generated by completing the geometric structures of architecture scene. Furthermore, by incorporating the geometrical relations between urban details and the primary structure into the z-depth computation of architectural details, a real fine 3D architecture can finally be reconstructed by synthesizing the surface texture derived from visible texture information of the input image. Experimental results show that our proposed method can conveniently and effectively reconstruct 3D architecture model from single image with high visual quality.