Efficient and Robust Large-Scale Structure-from-Motion via Track Selection and Camera Prioritization

Abstract

Incremental Structure-from-Motion (SfM) techniques have exhibited superior practicability in many recent studies; however, efficiency and robustness remain key challenges for these techniques. In this work, we propose a new incremental SfM method that overcomes these problems in a united framework that contains two iteration loops. The inner loop is a track selection loop, where a well-conditioned subset of the feature tracks is iteratively selected to accelerate the time-consuming bundle adjustment. The outer loop is a camera registration loop, where the a priori camera rotations are estimated via rotation averaging on multiple orthogonal maximum spanning trees (OMSTs) of the view-graph and used as weak supervision for the registration. The calibrated camera poses that agree with the a priori camera rotations are preferentially registered, and after all the consistent cameras have been calibrated, the remaining cameras are incrementally registered. The results of extensive experiments demonstrate that our system can reconstruct both general and ambiguous image datasets, and our system outperforms many state-of-the-art SfM systems in terms of efficiency and robustness.