Multi-Body Non-Rigid Structure-from-Motion Conference Paper uri icon


  • In this paper, we present the first multi-body non-rigid structure-from-motion (SFM) method, which simultaneously reconstructs and segments multiple objects that are undergoing non-rigid deformation over time. Under our formulation, 3D trajectories for each non-rigid object can be well approximated with a sparse affine combination of other 3D trajectories from the same object. The resultant optimization is solved by the alternating direction method of multipliers (ADMM). We demonstrate the efficacy of the proposed method through extensive experiments on both synthetic and real data sequences. Our method outperforms other alternative methods, such as first clustering the 2D feature tracks to groups and then doing non-rigid reconstruction in each group or first conducting 3D reconstruction by using single subspace assumption and then clustering the 3D trajectories into groups.

name of conference

  • 2016 Fourth International Conference on 3D Vision (3DV)

published proceedings

  • 2016 Fourth International Conference on 3D Vision (3DV)

author list (cited authors)

  • Kumar, S., Dai, Y., & Li, H.

citation count

  • 32

complete list of authors

  • Kumar, Suryansh||Dai, Yuchao||Li, Hongdong

publication date

  • October 2016