AbstractsMathematics

In this dissertation, we propose new approaches to the surface registration problem by coupling continuous geometry-based methods and combinatorial graph-based methods. On the one hand, geometry-based methods explore the intrinsic properties of the surfaces to simplify the search of correspondences among surfaces undergoing very large deformations. However, these methods are usually based on certain ideal assumptions on the qualities of the input, such as noise-free or no occlusions. Hence they are usually sensitive to uncertainties from the input that are common in real-world data. On the other hand, graph-based methods are better at dealing with uncertainties due to their statistics nature. Nevertheless, without exploring the geometric properties of the surface, discrete graph-based methods usually suffer from discretization error and high computational complexity. Thus, by exploring the relation between the two approaches, we show that our new approaches deal with surface registration problems under very challenging situations. To this purpose, three distinct approaches are explored in this thesis that achieves dense surface registration in different scenarios. In the first approach, we cast the surface registration into a high-order graph matching problem, through the minimization of an energy function based on multiple measurements of geometric/appearance similarities and deformation priors. Our method takes advantage of conformal mapping based method which derives a closed-form solution to dense surface matching. To this end, we design an efficient way to select a finite number of matching candidates for each point of the source surface based on the a sparse set of correspondences, which naturally induces an efficient two-stage optimization approach for the dense surface registration problem. In the sparse matching stage, the high-order interactions among a sparse set of feature points on the surfaces are used to encode the isometric deformation error using conformal mapping. In the dense registration stage, the high-order interactions of a dense set of sampling points are considered to encode the isometric deformation error as well as orientation consistency. Meanwhile, we also propose the first solution to the high-order graph matching problem that solves partial matching. Our method is validated through a series of experiments demonstrating its accuracy and efficiency, notably in challenging cases of large and/or non-isometric deformations, or meshes that are partially occluded. In the second approach, we propose a graph-based formulation for tracking surfaces in a sequence. In order to deal with noises in the input, we propose a robust metric for the cost of matching arbitrary correspondences, which is defined as the lowest feature differences across this set of matchings that cause the particular correspondence to match. We show that for surface tracking applications, the matching cost can be efficiently computed in the conformal mapping domain. Such a matching cost is then integrated into a complete…