American Institute of Mathematical Sciences

Advanced
December  2019, 6(2): 251-276. doi: 10.3934/jcd.2019013

Principal symmetric space analysis

Charles Curry 1, , Stephen Marsland 2, and  Robert I McLachlan 3,

1. 

Department of Mathematical Sciences, NTNU, Gjøvik, Norway
2. 

School of Mathematics and Statistics, Victoria University of Wellington, Wellington, New Zealand
3. 

School of Fundamental Sciences, Massey University, Palmerston North, New Zealand

Received  April 2019 Revised  October 2019 Published  November 2019

Principal Geodesic Analysis is a statistical technique that constructs low-dimensional approximations to data on Riemannian manifolds. It provides a generalization of principal components analysis to non-Euclidean spaces. The approximating submanifolds are geodesic at a reference point such as the intrinsic mean of the data. However, they are local methods as the approximation depends on the reference point and does not take into account the curvature of the manifold. Therefore, in this paper we develop a specialization of principal geodesic analysis, Principal Symmetric Space Analysis, based on nested sequences of totally geodesic submanifolds of symmetric spaces. The examples of spheres, Grassmannians, tori, and products of two-dimensional spheres are worked out in detail. The approximating submanifolds are geometrically the simplest possible, with zero exterior curvature at all points. They can deal with significant curvature and diverse topology. We show that in many cases the distance between a point and the submanifold can be computed analytically and there is a related metric that reduces the computation of principal symmetric space approximations to linear algebra.

Keywords: PCA, PGA, totally geodesic submanifolds, subtori, symmetric spaces.
Mathematics Subject Classification: Primary: 62H25, 53C35, 53C42.
Citation: Charles Curry, Stephen Marsland, Robert I McLachlan. Principal symmetric space analysis. Journal of Computational Dynamics, 2019, 6 (2) : 251-276. doi: 10.3934/jcd.2019013
References:
[1]

J. Berndt and C. Olmos, Maximal totally geodesic submanifolds and index of symmetric spaces, J. Differential Geom., 104 (2016), 187-217.  doi: 10.4310/jdg/1476367055.

[2]

B. Y. Chen and T. Nagano, Totally geodesic submanifolds of symmetric spaces, Ⅱ, Duke Math J., 45 (1978), 405-425.  doi: 10.1215/S0012-7094-78-04521-0.

[3]

J. H. Conway, R. H. Hardin and N. J. Sloane, Packing lines, planes, etc.: Packings in Grassmannian spaces, Experiment. Math., 5 (1996), 139-159.  doi: 10.1080/10586458.1996.10504585.

[4]

J. Damon and J. S. Marron, Backwards principal component analysis and principal nested relations, J. Math. Imaging Vision, 50 (2014), 107-114.  doi: 10.1007/s10851-013-0463-2.

[5]

B. Eltzner, S. Jung and S. Huckermann, Dimension reduction on polyspheres with application to skeletal representations, in Geometric Science of Information, Lecture Notes in Comput. Sci., 9389, Springer, Cham, 2015, 22–29. doi: 10.1007/978-3-319-25040-3_3.

[6]

P. T. Fletcher, C. Lu, S. M. Pizer and S. C. Joshi, Principal geodesic analysis for the study of nonlinear statistics of shape, IEEE Transactions on Medical Imaging, 23 (2004), 995-1005.  doi: 10.1109/TMI.2004.831793.

[7]

P. T. Fletcher and S. C. Joshi, Principal geodesic analysis on symmetric spaces: Statistics of diffusion tensors, in Computer Vision and Mathematical Methods in Medical and Biomedical Image Analysis, LNCS, 3117, Springer, Berlin, 2004, 87–98.

[8]

T. Fletcher, Geodesic regression on Riemannian manifolds, in Proceedings of the Third International Workshop on Mathematical Foundations of Computational Anatomy-Geometrical and Statistical Methods for Modelling Biological Shape Variability, 2001, 75–86.

[9]

C. G. Gebhardt, M. C. Steinbach and R. Rolfes, Understanding the nonlinear dynamics of beam structures: A principal geodesic analysis approach, Thin-Walled Structures, 140 (2019), 357-372.  doi: 10.1016/j.tws.2019.03.009.

[10]

G. H. Golub and C. F. Van Loan, Matrix Computations, Johns Hopkins Series in the Mathematical Sciences, 3, Johns Hopkins University Press, Baltimore, MD, 1989.

[11]

S. Huckemann, T. Hotz and A. Munk, Intrinsic shape analysis: Geodesic PCA for Riemannian manifolds modulo isometric Lie group actions, Statist. Sinica, 20 (2010), 1-58. 

[12]

I. Jolliffe, Principal Component Analysis, Springer Series in Statistics, Springer-Verlag, New York, 1986. doi: 10.1007/978-1-4757-1904-8.

[13]

S. Jung, I. L. Dryden and J. S. Marron, Analysis of principal nested spheres, Biometrika, 99 (2012), 551-568.  doi: 10.1093/biomet/ass022.

[14]

K. Kenobi, I. L. Dryden and H. Le, Shape curves and geodesic modelling, Biometrika, 97 (2010), 567-584.  doi: 10.1093/biomet/asq027.

[15]

S. Klein, Totally geodesic submanifolds in Riemannian symmetric spaces, in Differential Geometry, World Sci. Publ., Hackensack, NJ, 2009, 136–145. doi: 10.1142/9789814261173_0013.

[16]

S. Kobayashi and K. Nomizu, Foundations of Differential Geometry, John Wiley & Sons, Inc., New York, 1996.

[17]

J. Lawrence, Enumeration in torus arrangements, European J. Combin., 32 (2011), 870-881.  doi: 10.1016/j.ejc.2011.02.003.

[18]

A. K. Lenstra, H. W. Lenstra Jr. and L. Lovász, Factoring polynomials with rational coefficients, Math. Ann., 261 (1982), 515-534.  doi: 10.1007/BF01457454.

[19]

X. Pennec, Barycentric subspace analysis on manifolds, Ann. Statist., 46 (2018), 2711-2746.  doi: 10.1214/17-AOS1636.

[20]

Q. Rentmeesters, A gradient method for geodesic data fitting on some symmetric Riemannian manifolds, in 2011 50$^{th}$ IEEE Conference on Decision and Control and European Control Conference, 2011, 7141–7146. doi: 10.1109/CDC.2011.6161280.

[21]

H. J. S. Smith, On systems of linear indeterminate equations and congruences, Phil. Trans. Roy. Soc. London, 151 (1861), 293-326. 

[22]

S. Sommer, F. Lauze and M. Nielsen, Optimization over geodesics for exact principal geodesic analysis, Adv. Comput. Math., 40 (2014), 283-313.  doi: 10.1007/s10444-013-9308-1.

[23]

W. Utschick, Tracking of signal subspace projectors, IEEE Trans. Signal Process., 50 (2002), 769-778.  doi: 10.1109/78.992119.

[24]

J. A. Wolf, Elliptic spaces in Grassmann manifolds, Illinois J. Math., 7 (1963), 447-462.  doi: 10.1215/ijm/1255644952.

[25]

D. Wubben, D. Seethaler, J. Jalden and G. Matz, Lattice reduction, IEEE Signal Processing Magazine, 28 (2011), 70-91.  doi: 10.1109/MSP.2010.938758.

show all references

References:
[1]

J. Berndt and C. Olmos, Maximal totally geodesic submanifolds and index of symmetric spaces, J. Differential Geom., 104 (2016), 187-217.  doi: 10.4310/jdg/1476367055.

[2]

B. Y. Chen and T. Nagano, Totally geodesic submanifolds of symmetric spaces, Ⅱ, Duke Math J., 45 (1978), 405-425.  doi: 10.1215/S0012-7094-78-04521-0.

[3]

J. H. Conway, R. H. Hardin and N. J. Sloane, Packing lines, planes, etc.: Packings in Grassmannian spaces, Experiment. Math., 5 (1996), 139-159.  doi: 10.1080/10586458.1996.10504585.

[4]

J. Damon and J. S. Marron, Backwards principal component analysis and principal nested relations, J. Math. Imaging Vision, 50 (2014), 107-114.  doi: 10.1007/s10851-013-0463-2.

[5]

B. Eltzner, S. Jung and S. Huckermann, Dimension reduction on polyspheres with application to skeletal representations, in Geometric Science of Information, Lecture Notes in Comput. Sci., 9389, Springer, Cham, 2015, 22–29. doi: 10.1007/978-3-319-25040-3_3.

[6]

P. T. Fletcher, C. Lu, S. M. Pizer and S. C. Joshi, Principal geodesic analysis for the study of nonlinear statistics of shape, IEEE Transactions on Medical Imaging, 23 (2004), 995-1005.  doi: 10.1109/TMI.2004.831793.

[7]

P. T. Fletcher and S. C. Joshi, Principal geodesic analysis on symmetric spaces: Statistics of diffusion tensors, in Computer Vision and Mathematical Methods in Medical and Biomedical Image Analysis, LNCS, 3117, Springer, Berlin, 2004, 87–98.

[8]

T. Fletcher, Geodesic regression on Riemannian manifolds, in Proceedings of the Third International Workshop on Mathematical Foundations of Computational Anatomy-Geometrical and Statistical Methods for Modelling Biological Shape Variability, 2001, 75–86.

[9]

C. G. Gebhardt, M. C. Steinbach and R. Rolfes, Understanding the nonlinear dynamics of beam structures: A principal geodesic analysis approach, Thin-Walled Structures, 140 (2019), 357-372.  doi: 10.1016/j.tws.2019.03.009.

[10]

G. H. Golub and C. F. Van Loan, Matrix Computations, Johns Hopkins Series in the Mathematical Sciences, 3, Johns Hopkins University Press, Baltimore, MD, 1989.

[11]

S. Huckemann, T. Hotz and A. Munk, Intrinsic shape analysis: Geodesic PCA for Riemannian manifolds modulo isometric Lie group actions, Statist. Sinica, 20 (2010), 1-58. 

[12]

I. Jolliffe, Principal Component Analysis, Springer Series in Statistics, Springer-Verlag, New York, 1986. doi: 10.1007/978-1-4757-1904-8.

[13]

S. Jung, I. L. Dryden and J. S. Marron, Analysis of principal nested spheres, Biometrika, 99 (2012), 551-568.  doi: 10.1093/biomet/ass022.

[14]

K. Kenobi, I. L. Dryden and H. Le, Shape curves and geodesic modelling, Biometrika, 97 (2010), 567-584.  doi: 10.1093/biomet/asq027.

[15]

S. Klein, Totally geodesic submanifolds in Riemannian symmetric spaces, in Differential Geometry, World Sci. Publ., Hackensack, NJ, 2009, 136–145. doi: 10.1142/9789814261173_0013.

[16]

S. Kobayashi and K. Nomizu, Foundations of Differential Geometry, John Wiley & Sons, Inc., New York, 1996.

[17]

J. Lawrence, Enumeration in torus arrangements, European J. Combin., 32 (2011), 870-881.  doi: 10.1016/j.ejc.2011.02.003.

[18]

A. K. Lenstra, H. W. Lenstra Jr. and L. Lovász, Factoring polynomials with rational coefficients, Math. Ann., 261 (1982), 515-534.  doi: 10.1007/BF01457454.

[19]

X. Pennec, Barycentric subspace analysis on manifolds, Ann. Statist., 46 (2018), 2711-2746.  doi: 10.1214/17-AOS1636.

[20]

Q. Rentmeesters, A gradient method for geodesic data fitting on some symmetric Riemannian manifolds, in 2011 50$^{th}$ IEEE Conference on Decision and Control and European Control Conference, 2011, 7141–7146. doi: 10.1109/CDC.2011.6161280.

[21]

H. J. S. Smith, On systems of linear indeterminate equations and congruences, Phil. Trans. Roy. Soc. London, 151 (1861), 293-326. 

[22]

S. Sommer, F. Lauze and M. Nielsen, Optimization over geodesics for exact principal geodesic analysis, Adv. Comput. Math., 40 (2014), 283-313.  doi: 10.1007/s10444-013-9308-1.

[23]

W. Utschick, Tracking of signal subspace projectors, IEEE Trans. Signal Process., 50 (2002), 769-778.  doi: 10.1109/78.992119.

[24]

J. A. Wolf, Elliptic spaces in Grassmann manifolds, Illinois J. Math., 7 (1963), 447-462.  doi: 10.1215/ijm/1255644952.

[25]

D. Wubben, D. Seethaler, J. Jalden and G. Matz, Lattice reduction, IEEE Signal Processing Magazine, 28 (2011), 70-91.  doi: 10.1109/MSP.2010.938758.

Figure 1.  In linearized Principal Geodesic Analysis, the data (here 20 points on a sphere) is pulled back to the tangent space (shown here as a disk) of the intrinsic mean using geodesics. Data points near the mean are well represented, but data points far from the mean (here, near the south pole) become far apart in the linear approximation
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2.  Twenty data points on $ S^2 $ (dark blue) together with the point (pink) and the great circle (blue) that best approximate the data in the Riemannian metric, computed using nonlinear optimization. The best point (the intrinsic mean of the data) does not lie on the best great circle
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3.  Results for datasets 1–3 of Example 2. In each case, the best subspheres that approximate a set of 20 points on $ S^3 $ is shown. Data points further from the best $ S^2 $ are shown smaller. The best $ S^1 $ is shown in blue, lying on the best $ S^2 $ in teal. In datasets 2 and 3, the axis of the best $ S^0 $ (which consists of two antipodal points) is shown in black. In dataset 3, this also coincides with a standard mean of the data
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 4.  The geodesic in $ \mathbb{T} ^3 $ through the origin in direction $ d = [1, 2, 3]^\mathsf{T} $, seen from two different viewpoints. Viewing in direction $ d $ (right) shows the lattice formed in $ \mathbb{R}^3 $ by the intersection of the lifted geodesic with an orthogonal plane
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 6.  Fitting data on a torus (see Example 4). The best 1-torus and 2-torus approximating 50 data points on $ \mathbb{T} ^3 $, are shown from two different viewing directions. The subtori have been chosen from those with fixed resonance relations, i.e., only their translations fitted
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5.  Fitting data on a torus. Here the closed geodesic of best fit is computed to a set of 50 data points on $ S^1\times S^1 $. The data set is synthetic and has been chosen to lie near the geodesic with resonance relation $ 2 x_1 + 5 x_2 = $ const.; each data point has normal random noise of standard deviation $ 0.1/(2\pi) $ in each angle
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 7.  Fitting data on a polysphere (see Example 6). The rotations of points $ x_i $ are plotted as cubes, whilst the points $ y_i $ are plotted as circles; a different colour is chosen for each $ i $. The great circle shows the best subspace $ S^1\subset S^2\subset S^2\times S^2 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 8.  Fitting data on a polysphere (see Example 6). The best approximating torus $ S^1\times S^1\subset S^2\times S^2 $ is shown with two great circles inside the two spheres. Due to the difficulty of plotting the nested approximation $ S^1\subset S^2\times S^2 $ we have plotted (right) the projection of the points in $ S^2\times S^2 $ to the approximating torus $ S^1\times S^1 $ and shown the best approximating $ S^1 $ as a subset of this
Figure Options

Download full-size image

Download as PowerPoint slide

[1]

Sergei Ivanov. On Helly's theorem in geodesic spaces. Electronic Research Announcements, 2014, 21: 109-112. doi: 10.3934/era.2014.21.109
[2]

Feng Luo. Geodesic length functions and Teichmuller spaces. Electronic Research Announcements, 1996, 2: 34-41.

[3]

Jeffrey Boland. On rigidity properties of contact time changes of locally symmetric geodesic flows. Discrete and Continuous Dynamical Systems, 2000, 6 (3) : 645-650. doi: 10.3934/dcds.2000.6.645
[4]

Venkateswaran P. Krishnan, Plamen Stefanov. A support theorem for the geodesic ray transform of symmetric tensor fields. Inverse Problems and Imaging, 2009, 3 (3) : 453-464. doi: 10.3934/ipi.2009.3.453
[5]

Pablo D. Carrasco, Túlio Vales. A symmetric Random Walk defined by the time-one map of a geodesic flow. Discrete and Continuous Dynamical Systems, 2021, 41 (6) : 2891-2905. doi: 10.3934/dcds.2020390
[6]

Krzysztof A. Krakowski, Luís Machado, Fátima Silva Leite. A unifying approach for rolling symmetric spaces. Journal of Geometric Mechanics, 2021, 13 (1) : 145-166. doi: 10.3934/jgm.2020016
[7]

Qing Liu, Atsushi Nakayasu. Convexity preserving properties for Hamilton-Jacobi equations in geodesic spaces. Discrete and Continuous Dynamical Systems, 2019, 39 (1) : 157-183. doi: 10.3934/dcds.2019007
[8]

Bryce Weaver. Growth rate of periodic orbits for geodesic flows over surfaces with radially symmetric focusing caps. Journal of Modern Dynamics, 2014, 8 (2) : 139-176. doi: 10.3934/jmd.2014.8.139
[9]

Muhammad Hamid, Wei Wang. A symmetric property in the enhanced common index jump theorem with applications to the closed geodesic problem. Discrete and Continuous Dynamical Systems, 2022, 42 (4) : 1933-1948. doi: 10.3934/dcds.2021178
[10]

Johannes Hertrich, Dang-Phuong-Lan Nguyen, Jean-Francois Aujol, Dominique Bernard, Yannick Berthoumieu, Abdellatif Saadaldin, Gabriele Steidl. PCA reduced Gaussian mixture models with applications in superresolution. Inverse Problems and Imaging, 2022, 16 (2) : 341-366. doi: 10.3934/ipi.2021053
[11]

Misha Bialy. On Totally integrable magnetic billiards on constant curvature surface. Electronic Research Announcements, 2012, 19: 112-119. doi: 10.3934/era.2012.19.112
[12]

Vladimír Špitalský. Entropy and exact Devaney chaos on totally regular continua. Discrete and Continuous Dynamical Systems, 2013, 33 (7) : 3135-3152. doi: 10.3934/dcds.2013.33.3135
[13]

Vladimir V. Chepyzhov, Monica Conti, Vittorino Pata. Totally dissipative dynamical processes and their uniform global attractors. Communications on Pure and Applied Analysis, 2014, 13 (5) : 1989-2004. doi: 10.3934/cpaa.2014.13.1989
[14]

Jean-Michel Rakotoson. Generalized eigenvalue problem for totally discontinuous operators. Discrete and Continuous Dynamical Systems, 2010, 28 (1) : 343-373. doi: 10.3934/dcds.2010.28.343
[15]

Mao Okada. Local rigidity of certain actions of solvable groups on the boundaries of rank-one symmetric spaces. Journal of Modern Dynamics, 2021, 17: 111-143. doi: 10.3934/jmd.2021004
[16]

Venkateswaran P. Krishnan, Vladimir A. Sharafutdinov. Ray transform on Sobolev spaces of symmetric tensor fields, I: Higher order Reshetnyak formulas. Inverse Problems and Imaging, 2022, 16 (4) : 787-826. doi: 10.3934/ipi.2021076
[17]

Marie-Claude Arnaud. When are the invariant submanifolds of symplectic dynamics Lagrangian?. Discrete and Continuous Dynamical Systems, 2014, 34 (5) : 1811-1827. doi: 10.3934/dcds.2014.34.1811
[18]

Gennadi Sardanashvily. Lagrangian dynamics of submanifolds. Relativistic mechanics. Journal of Geometric Mechanics, 2012, 4 (1) : 99-110. doi: 10.3934/jgm.2012.4.99
[19]

Ely Kerman. Displacement energy of coisotropic submanifolds and Hofer's geometry. Journal of Modern Dynamics, 2008, 2 (3) : 471-497. doi: 10.3934/jmd.2008.2.471
[20]

Anton Schiela, Julian Ortiz. Second order directional shape derivatives of integrals on submanifolds. Mathematical Control and Related Fields, 2021, 11 (3) : 653-679. doi: 10.3934/mcrf.2021017

 Impact Factor: 

Tools

Metrics

  • PDF downloads (359)
  • HTML views (362)
  • Cited by (1)

Other articles
by authors

[Back to Top]

Copyright © 2022 American Institute of Mathematical Sciences | Privacy Policy