The (M, N)-symmetric Procrustes problem

https://doi.org/10.1016/j.amc.2007.08.094Get rights and content

Abstract

An p×q matrix A is said to be (M,N)-symmetric if MAN=(MAN)T for given MRn×p,NRq×n. In this paper, the following (M,N)-symmetric Procrustes problem is studied. Find the (M,N)-symmetric matrix A which minimizes the Frobenius norm of AX-B, where X and B are given rectangular matrices. We use Project Theorem, the singular-value decomposition and the generalized singular-value decomposition of matrices to analysis the problem and to derive a stable method for its solution. The related optimal approximation problem to a given matrix on the solution set is solved. Furthermore, the algorithm to compute the optimal approximate solution and the numerical experiment are given.

Introduction

Let Rn denote the set of n-dimensional real vectors, and Rn×n,SRn×n,ASRn×n,ORn×n denote the set of real n×n matrices, real n×n symmetric matrices, real n×n antisymmetric matrices and orthogonal n×n matrices, respectively. The notation A+,A stands for the Moore-Penrose inverse and the Frobenius norm of a matrix A, respectively. For A=(aij)Rn×m and B=(bij)Rn×m, define AB=(aijbij)Rn×m as Hadamard product of matrices A and B.

Definition 1

Given MRn×p,NRq×n, we say that ARp×q is (M,N)-symmetric ifMAN=(MAN)T.We denote by SRp×q(M,N) the set of all (M,N)-symmetric matrix.

In this paper, we consider the following problems:

Problem I

Given MRn×p,NRq×n,XRq×k,BRp×k, find ASRp×q(M,N) such thatAX-B=min.

Problem II

Given ARp×q, find A^SE such thatA^-A=minASEA-A,

where SE is the solution set of Problem I.

In electricity, control theory and processing of digital signals, we often need to study the Procrustes problem of the well-known equation AX=B with the unknown matrix A. The problem with A being symmetric, bisymmetric, centrosymmetric and positive semidefinite symmetric were studied (see [1], [2], [3], [4], [5], [6], [7], [8]). Taking for A the set of orthogonal matrices yields the orthogonal Procrustes problem (see [9]), the set of symmetric matrices yiedls the symmetric Procrustes problem (see [10]). By analogy with the problem mentioned above, we will refer to Problem I as the (M,N)-symmetric Procrustes problem. Usually, by applying the structure properties of unknown matrix A and appropriate matrix decompositions (the singular-value decomposition, the generalized singular-value decomposition, etc.), the solution of the Procrustes problem were given. But this approach can not be used to solve Problem I. In this paper, we initiate an efficient method: Firstly, by the structure property of A and a set of orthonormal basis of a subspace, we find out a solution A0 of Problem I. Secondly, using the solution A0 and the Project Theorem, we transfer Problem I to the problem of finding the (M,N)-symmetric solution of a consistent matrix equation AX=A0X. Finally, we find out the (M,N)-symmetric solution of the consistent matrix equation.

Problem II, that is, the optimal approximation problem of a matrix with the given matrix restriction, is proposed in the processes of test or recovery of linear systems due to incomplete data or revising given data. A preliminary estimate A of the unknown matrix A can be obtained by the experimental observation values and the information of statical distribution. The optimal estimate of A is a matrix A^ satisfying the given matrix restriction for A and being the best approximation of A. Various aspects of the optimal approximation problem associated with AX=B were considered, see [1], [2] and reference therein.

The paper is organized as follows. In Section 2, we will discuss the structure properties of matrices in SRp×q(M,N), and provide the general expression of the solutions of Problem I. In Section 3, we will prove the existence and uniqueness of the solution of Problem II and derive the expression of this unique solution. In Section 4, we will give the algorithm to compute the approximate solution and the numerical experiment.

Section snippets

The general form of solutions of Problem I

For convenience, here we give the singular-value decomposition (SVD) of a matrix X, and the generalized singular-value decomposition (GSVD) of a matrix pair [MT,N]. Proofs and properties concerning the SVD and GSVD can be found in [11], [12], [13].

Given a matrix XRq×k of rank r, its SVD isX=UΣ000VT=U1ΣV1T,where

ORq×q,
ORk×k, Σ=diag(σ1,σ2,,σr)>0.

Given two matrices MRn×p,NRq×n, the GSVD of the matrix pair [MT,N] isMT=UΣ1WT,N=VΣ2WT,where W is a nonsingular n×n matrix, UORp×p,VORq×q,

The expression of solution of Problem II

The solution set of Problem I is a closed convex set. Therefore, there exists a unique solution for Problem II.

Lemma 8

Given LRn×n, Λ1=diag(a1,a2,,an)>0, Λ2=diag(b1,b2,,bn)>0, there exists a unique matrix K^SRn×n such thatF(K)=Λ1KΛ2-L2=min,and K^ can be expressed asK^=Φ(Λ1LΛ2+Λ2LTΛ1),where Φ=(φij)SRn×n,φij=1ai2bj2+aj2bi2.

Proof

For K=(kij)SRn×n,L=(lij)Rn×n, we haveF(K)=i=j=1n(aibikii-lii)2+1i<jn[(aibjkij-lij)2+(ajbikij-lji)2].In Eq. (21), F(K) is a continuously differentiable function of 12n(n-1)

Numerical computation of the solution of Problem II

Now we give the procedure to compute the optimal approximate solution A^ of Problem II and a experiment example.

Algorithm

  • Step 1.

    Input M,N,X,B and A;

  • Step 2.

    Make the GSVD of the matrix pair [MT,N] according to (2);

  • Step 3.

    Calculate A0 according to (6), calculate B0=A0X;

  • Step 4.

    Make the SVD of the matrix X according to (1), make the GSVD of the matrix pair MT,U2TN according to (9);

  • Step 5.

    Partition the matrix H-1[NT(B0X+)TMT-MB0X+N]H-T according to (12), partition PT(A-B0X+)U2Q according to (23);

  • Step 6.

    According to (24) calculate A^.

Example

GivenM=-0.4326-

Acknowledgements

Research supported by National Natural Science Foundation of China (10571047), by Specialized Research Fund for the Doctoral Program of Higher Education (20060532014) and by the College Fund of College of Applied Sciences, Beijing University of Technology.

References (15)

There are more references available in the full text version of this article.

Cited by (4)

  • Procrustes: A python library to find transformations that maximize the similarity between matrices

    2022, Computer Physics Communications
    Citation Excerpt :

    Motivated by the scientific significance of Procrustes problem and the absence of a dedicated package, we designed the Procrustes library: a flexible, easy-to-use, and easy-to-extend Python library for finding the optimal transformation that makes two matrices as close as possible to each other. As summarized in Table 1, the Procrustes library includes algorithms for orthogonal [9], rotational [9–11], symmetric [12–14], and permutation [17,16] Procrustes problems and their two-sided counterparts [19,20,7]. Notably, the softassign algorithm [42,23] is applied for solving the two-sided permutation Procrustes problem, which gives higher accuracy than other approaches, with commensurate computational costs.

  • Procrustes problems and parseval quasi-dual frames

    2014, Acta Applicandae Mathematicae
View full text