Some Hyperbolic Iterative Methods for Linear Systems

-e indefinite inner product defined by J � diag(j1, . . . , jn), jk ∈ − 1, +1 { }, arises frequently in some applications, such as the theory of relativity and the research of the polarized light. -is indefinite scalar product is referred to as hyperbolic inner product. In this paper, we introduce three indefinite iterative methods: indefinite Arnoldi’s method, indefinite Lanczos method (ILM), and indefinite full orthogonalization method (IFOM). -e indefinite Arnoldi’s method is introduced as a process that constructs a Jorthonormal basis for the nondegenerated Krylov subspace. -e ILM method is introduced as a special case of the indefinite Arnoldi’s method for J-Hermitian matrices. IFOM is mentioned as a process for solving linear systems of equations with JHermitian coefficient matrices. Finally, by providing numerical examples, the FOM, IFOM, and ILM processes have been compared with each other in terms of the required time for solving linear systems and also from the point of the number of iterations.


Introduction
Nowadays, iterative methods are used extensively for solving general large sparse linear systems in many areas of scientific computing because they are easier to implement efficiently on high-performance computers than direct methods.
Projection methods for solving systems of linear equations have been known for some time.
e initial development was done by A. de la Garza [1].
One process by which an approximate solution  x of the linear system Ax � b can be found is a projection method onto the subspace K and orthogonal to L. is method focuses on this requirement that x belongs to K and the new residual vector b − A x be orthogonal to L (for more details, refer to [2][3][4][5]).Around the early 1950s, the idea of the Krylov subspace iteration was established by Cornelius Lanczos and Walter Arnoldi.Lanczos's method was based on two mutually orthogonal vector sequences and his motivation came from eigenvalue problems.In that context, the most prominent feature of the method is that it reduces the original matrix to tridiagonal form.Lanczos later applied his method to solve linear systems, in particular, symmetric ones.Krylov subspace iterations or Krylov subspace methods are iterative methods which are used as linear system solvers and also iterative solvers of eigenvalue problems.Krylov subspace methods which built up Krylov subspaces look for good approximations to eigenvectors.It is done by keeping all computed approximates and by combining them for a better solution.
In this paper, we introduce three iterative methods in the space with hyperbolic inner product.
ese methods are indefinite Arnoldi, indefinite Lanczos (ILM), and indefinite full orthogonalization (IFOM), and we define new algorithms to run these hyperbolic versions.By the numerical examples, we will compare these indefinite algorithms with their common definite modes, from the point of the number of iterations and the required time to run the algorithms.
is paper is organized as follows: in Section 2, the indefinite Arnoldi's process is proposed to construct a Jorthonormal basis.In Section 3, we present IFOM to solve the linear system of equations, and in Section 4, we give the ILM.At the end of this section, several numerical examples are expressed to compare the run speed and the number of repetitions.Counting the arithmetic act of multiplication in FOM, IFOM, and ILM algorithms and conclusion are the last two sections, respectively.

Indefinite Arnoldi's Method
We know that there are many applications which require a nonstandard scalar product which is usually defined by [x, y] J � y * Jx, where J is some nonsingular matrix and many of these applications consider Hermitian or skew-Hermitian J and an indefinite scalar product is defined by nonsingular Hermitian indefinite matrix J ∈ C n×n as [x, y] J � y * Jx.When J is the signature matrix J � diag(± 1) � diag(j 11 , j 22 , . . ., j nn ) where j kk ∈ − 1, 1 { } for all k, the scalar product is referred to as hyperbolic and takes the following form: (1) where σ is a permutation for which σ(i) � j i and j i ∈ 1, . . ., n { } and r is an arbitrary integer from 0 to n.It is easy to see that [., .] is an indefinite inner product and its corresponding nonsingular Hermitian matrix is in the form J � diag(± 1), wherein r is the number of +1 and n − r is the number of − 1.Because if and conversely, if If M is any nonzero subspace of C n , then the basis x 1 , . . ., x k for M is said to be an orthogonal basis with respect to the indefinite inner product [., .]if [x i , x j ] � 0 for i ≠ j, and is said to be an orthonormal basis if in addition to orthogonality, [x i , x i ] � ± 1 for i � 1, . . ., k.For the hyperbolic inner product, the above definitions of orthogonal basis and orthonormal basis are said to be J-orthogonal and J-orthonormal bases, respectively.Let C n be a vector space with an indefinite inner product en, it follows that g k � 0. In this section, we construct the indefinite Arnoldi's method and then we turn it into a practical algorithm.Definition 2. Let a matrix A and a starting vector v be given.
en, the m-dimensional Krylov subspace K m (A, V) is spanned by a sequence of m column vectors: It is well known that the construction of a basis with Arnoldi's method for the Krylov subspace K m (A, V) leads to an upper Hessenberg matrix that describes the relation between the basis vectors.Each new basis vector can be constructed from the existing set as where h i,j follows from the orthogonality requirement v * i v j+1 � 0 and h j+1,j follows from the requirement that ‖v j+1 ‖ 2 � 1. e expression (8) can be formulated in matrix notation as where H m is an upper Hessenberg matrix.For further details, refer to [6].Now, the purpose of this section is to construct a J-orthonormal basis for the Krylov subspace (7) and the indefinite Arnoldi's process is an algorithm that brought us to this goal.Furthermore, this process is a tool that condensed the matrix into a Hessenberg form.e indefinite Arnoldi's algorithm for the computation of a Jorthonormal basis of the Krylov (7) subspace is shown in Algorithm 1.

Proposition 1. Assume that the indefinite Arnoldi's algorithm does not stop before the m-th step. en, the vectors
Proof.By considering the following expression, the proof is straightforward: Journal of Applied Mathematics en, the following relations are valid: In particular, if m � n, then Proof.Indeed, in general, (11) is the matrix representation of (10): Now, to see (12), left-multiply relation (14 On the other hand, given that the vectors v 1 , . . ., v m build a J-orthonormal basis, then, (2) We have In other words, J �V * m JV m � I.
erefore, relation (15) can be summarized as follows: and by left-multiplying by J � , we have It is noteworthy that these concepts are used in [7] to solve an eigenvalue problem.

Indefinite Full Orthogonalization Method
e purpose of this section is to build an algorithm to solve the linear system: where A is an n × n complex matrix and the inner product of the space is hyperbolic.Let K and L be two m-dimensional subspace of C n .As mentioned in Section 1, one process by which an approximate solution  x of the linear system (21) can be found is a projection method onto the subspace K and orthogonal to L. is method focuses on this requirement that  x belongs to K and the new residual vector b − A x be orthogonal to L. Suppose that V m � [v 1 , . . ., v m ] is an n × m matrix whose columns constitute a J-orthonormal basis of the nondegenerated subspace K and, similarly, W m � [w 1 , . . ., w m ] is an n × m matrix whose columns form a J-orthonormal basis of the nondegenerated subspace L and suppose that the approximate solution of (21) is as follows: where x 0 is an initial guess to the solution of (21).en, for each i � 1, . . ., m, we should have and by letting r 0 � b − Ax 0 , we have and therewith, for approximate solution  x, we earn , the indefinite full orthogonalization method (IFOM) is a process which seeks for an approximation solution x from the subspace x 0 + K m with the proviso that us, relation (26 and finally, Our explanations are summarized in Algorithm 2.

Proposition 3. e residual vector of the approximate solution x m calculated by the IFOM algorithm is such that
Proof.By using relations (11) and (29), we have the following relations: We expect that FOM performs better than IFOM in terms of the number of iterations and the required time to run because in the IFOM method, the product of entries of J � in the entries of H is added to the calculations, when compared to the FOM method.
e following example verifies this expectation.In this example, we have used n instead of m, i.e., we have assumed that n is the maximum number of iterations of the algorithm.But instead, we have considered this requirement that ‖A x − b‖ < 10 − 8 .

□
Example 2. Let A is a 150 × 150 tridiagonal matrix and an arbitrary diagonal matrix J is J � diag(j 1 , . . ., j 150 ), j i ∈ +1, − 1 { } and suppose that b and v 0 are two vectors in R 150 (see Figure 1).Suppose that the entries of these vectors and the nonzero entries of A have been randomly selected from zero to five.en, the effects of the FOM and IFOM algorithms are as follows: (i) e IFOM algorithm (Algorithm 2) after 149 iterations and within t � 1.89 seconds brings the linear system Ax � b to the following condition: (ii) e FOM algorithm does the same with 149 replications and at t � 0.6 seconds.
Despite the superiority of the FOM on the IFOM, there is an important property of the IFOM algorithm that is shown in the next section.

Indefinite Lanczos Method
is section is devoted to the indefinite Lanczos method.As can be seen in the following, this method is expressed as a special case of the indefinite Arnoldi's method in the complex space for the special case when the matrix A is J-Hermitian.

Definition 3.
A matrix A is said to be J-Hermitian (Jsymmetric) when A � JA * J (A � JA T J) and we write A � A [H] (A � A [T] ).

Proposition 4. Assume that indefinite Arnoldi's method is applied to a J-Hermitian matrix A. en, the matrix H m obtained from the process is tridiagonal and Hermitian.
Proof.From the indefinite Arnoldi's method, we have relation (12): On the other hand, that A is J-Hermitian yields JA � A * J. us, H * m � H m .erefore, the resulting matrix H m by the indefinite Arnoldi's algorithm (Algorithm 1) for J-Hermitian matrix A is an upper Hessenberg and Hermitian matrix.In other words, H m is a Hermitian tridiagonal matrix.e resulting H m matrix is shown by T m , and the diagonal elements are denoted by α j ≔ h jj , and the off-diagonal elements are denoted by β j ≔ h j− 1,j � h j,j− 1 ,

4
Journal of Applied Mathematics In fact, we have the following: and the above relation turns to By using the hyperbolic inner product both sides in v j+1 , we earn is implies that β j+1 � β j+1 ; therefore, T m is in the above form.
With this explanation, the hyperbolic version of the Hermitian Lanczos algorithm can be formulated as given in Algorithm 3. Now, consider the linear system Ax � b for which A is a J-Hermitian matrix and x 0 is an initial vector and the indefinite Lanczos vectors v 1 , . . ., v m together with the tridiagonal matrix T m are given.
en, the approximate solution obtained from an indefinite orthogonal projection method on to K m , similar to what was seen for the indefinite Arnoldi's method, is given by us, using the above algorithm, Algorithm 4 can be considered as the indefinite Lanczos algorithm for solving a real linear system with the J-Hermitian coefficient matrix.
Similar to what has already been proven for the IFOM algorithm, here also it can be seen that e advantage of ILM (the indefinite Lanczos method) is that it solves some classes of linear systems with different coefficient matrices, for different choices of matrix J. e following examples explain more in which we use n instead of m.In other words, we assume that the maximum number of the iterations of the algorithm is n.Besides, we use this stop condition that ‖A x − b‖ < 10 − 8 .Journal of Applied Mathematics where each block A ij is of order (n/2) × (n/2) and A 11 and A 22 are symmetric matrices and A T 12 � − A 21 .By choosing J � (− I n/2 ) ⊕ I n/2 , it can be seen that A � A [T] (see Figure 2).Now, let n � 200 and suppose that A 11 and A 22 are diagonal matrices and A 12 is a tridiagonal matrix where the diagonal entries of A 11 , A 22 , and A 12 are chosen arbitrarily in (0, 10) and b is a vector in R 200 that its entries are selected at this distance (see Figure 3).e performance of the algorithm is as follows:

□ Example 3. Consider the linear system Ax � b in which
(i) e IFOM algorithm brings the linear system Ax � b to the condition ‖A x − b‖ < 10 − 8 , after 123 iterations and within t � 1.7 seconds (ii) e FOM does the same with 118 iterations and within t � 0.36 seconds (iii) e ILM algorithm does the same with 130 iterations and within t � 0.15 seconds It shows that ILM is more efficient than the IFOM and FOM.However, the number of its iterations is higher but less time is required.
Example 4. Consider the assumptions of the previous example, except that A ∈ M n (C) and A 12 is a tridiagonal matrix with complex entries as a + ib in which a ∈ (0, 10) and b ∈ (1, 5) and A * 12 � − A 21 .en, A � A [H] and n � 200: (i) By IFOM: the number of iterations is 140, within t � 4.06 seconds (ii) By FOM: the number of iterations is 136, within t � 1.11 seconds (1) Choose an initial vector v 1 such that t(v where each block A ij is of order (n/3) × (n/3) and A 11 , A 22 , and A 33 are symmetric matrices and A T 12 � − A 21 and A 23 � − A T 32 and A T 13 � A 31 .By choosing J � (− I n/3 ) ⊕ I n/3 ⊕ (− I n/3 ), it can be seen that A is J-symmetric, and therefore, it is allowed to apply ILM.Now, suppose that (i) A ii , i � 1, 2, 3, are diagonal matrices with diagonal entries between zero and ten and A T 13 � A 31 � 0 and n � 300 (ii) A 12 and A 23 are bidiagonal matrices and the entries of the main diagonals and their below entries are chosen between zero and ten (iii) b is a vector in R n with entries between zero and ten (iv) x 0 is an initial vector in R n with arbitrary entries between zero and ten en, to achieve the condition ‖A x − b‖ < 10 − 8 , we need to consider the following: (i) By IFOM: the number of iterations is 175, within t � 5.6 seconds (ii) By FOM: the number of iterations is 167, within t � 1.09 seconds (iii) By ILM: the number of iterations is 190, within t � 0.39 seconds As it is seen, the ILM method is superior to FOM and IFOM methods.It is because of the low length of the recursive relation in its algorithm (tree terms for it) (see Figure 4).In other words, we do not need to do orthogonalizations at each step, on the all earlier vectors of its related Krylov subspace.

Counting the Arithmetic Act of Multiplication in FOM, IFOM, and ILM Algorithms
For two n-vectors x, y, we have where x i and y i are the i-th elements of the x, y vectors, respectively, and j ii is the (i, i)-th array of J. us, 2n multiplication operations are required to perform this indefinite inner product.
Using the above point, the number of multiplication operations required to perform steps (3)-(12) of the IFOM algorithm is equal to and the number of multiplication operations required to perform steps (3)-(12) of the FOM algorithm is equal to However, the number of required multiplication operations to do steps (3)- (11) of the ILM algorithm is Comparison of ( 46) and (47) shows that, for m ≤ 12, the number of multiplications of the FOM algorithm is further Journal of Applied Mathematics than the ILM algorithm, and by increasing the value of m, this difference will also increase.
In the aforementioned algorithms, the inverses of the upper Hessenberg matrix H n or the tridiagonal matrix T n must be calculated.In this regard, it should be noted that calculating the inverse of the matrix T m in the ILM algorithm requires less number of multiplications than calculating the inverse of the H m matrix in the FOM algorithm.
What was said above shows that the run speed of the m steps of ILM is faster than that of the FOM algorithm and this is evident in the preceding section.

Conclusion
e indefinite inner product defined by J � diag(j 1 , . . ., j n ), j k ∈ − 1, +1 { }, arises frequently in applications.It is used, for example, in the theory of relativity and in the research of the polarized light.More on the applications of such products can be found in [8][9][10][11].ese applications in other fields of science inspired us to resume Lanczos, FOM, and Arnoldi's methods in the indefinite inner product space.e indefinite Arnoldi's method is a process that constructs a J-orthonormal basis for the nondegenerated Krylov subspace, and the bases that we proved have a particular common property, about the structure of the product of their vectors.In this paper, IFOM process has been introduced and also a process is made which is useful for solving linear systems of equations with J-Hermitian coefficient matrices.is process is the same Lanczos method that has been restored in the hyperbolic inner product space.In this paper, the FOM, IFOM, and ILM processes have been compared with each other in terms of the time required for solving linear systems and the best one is introduced.Indeed, we show that the run speed of the m steps of ILM is faster than that of FOM and IFOM.

Figure 2 6 5 .
Figure2 Figure 4 [., .].A vector y ∈ C n is called nonneutral if [y, y] ≠ 0. Note first of all that any set of nonneutral vectors y 1 , . . ., y m which is orthogonal in the sense of the indefinite inner product [., .] is necessarily linear independent.To see this, suppose that  m j�1 g j y j � 0, and hence, for k � 1, . . ., m,