Open Access

ARTICLE

# Novel Algorithms Based on the Conjugate Gradient Method for Inverting Ill-Conditioned Matrices, and a New Regularization Method to Solve Ill-Posed Linear Systems

Chein-Shan Liu1, Hong-Ki Hong1, Satya N. Atluri2

Department of Civil Engineering, National Taiwan University, Taipei, Taiwan. E-mail: liucs@ntu.edu.tw
Center for Aerospace Research & Education, University of California, Irvine

Computer Modeling in Engineering & Sciences 2010, 60(3), 279-308. https://doi.org/10.3970/cmes.2010.060.279

## Abstract

We propose novel algorithms to calculate the inverses of ill-conditioned matrices, which have broad engineering applications. The vector-form of the conjugate gradient method (CGM) is recast into a matrix-form, which is named as the matrix conjugate gradient method (MCGM). The MCGM is better than the CGM for finding the inverses of matrices. To treat the problems of inverting ill-conditioned matrices, we add a vector equation into the given matrix equation for obtaining the left-inversion of matrix (and a similar vector equation for the right-inversion) and thus we obtain an over-determined system. The resulting two modifications of the MCGM, namely the MCGM1 and MCGM2, are found to be much better for finding the inverses of ill-conditioned matrices, such as the Vandermonde matrix and the Hilbert matrix. We propose a natural regularization method for solving an ill-posed linear system, which is theoretically and numerically proven in this paper, to be better than the well-known Tikhonov regularization. The presently proposed natural regularization is shown to be equivalent to using a new preconditioner, with better conditioning. The robustness of the presently proposed method provides a significant improvement in the solution of ill-posed linear problems, and its convergence is as fast as the CGM for the well-posed linear problems.

## Keywords

APA Style
Liu, C., Hong, H., Atluri, S.N. (2010). Novel algorithms based on the conjugate gradient method for inverting ill-conditioned matrices, and a new regularization method to solve ill-posed linear systems. Computer Modeling in Engineering & Sciences, 60(3), 279-308. https://doi.org/10.3970/cmes.2010.060.279
Vancouver Style
Liu C, Hong H, Atluri SN. Novel algorithms based on the conjugate gradient method for inverting ill-conditioned matrices, and a new regularization method to solve ill-posed linear systems. Comput Model Eng Sci. 2010;60(3):279-308 https://doi.org/10.3970/cmes.2010.060.279
IEEE Style
C. Liu, H. Hong, and S.N. Atluri "Novel Algorithms Based on the Conjugate Gradient Method for Inverting Ill-Conditioned Matrices, and a New Regularization Method to Solve Ill-Posed Linear Systems," Comput. Model. Eng. Sci., vol. 60, no. 3, pp. 279-308. 2010. https://doi.org/10.3970/cmes.2010.060.279

View