The SOR and AOR Methods with Stepwise Optimized Values of Parameters for the Iterative Solutions of Linear Systems

We modify the successive overrelaxation (SOR) method and accelerated overrelaxation (AOR) method for solving linear equations systems. The optimal value of the acceleration parameter is determined, using the maximal reduction method of the residual vector’s length, or equivalently an orthogonality condition. Rather than the constant value, the MAOR method endows a step-by-step varying acceleration parameter to possess the property of absolute convergence and the orthogonality of consecutive residual vector. In SOR, the relaxation parameter is also optimized by using the orthogonality condition. Numerical examples ensure that the MSOR and MAOR iterative schemes converge faster than the original SOR and AOR iterative schemes. They are easily implemented with low computational cost, and without needing of a detailed spectral analysis to determine the optimal values of parameters has a great advantage.