CMC CMC CMC Computers, Materials & Continua 1546-22261546-2218 Tech Science Press USA 12610 10.32604/cmc.2020.012610 Article An Iterative Scheme of Arbitrary Odd Order and Its Basins of Attraction for Nonlinear SystemsAn Iterative Scheme of Arbitrary Odd Order and Its Basins of Attraction for Nonlinear SystemsAn Iterative Scheme of Arbitrary Odd Order and Its Basins of Attraction for Nonlinear Systems Solaiman Obadah Said Hashim Ishak ishak_h@ukm.edu.my Department of Mathematical Sciences, Universiti Kebangsaan Malaysia, Bangi Selangor, 43600, Malaysia *Corresponding Author: Ishak Hashim. Email: ishak_h@ukm.edu.my 21 11 2020 66 2 1427 1444 06 7 2020 02 8 2020 © 2020 Solaiman and Hashim 2020 Solaiman and Hashim This work is licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

In this paper, we propose a fifth-order scheme for solving systems of nonlinear equations. The convergence analysis of the proposed technique is discussed. The proposed method is generalized and extended to be of any odd order of the form 2n1 . The scheme is composed of three steps, of which the first two steps are based on the two-step Homeier’s method with cubic convergence, and the last is a Newton step with an appropriate approximation for the derivative. Every iteration of the presented method requires the evaluation of two functions, two Fréchet derivatives, and three matrix inversions. A comparison between the efficiency index and the computational efficiency index of the presented scheme with existing methods is performed. The basins of attraction of the proposed scheme illustrated and compared to other schemes of the same order. Different test problems including large systems of equations are considered to compare the performance of the proposed method according to other methods of the same order. As an application, we apply the new scheme to some real-life problems, including the mixed Hammerstein integral equation and Burgers’ equation. Comparisons and examples show that the presented method is efficient and comparable to the existing techniques of the same order.

System of nonlinear equations root finding method iterative method order of convergence Burgers’ equation
Introduction

One popular research area in mathematics is to find the solution α=(α1,α2,,αn)t of the system of nonlinear equation F(X)=0 , where F(X)=(f1(x),f2(x),,fn(x))t , and X=(x1,x2,xn)tRn . This type of problems occurs in many applied sciences like engineering, physics, biology and chemistry. Many researchers developed iterative methods for solving this kind of systems using different techniques. The most popular iterative method for solving system of nonlinear equations is the well-known Newton’s method which has second order of convergence . To improve the order of convergence and increase the accuracy of the solution obtained, many researchers tried to improve Newton’s method. Some authors used different forms and modifications based on Adomian decomposition technique for solving systems of nonlinear equations, see for instance . Another way to improve some schemes for systems of nonlinear equation is by using homotopy analysis method and homotopy perturbation method, see for example [7,8]. Grau-Sánchez et al.  used the harmonic mean of the derivative to improve an iterative scheme for solving systems of nonlinear equations. By applying some quadrature formulas, some researchers implement their techniques to solve systems of nonlinear equations, for instance . Also, some derivative-free schemes for systems of nonlinear equations were proposed, see for example  and the references therein. One of the well-known modifications of Newton method is Jarratt method of order four. Cordero et al.  extended Jarratt method to solve systems of nonlinear equations preserving the same order of convergence. Many variants of Jarratt type methods have been developed, see for example  and the references therein. Many other different orders of convergence schemes for nonlinear modules can be found in the literature, see for example [20,21] and the references therein.

Some techniques to improve the order of convergence of the iterative schemes for systems of nonlinear equations have been proposed, for instance, see [22,23]. In general, obtaining a higher-order iterative method is not the only important thing; as the computational and the time cost are crucial issue also. So, establishing a high order iterative method based on low computational and time cost is very important.

In this paper, we develop a new multi-step scheme of arbitrary odd order for nonlinear equations. The proposed method can be used in the multidimensional case preserving the same order. The convergence analysis of the new scheme is discussed. Several examples are given to show the efficiency of the generalized method and its comparison with other iterative schemes of the same order. To confirm the applicability of the new technique, we apply the new technique to some real-life problems.

The Proposed Method

In this section we will derive the proposed technique for nonlinear modules. We begin by writing the function f(x) as:

f(x)=xnxf(t)dt+f(xn).

As we want f(x)=0 , and by using midpoint quadrature formula and writing the equation as an iterative scheme, one gets

xn+1=xnf(xn)f(xn+xn+12).

Now, to write the iterative scheme (2) in explicit form, replace f(xn+xn+12) by f(xn+xn+12) where xn+1 is the Newton step. So, scheme (2) becomes:

{yn=xn12f(xn)f(xn),xn+1=xnf(xn)f(yn).

The iterative method (3) was proposed by Frontini and Sormani . The multidimensional case of scheme (3) was discussed by Homeier  and can be written as:

{Yn=Xn12F(Xn)1F(Xn),Xn+1=XnF(Yn)1F(Xn),

where F(Xn)1 and F(Yn)1 are the inverse of the first Fréchet derivative of F(Xn) and F(Yn) respectively. Scheme (4) is of third-order of convergence, and requires at each iteration the evaluation of one function, two Fréchet derivatives and two matrix inversions. In order to increase the convergence order and the computational efficiency of scheme (4) Sharma et al.  proposed a new scheme of the fifth-order of convergence by adding one step to scheme (4):

{Yn=Xn12F(Xn)1F(Xn),Wn=XnF(Yn)1F(Xn),Xn+1=Wn(2F(Yn)1F(Xn)1)F(Wn).

Per iteration, scheme (5) requires the evaluations of two functions, two Fréchet derivatives and two matrix inversions.

Now, to derive the new scheme for solving systems of nonlinear equations, we start by composing scheme (3) to additional Newton step, that is:

{yn=xn12f(xn)f(xn),wn=xnf(xn)f(yn),xn+1=wnf(wn)f(wn).

Now, to reduce number of functional evaluations at each iteration, we will use divided difference approximation to write the derivative f(wn) using some already computed functions from the previous steps. To do that, one can write

f(yn)=f(yn)f(xn)ynxn=f[yn,xn]f(xn),

in the same manner, we have

f(yn)=f(yn)f(wn)ynwn=f[yn,wn]f(wn),

by adding (7) and (8), one easily can conclude that

f(wn)2f(yn)f(xn).

Now, if we substitute (9) in (6), then we will have a new scheme for solving nonlinear equations:

{yn=xn12f(xn)f(xn),wn=xnf(xn)f(yn),xn+1=wnf(wn)2f(yn)f(xn).

To generalize scheme (10) to the multidimensional case to solve systems of nonlinear modules, the scheme becomes:

{Yn=Xn12F(Xn)1F(Xn),Wn=XnF(Yn)1F(Xn),Xn+1=Wn(2F(Yn)F(Xn))1F(Wn).

Scheme (11) requires at each iteration the evaluation of two functions, two Fréchet derivatives and three matrix inversions. The proposed scheme is of fifth-order of convergence as we will see in the next section.

If we repeat using the same idea of the derivation of scheme (11), we can write a general scheme for solving system of nonlinear equations, and this is the main motivation of our work. The general scheme can be written as:

{X1,n=X0,n12F(X0,n)1F(X0,n),X2,n=X0,nF(X1,n)1F(X0,n),X3,n=X2,n(2F(X1,n)F(X0,n))1F(X2,n),Xq,n=Xq1,n(2F(X1,n)F(X0,n))1F(Xq1,n),Xm,n=Xm1,n(2F(X1,n)F(X0,n))1F(Xm1,n).

Per iteration, scheme (12) requires the evaluation of m1 functions, two Fréchet derivatives and three matrix inversions. We will prove in the next section that scheme (12) is of order 2m1 for any integer m3 .

Order of Convergence

We will discuss in this section the order of convergence of the proposed schemes (11) and (12). Assume for the next theorems that Cj=1j!F(α)1F(j)(α) , j2 , and en=Xnα .

Theorem 1 Let α be the solution of the system F(X)=0 where F:DRnRn be a sufficiently differentiable function on a neighborhood D of α . Suppose that F(X) is continuous and nonsingular in α . If X0D is an initial approximation which is close enough to α , then the sequence {Xn}n0 obtained by scheme (11) converges to the root α , and the order of convergence equals 5 , with asymptotic equation ek+1=18(4C223C3)(4C22C3)ek5 .

Proof. By using the Taylor expansion of F(Xn) we can write F(Xn)=F(α)en+C2en2+C3en3+C3en3+C4en4+) . Now, we use the following Mathematica code to show the convergence order of scheme (11) for m=3 :

In:= F[e_]:= dF[α](e+C2e2+C3e3+C4e4);

In:= y=e-Series[12(F[e])1F[e],{e,0,2}];

In:= w=e-Series[(F[y])1F[e],{e,0,2}];

In:= en+1=w(2F[y]F[e])1F[w]// //FullSimplify

Out:= (2C242C22C3+3C328)e5+O[e6].

the code shows that we have en+1=(2C242C22C3+3C328)en5 , which can be written as:

en+1=18(4C223C3)(4C22C3)en5 .

By this, we show that scheme (11) is at least of fifth-order of convergence.

Now, we want to discuss the order of convergence of the generalized scheme given by (12).

Theorem 2 Let α be the solution of the system F(X)=0 where F:DRnRn be a sufficiently differentiable function on a neighborhood D of α . Suppose that F(X) is continuous and nonsingular in α . If X0D is an initial approximation which is close enough to α , then the sequence {Xn}n0 obtained by scheme (12) converges to the root α , and the order of convergence equals 2m1 , for any integer m3 , with asymptotic equation of the form ek+1=12m(4C223C3)m2(4C22C3)ek2m1 .

Proof. We will use the mathematical induction to prove the convergence order of scheme (12).

Firstly, we will prove that scheme (12) is convergent for m=3 , and the convergence order satisfies 2(3)1=5 . Note that for m=3 , scheme (12) reduces to scheme (11) which we have been proved that it has the fifth-order of convergence in the previous theorem. Now, to complete the proof using the mathematical induction, suppose that scheme (12) is true and converges for all mr for some positive 3$]]>r>3 and satisfy the given asymptotic equation. We need to show that the scheme converges for m=r+1 , and satisfy the given asymptotic equation. To do so, consider the following code of Mathematica: In:= F[e_]:= dF[α](e+C2e2+C3e3+C4e4); In:= y=e-Series[12(F[e])1F[e],{e,0,6}]; In:= w=e-Series[(F[y])1F[e],{e,0,6}]; In:= x[m_]:=x[m] =12m(4C223C3)m2(4C22C3)en2m1// //FullSimplify In:= en+1=x[r](2F[y]F[e])1F[x[r]]// //FullSimplify Out:= 12r+1(4C223C3)r2(4C22C3)en2r1 Hence, this shows that for m=r+1 , we have ek+1=12r+1(4C223C3)r1(4C22C3)ek2r+1 . Computational Efficiency In this section, we compare the efficiency index of our proposed method with other methods in the literature. Commonly in the literature, the efficiency index EI=p1d is used, where p is the order of convergence of the iterative scheme, and d is the number of functions needed to be found per iteration in the iterative scheme. Another common index that can be used in the comparison between iterative scheme is the computational efficiency index CEI=p1d+op , where op is the number of operations per iteration in the iterative scheme. The evaluation of any scalar function is considered as an operation. To find the number of functions required to be found per iteration in an iterative scheme, the following rules applied: Any computation of F(X) needs n evaluations of scalar functions. Any computation of the Jacobian F(X) needs n2 evaluations of scalar functions. Also, the floating points for obtaining the LU factorization are 23n3 , and to solve the triangular system we need n2 floating points operations. Finally, n2 operations required to find a matrix-vector multiplication, and n3 operations needed to find a matrix-matrix multiplication. We compare the efficiency index and the computational efficiency index for the proposed method (PM) (11) to the following iterative schemes: • The third-order Frontini-Sormani method (FS)  given by (4). • The fifth order scheme (CHMT) proposed by Cordero et al. , given by {Yn=XnF(Xn)1F(Xn),Wn=Xn2(F(Yn)+F(XN))1F(Xn),Xn+1=WnF(Yn)1F(Wn). • The fifth order scheme (MMK) proposed by Waseem et al. , which is given by: {Yn=XnF(Xn)1F(Xn),Wn=YnF(Xn)1F(Yn),Zn=WnF(Xn)1F(Wn),Xn+1=ZnF(Xn)1F(Zn). • The fifth-order iterative scheme (SG) presented by Sharma et al. , which is defined by scheme (5). A comparison of the number of functional evaluations of the selected iterative schemes is illustrated in Tab. 1. Also, the computational efficiency indices of the selected schemes are compared (for n=2,3,4,5,10,20,50 ), see Fig. 1. Note that the proposed scheme does not attain the best efficiency in this comparison, especially for small n . We will see in the next two sections that this issue does not affect the scheme negatively when applied to some numerical tests. Computational efficiency indices for different sizes of system Comparisons of required functional evaluations per iteration FS CHMT MMK SG PM 5 Order of convergence 3 5 5 5 5 Number of functional evaluations n+2n2 2n+2n2 4n+n2 2n+2n2 2n+2n2 Efficiency index 31n+2n2 512n+2n2 514n+n2 512n+2n2 512n+2n2 Computational efficiency index 3143n3+6n2+n 512n3+8n2+2n 5123n3+9n2+4n 5143n3+6n2+2n 512n3+8n2+2n Fig. 2 illustrates the efficiency indices for the selected methods. Note that CHMT, SG and our proposed method have the same efficiency indices. However, this does not guarantee that they have the same behavior, accuracy and computational time cost. Efficiency indices for different values of <inline-formula id="ieqn-111"> <alternatives><inline-graphic xlink:href="ieqn-111.png"/><tex-math id="tex-ieqn-111"><![CDATA[$n$]]></tex-math><mml:math id="mml-ieqn-111"><mml:mi>n</mml:mi></mml:math> </alternatives></inline-formula> Basins of Attraction The concept of basins of attraction is a method to show how different starting points affect the behavior of the function. In this way, we can compare different root-finding schemes depending on the convergence area of the basins of attraction. In this sense, the iterative scheme is better if it has a larger area of convergence. Here, we mean by the area of convergence, the number of convergent points to a root α of f(x) in a selected range. To check the stability and the area of convergence of our proposed method, we select the case m=3 of scheme (12). We denote the proposed method by PM 5 . For comparison, we compare PM 5 with the following schemes of the same order of convergence: The scheme CHMT given by Cordero et al. (13), the scheme SG proposed by Sharma and Gupta (5), and the scheme MMK presented by Waseem et al. (14). We choose three test examples to visualize the basins of attraction. All examples are polynomials with roots of multiplicity one. The test polynomials are P1(z)=z3z , with roots z=0 , ±1 . P2(z)=z41 , with roots z=±i , ±1 . P3(z)=z5+2z1 , with roots z=0.945068±0.854518i , 0.486389 , 0.701874±0.879697i A 4×4 region is centered at the origin to cover all the zeros of the selected polynomials. The step size selected is 0.01 ; thus, 401×401=160801 points in a uniform grid are selected as initial point for the iterative schemes to generate the basins of attraction. The exact roots were assigned as black dots on the graph. If the scheme needs less number of iterations to converge to a specific root, then the region of that roots appears darker. The convergence criterion selected is a tolerance of 103 with a maximum of 100 iterations. All calculations have been performed on Intel Xeon CPU-E5-2690 0@2.90 GHz with 32 GB RAM, using Microsoft Windows 10, 64 bit based on X64-based processor. Mathematica 9 has been used to generate all graphs and computations. The dynamics of the four test problems are shown in Figs. 35 respectively. Basins of attraction of <inline-formula id="ieqn-132"> <alternatives><inline-graphic xlink:href="ieqn-132.png"/><tex-math id="tex-ieqn-132"><![CDATA[${P_1}\left( z \right) = {z^3} - z$]]></tex-math><mml:math id="mml-ieqn-132"><mml:mrow><mml:msub><mml:mi>P</mml:mi><mml:mn>1</mml:mn></mml:msub></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:msup><mml:mi>z</mml:mi><mml:mn>3</mml:mn></mml:msup></mml:mrow><mml:mo>−</mml:mo><mml:mi>z</mml:mi></mml:math> </alternatives></inline-formula>. The top row from left to right: CHMT and MMK. The bottom row from left to right: SG and PM<inline-formula id="ieqn-133"> <alternatives><inline-graphic xlink:href="ieqn-133.png"/><tex-math id="tex-ieqn-133"><![CDATA[$_{5}$]]></tex-math><mml:math id="mml-ieqn-133"><mml:msub><mml:mi></mml:mi><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:msub></mml:math> </alternatives></inline-formula> Basins of attraction of <inline-formula id="ieqn-134"> <alternatives><inline-graphic xlink:href="ieqn-134.png"/><tex-math id="tex-ieqn-134"><![CDATA[${P_2}\left( z \right) = {z^4} - 1$]]></tex-math><mml:math id="mml-ieqn-134"><mml:mrow><mml:msub><mml:mi>P</mml:mi><mml:mn>2</mml:mn></mml:msub></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:msup><mml:mi>z</mml:mi><mml:mn>4</mml:mn></mml:msup></mml:mrow><mml:mo>−</mml:mo><mml:mn>1</mml:mn></mml:math> </alternatives></inline-formula>. The top row from left to right: CHMT and MMK. The bottom row from left to right: SG and PM<sub>5</sub> Basins of attraction of <inline-formula id="ieqn-135"> <alternatives><inline-graphic xlink:href="ieqn-135.png"/><tex-math id="tex-ieqn-135"><![CDATA[${P_3}\left( z \right) = {z^5} +2z - 1$]]></tex-math><mml:math id="mml-ieqn-135"><mml:mrow><mml:msub><mml:mi>P</mml:mi><mml:mn>3</mml:mn></mml:msub></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:msup><mml:mi>z</mml:mi><mml:mn>5</mml:mn></mml:msup></mml:mrow><mml:mo>+</mml:mo><mml:mn>2</mml:mn><mml:mi>z</mml:mi><mml:mo>−</mml:mo><mml:mn>1</mml:mn></mml:math> </alternatives></inline-formula>. The top row from left to right: CHMT and MMK. The bottom row from left to right: SG and PM5 Basins of attraction of PM 5 shows that the proposed method is comparable to other methods of the same order, with an area of convergence which is larger or the same as the areas of convergence of the other methods used in the comparison. Numerical Tests and Applications In this part, we consider some numerical problems to clarify the computational efficiency and convergence behavior of the proposed scheme. All calculations have been performed using 4000 significant digits on Mathematics 9. For comparisons, we find the number of iterations n needed to satisfy the stopping criterion XnXn1+F(Xn)<10150 for each selected method. Also, we use the approximated computational order of convergence for each iterative scheme, which can be found by ACOCln((Xn+1xn)/(XnXn1))ln((XnXn1)/(Xn1Xn2)). Finally, we compare for the selected schemes the distance between two consecutive iterations XnXn1 and the value of F(Xn) for n=1,2,3 . To be consistent in the comparison, we compare the proposed scheme PM 5 defined by scheme (12) for m=3 , to the original method which we derived from, that is, FS scheme given by (4). Also, we use the following fifth-order iterative schemes in the comparison: CHMT 5 method defined by scheme (13), MMK method defined by (14), and SG method defined by (5). To test the efficiency of the extension of our proposed scheme to higher orders schemes, we compare the proposed scheme PM 7 of seventh-order given by scheme (12) for m=4 , to the extension of CHMT 5 to the seventh-order scheme CHMT 7 given by: {Yn=XnF(Xn)1F(Xn),Wn=Xn2(F(Yn)+F(XN))1F(Xn),Zn=WnF(Yn)1F(Wn),Xn+1=ZnF(Yn)1F(Zn). Numerical Tests To be not selective in our examples, we choose most test problems from the same papers which contain the schemes used in the comparisons, see [4,20,23]. Also, we choose two distinct initial guesses for all problems to test the validity and the applicability of iterative schemes. We consider the following test problems and applications: Example 1 Consider the following system of two nonlinear equations: {x+1ey=0,x+cos(y)2=0, with initial guesses X0={0,0}t and X0={2,2}t . The exact solution of this problem is α={1.3401918575555883401 , 0.8502329164169513268}t . Example 2 Consider the following system of three nonlinear equations: {cos(y)sin(x)=0,zx1y=0,exz2=0. We consider as an initial solution X0={1,1,2}t and X0={1,12,1}t . The exact solution of this problem is α={0.90956949452004488381 , 0.66122683227485173542 , 1.5758341439069990361}t . Example 3 Consider the following system {xixi+11=0,i=1,2,,n1,xix11=0,i=n. For odd n , the exact zeros of F(X) are α={1,1,,1}t49times and α={1,1,,1}t49times . For n=49 , we select as an initial guess X0={2,2,,2}t49times and X0={12,12,,12}t49times . Example 4 Consider the nonlinear boundary value problem: y+y3=0,y(0)=0,y(1)=1. Assume the following partitioning for the interval [0,1] : u0=0<u1<u2<<um<um+1=1,uj+1=uj+h, where h=1m+1 is the step size, m is the system size. Let yi=y(ui) for i=0,1,2,,m+1 . We use the finite difference method to solve the problem, in which the second derivative y will be replaced by the central difference yyi12yi+yi+1h2 , i=1,2,,m . By this, we obtain m×m system given by: yi12yi+yi+1+h2yi3=0,i=1,2,,m. We solve this system for m=10 by selecting X0={1,1,,1}t10times , and X0={53,53,,53}t10times as initial guesses. The exact solution for this problem is α={0.680945648372 , 1.359281828740 , 2.016862032948 , 2.606640128407 , 3.050046273378 , 3.258957241540 , 3.181812502482 , 2.838449171715 , 2.306087498753 , 1.672371573489}t . Tabs. 25 show that our proposed methods PM 5 and PM 7 are efficient with a good performance and comparable to the other methods of the same order. The proposed methods converge to the desired solution either by less number of iterations based on the convergence criterion (Examples 1 and 2), or by the same number of iterations needed to satisfy the convergence criterion with more accurate answers (Examples 3 and 4). Comparisons between different methods for Example <inline-formula id="ieqn-197"> <alternatives><inline-graphic xlink:href="ieqn-197.png"/><tex-math id="tex-ieqn-197"><![CDATA[$\bf 1$]]></tex-math><mml:math id="mml-ieqn-197"><mml:mn>1</mml:mn></mml:math> </alternatives></inline-formula> Method X0 n X1X0 X2X1 X3X2 F(X1) F(X2) F(X3) ACOC FS {0,0}t 6 1.65 0.07 2.56 E-8 0.088 6.94 E-8 8.41 E-24 3 {2,2}t 7 1.01 0.315 0.00378 0.495 0.00914 3.03 E-8 3 CHMT 5 {0,0}t 5 1.56 0.0341 1.08 E-8 0.0738 2.46 E-8 7.92 E-41 5 {2,2}t 6 1.19 0.135 4.75 E-6 0.218 0.0000108 1.31 E-27 5 MMK {0,0}t 5 1.60 0.0547 3.28 E-8 0.140 7.64 E-8 5.33 E-38 5 {2,2}t 6 1.10 0.226 0.0000968 0.313 0.000198 1.02 E-20 5 SG {0,0}t 5 1.58 0.00283 1.82 E-17 0.00257 5.04 E-17 3.43 E-85 5 {2,2}t 6 1.19 0.135 3.33 E-6 0.224 9.23 E-6 1.12 E-28 5 PM 5 {0,0}t 5 1.58 0.00215 7.37 E-17 0.00125 1.28 E-16 2.66 E-86 5 {2,2}t 5 1.27 0.0607 8.03 E-8 0.152 1.46 E-7 1.34 E-40 5 CHMT 7 {0,0}t 5 1.58 0.00581 2.55 E-17 0.0122 5.82 E-17 2.12 E-117 7 {2,2}t 5 1.27 0.0576 1.18 E-10 0.0952 2.68 E-10 9.39 E-71 7 PM 7 {0,0}t 4 1.59 0.000406 3.75 E-29 0.000238 6.50 E-29 2.13 E-207 7 {2,2}t 5 1.31 0.0195 7.78 E-15 0.0452 1.38 E-14 7.36 E-107 7 Comparisons between different methods for Example <inline-formula id="ieqn-336"> <alternatives><inline-graphic xlink:href="ieqn-336.png"/><tex-math id="tex-ieqn-336"><![CDATA[$\bf 2$]]></tex-math><mml:math id="mml-ieqn-336"><mml:mn>2</mml:mn></mml:math> </alternatives></inline-formula> Method X0 n X1X0 X2X1 X3X2 F(X1) F(X2) F(X3) ACOC FS {1,1,2}t 8 0.790 0.471 0.0420 0.149 0.0372 0.000122 3 {1,12,1}t 7 0.561 0.0703 0.00105 0.235 0.000902 1.87 E-9 3 CHMT 5 {1,1,2}t 6 0.555 0.0638 0.0000172 0.0606 0.0000114 151 E-23 5 {1,12,1}t 5 0.599 0.0147 4.79 E-8 0.0370 3.32 E-8 2.79 E-36 5 MMK {1,1,2}t Div . {1,12,1}t 6 0.500 0.109 9.72 E-6 0.364 0.0000259 2.89 E-26 5 SG {1,1,2}t 8 1.63 0.334 1.09 0.398 0.343 0.231 5 {1,12,1}t 6 0.581 0.0289 7.18 E-7 0.106 5.47 E-7 1.81 E-30 5 PM 5 {1,1,2}t 5 0.553 0.0303 4.98 E-8 0.0355 3.51 E-8 3.01 E-37 5 {1,12,1}t 5 0.600 0.0195 4.77 E-8 0.0397 4.17 E-8 1.04 E-36 5 CHMT 7 {1,1,2}t 5 0.554 0.0607 3.99 E-7 0.0453 2.69 E-7 7.66 E-44 7 {1,12,1}t 5 0.605 0.00794 1.82 E-13 0.00769 1.21 E-13 3.02 E-88 7 PM 7 {1,1,2}t 5 0.549 0.0188 1.83 E-11 0.0189 1.62 E-11 5.49 E-75 7 {1,12,1}t 5 0.606 0.0112 1.00 E-13 0.00905 9.65 E-14 8.98 E-91 7 Comparisons between different methods for Example <inline-formula id="ieqn-475"> <alternatives><inline-graphic xlink:href="ieqn-475.png"/><tex-math id="tex-ieqn-475"><![CDATA[$\bf 3$]]></tex-math><mml:math id="mml-ieqn-475"><mml:mn>3</mml:mn></mml:math> </alternatives></inline-formula> Method X0 n X1X0 X2X1 X3X2 F(X1) F(X2) F(X3) ACOC FS {2,2,,2}t 7 6.46 0.538 0.000711 1.12 0.00142 3.67 E-12 3 {12,12,,12}t 7 3.00 0.499 0.000711 0.964 0.00142 3.67 E-12 3 CHMT 5 {2,2,,2}t 5 6.91 0.0911 3.16 E-10 0.183 6.31 E-10 3.26 E-52 5 {12,12,,12}t 5 3.39 0.114 1.06 E-9 0.227 2.12 E-9 1.41 E-49 5 MMK {2,2,,2}t 5 6.82 0.176 3.19 E-8 0.357 6.37 E-8 1.37 E-41 5 {12,12,,12}t 6 1.67 1.81 0.0151 3.18 0.0302 3.32 E-13 5 SG {2,2,,2}t 5 6.87 0.130 3.61 E-9 0.262 7.22 E-9 1.28 E-46 5 {12,12,,12}t 5 3.14 0.362 7.75 E-7 0.706 1.55 E-6 5.84 E-35 5 PM 5 {2,2,,2}t 5 6.91 0.0911 3.16 E-10 0.183 6.31 E-10 3.26 E-52 5 {12,12,,12}t 5 3.39 0.114 1.06 E-9 0.227 2.12 E-9 1.41 E-49 5 CHMT 7 {2,2,,2}t 5 6.98 0.0178 2.92 E-19 0.0355 5.84 E-19 1.93 E-136 7 {12,12,,12}t 5 3.48 0.0236 2.20 E-18 0.0471 4.39 E-18 2.62 E-130 7 PM 7 {2,2,,2}t 5 6.98 0.0178 2.92 E-19 0.0355 5.84 E-19 1.93 E-136 7 {12,12,,12}t 5 3.48 0.0236 2.20 E-18 0.0471 4.39 E-18 2.62 E-130 7 Comparisons between different methods for Example <inline-formula id="ieqn-614"> <alternatives><inline-graphic xlink:href="ieqn-614.png"/><tex-math id="tex-ieqn-614"><![CDATA[$ \bf 4$]]></tex-math><mml:math id="mml-ieqn-614"><mml:mn>4</mml:mn></mml:math> </alternatives></inline-formula> Method X0 n X1X0 X2X1 X3X2 F(X1) F(X2) F(X3) ACOC FS {1,1,,1}t 7 4.55 0.349 0.000285 0.0288 0.0000219 1.56 E-14 3 {53,53,,53}t 7 2.96 0.825 0.00726 0.0751 0.000552 2.56 E-10 3 CHMT 5 {1,1,,1}t 5 4.59 0.315 9.42 E-8 0.0246 7.40 E-9 1.72 E-41 5 {53,53,,53}t 6 2.50 0.873 0.00667 0.106 0.000845 9.74 E-15 5 MMK {1,1,,1}t 5 4.86 0.0205 4.64 E-13 0.00160 3.59 E-14 3.02 E-67 5 {53,53,,53}t 5 4.05 0.455 6.91 E-9 0.146 1.34 E-9 6.52 E-47 5 SG {1,1,,1}t 5 4.73 0.166 3.65 E-8 0.0124 2.82 E-9 1.85 E-42 5 {53,53,,53}t 8 1.55 14.3 4.39 0.160 0.725 0.163 5 PM 5 {1,1,,1}t 5 4.79 0.101 2.66 E-9 0.00765 2.06 E-10 2.5 E-48 5 {53,53,,53}t 5 3.42 0.333 1.40 E-6 0.0272 1.08 E-7 1.21 E-34 5 CHMT 7 {1,1,,1}t 5 5.01 0.139 2.81 E-13 0.0106 2.23 E-14 3.08 E-96 7 {53,53,,53}t 5 3.00 0.327 2.52 E-7 0.0533 3.16 E-8 4.63 E-51 7 PM 7 {1,1,,1}t 5 4.85 0.0305 2.11 E-16 0.00229 1.63 E-17 1.36 E-116 7 {53,53,,53}t 5 3.61 0.125 4.57 E-12 0.0106 3.54 E-13 3.10 E-86 7 Applications To check the applicability of the proposed scheme on real-life problems, we apply it on the mixed Hammerstein integral equation and Burgers’ equation. Problem 1 Consider the mixed Hammerstein integral equation: x(s)=1+1501G(s,t)x(t)3dt, such that xC[0,1] , and s,t[0,1] , and the kernel G(s,t) is given by G(s,t)={(1s)t,ts,(1t)s,st. The integral equation is transformed into a finite-dimensional problem using the Gauss-Legender quadrature formula given by 01f(t)dtj=18ωjf(tj), where the abscissas tj and the weights ωj are determined for n=8 by the Gauss–Legendre quadrature formula. If we set x(ti)=xi , for i=1,2,,8 , then we obtain the following system of nonlinear equations xi115j=18aijxj3=0,j=1,2,,8, where aij={ωjtj(1ti),ji,ωjti(1tj),i<j, where the abscissas tj and the weights ωj are known and presented in Tab. 6 for m=8 . The initial solutions considered are X0={0,0,0,0,0,0,0,0}t and X0={2,2,2,2,2,2,2,2}t . The exact solution of this problem is α={1.002096245031 , 1.009900316187 , 1.019726960993 , 1.026435743030 , 1.026435743030 , 1.019726960993 , 1.009900316187 , 1.002096245031}t . Abscissas and weights and of Gauss-Legendre quadrature formula for <inline-formula id="ieqn-779"> <alternatives><inline-graphic xlink:href="ieqn-779.png"/><tex-math id="tex-ieqn-779"><![CDATA[${m} = 8$]]></tex-math><mml:math id="mml-ieqn-779"><mml:mi mathvariant="bold-italic">m</mml:mi><mml:mo>=</mml:mo><mml:mn>8</mml:mn></mml:math> </alternatives></inline-formula> j tj ωj 1 0.01985507175123188415821956571526350478 0.05061426814518812957626567715498109 2 0.10166676129318663020422303176208478158 0.11119051722668723527217799721312044 2 0.23723379504183550709113047540537682547 0.15685332293894364366898110099330065 4 0.40828267875217509753026192881990800966 0.1813418916891809914825752246385978060 5 0 .59171732124782490246973807118009199033 0.1813418916891809914825752246385978060 6 0.76276620495816449290886952459462317452 0.15685332293894364366898110099330065 7 0.89833323870681336979577696823791521841 0.11119051722668723527217799721312044 8 0.98014492824876811584178043428473649521 0.05061426814518812957626567715498109 Comparisons in Tab. 7 show that the proposed schemes have a good functioning and comparable to the other iterative methods of the same order. Comparisons between different methods for Problem <inline-formula id="ieqn-807"> <alternatives><inline-graphic xlink:href="ieqn-807.png"/><tex-math id="tex-ieqn-807"><![CDATA[$\bf 1$]]></tex-math><mml:math id="mml-ieqn-807"><mml:mn>1</mml:mn></mml:math> </alternatives></inline-formula> Method X0 n X1X0 X2X1 X3X2 F(X1) F(X2) F(X3) ACOC FS {0,0,,0}t 5 2.86 0.0140 6.64 E-9 0.0654 3.10 E-8 3.63 E-27 3 {2,2,,2}t 5 2.75 0.0422 1.91 E-7 0.197 8.94 E-7 8.71 E-23 3 CHMT 5 {0,0,,0}t 4 2.87 0.0000848 1.79 E-26 0.000396 8.34 E-26 0 5 {2,2,,2}t 4 2.79 0.0000881 2.10 E-26 0.000412 9.83 E-26 0 5 MMK {0,0,,0}t 4 2.87 0.0000132 4.19 E-30 0.0000615 1.96 E-29 0 5 {2,2,,2}t 4 2.78 0.00442 1.80 E-17 0.0207 8.40 E-17 0 5 SG {0,0,,0}t 4 2.87 0.000490 9.53 E-22 0.00229 4.45 E-21 0 5 {2,2,,2}t 4 2.78 0.00417 4.35 E-17 0.0195 2.03 E-16 0 5 PM 5 {0,0,,0}t 4 2.87 0.000484 7.34 E-22 0.00226 3.43 E-21 0 5 {2,2,,2}t 4 2.79 0.00243 2.40 E-18 0.0113 1.12 E-17 0 5 CHMT 7 {0,0,,0}t 3 2.87 2.72 E-7 0 1.27 E-6 0 0 7 {2,2,,2}t 3 2.79 1.56 E-6 0 7.31 E-6 0 0 7 PM 7 {0,0,,0}t 3 2.87 0.0000170 0 0.0000796 0 0 7 {2,2,,2}t 3 2.79 0.000137 0 0.000642 1.00 E-33 0 7 Problem 2 Consider the following Burgers’ equation selected from : {ut+uux=Duxxu(x,0)=2Dβπsin(πx)α+βcos(πx),0x1u(0,t)=0,t0u(1,t)=0,t0. We use discretization to solve this problem. Let h=baN , and k=TM be the spatial and temporal step sizes respectively, where N and M are numbers of subintervals in x and t directions respectively. Therefore, for this problem we select points (xi,tj) from a grid of domain [0,1]×[0,T] , where, xi=0+ih , i=0,1,,M and tj=0+jk , j=0,1,,N . Let wij be the approximate solution at (xi,tj) . By applying the central differences to ux and uxx , and the backward difference to ut , we get the following nonlinear system: wijwi,j1k+wij(wi+1,jwi1,j2h)=Dh2(wi+1,j2wij+wi1,j). If we let σ=Dkh2 , and zi=wij , then we are trying to solve the following system of equations: Fi(z1,z2,,zM)=zi+k2hzi(zi+1zi1)σ(zi+12zi+zi1)wi,j1=0 . For the unknowns z1,z2,,zM . The last term wi,j1 is known from the previous time step. The first and the last equations in the system can be replaced by using the given boundary conditions. In our problem, the first and the last equations in the system are F1=z1, FM=zM. So, we have M equations with M unknowns. We find the approximate solution of the problem using the proposed method PM 5 at x=0.5 and t=0.2 . To check the effect of the temporal step sizes on the solution, we select different values for k , which means a different number of steps to reach the wanted time. Consider for our problem that the diffusion coefficient D=0.05 , α=5 , and β=4 . The exact solution of the given Burgers’ equation is given by: u(x,t)=2DβπeDπ2tsin(πx)α+βeDπ2tcos(πx). The exact solution for this problem is u(0.5,0.2)=0.2277071734 . Based on spatial step size equals 110 , we choose X0={0.6,0.6,,0.6}10times . Tab. 8 illustrates the numerical results of this problem. The effect of the selected k is clear. The results become better whenever we have a smaller temporal step size. Based on that, we will compare our proposed schemes to the other schemes for h=0.1 and k=0.01 . We compare the approximate solutions at x=0.5 and t=0.2 for n=3 and n=4 , that is X3 and X4 . Also, we find the norms of the functions F(X3) and F(X3) . Finally, we find the norm of the difference between the two consecutive iterations X4X3 for each selected method. Comparisons results are shown in Tab. 9. It is clear that the proposed schemes perform in a good way, and in general, give results which are better than the other selected schemes. Numerical results for Problem <inline-formula id="ieqn-997"> <alternatives><inline-graphic xlink:href="ieqn-997.png"/><tex-math id="tex-ieqn-997"><![CDATA[$2$]]></tex-math><mml:math id="mml-ieqn-997"><mml:mn>2</mml:mn></mml:math> </alternatives></inline-formula> h k n u(0.5,0.2) w(0.5,0.2) Error F(Xn) X4X3 0.1 0.04 3 0.227707 0.227014 0.000693 1.89 E-165 1.59 E-165 0.1 0.04 4 0.227707 0.227014 0.000693 7.06 E-829 0.1 0.02 3 0.227707 0.226946 0.000761 1.10 E-195 2.00 E-195 0.1 0.02 4 0.227707 0.226946 0.000761 1.37 E-980 0.1 0.01 3 0.227707 0.226918 0.000789 6.10 E-229 1.77 E-228 0.1 0.01 4 0.227707 0.226918 0.000789 1.00 E-1147 Comparisons between different methods for Problem <inline-formula id="ieqn-1050"> <alternatives><inline-graphic xlink:href="ieqn-1050.png"/><tex-math id="tex-ieqn-1050"><![CDATA[$2\$]]></tex-math><mml:math id="mml-ieqn-1050"><mml:mn>2</mml:mn></mml:math> </alternatives></inline-formula>
Method X3(0.5,0.2) X4(0.5,0.2) F(X3) F(X4) X4X3
FS 0.2269178 0.2269178 5.51 E-52 8.23 E-158 1.82 E-51
CHMT 5 0.2269178 0.2269178 6.10 E-229 1.00 E-1147 1.39 E-228
MMK 0.2269178 0.2269178 1.60 E-213 3.80 E-1070 5.38 E-213
SG 0.2269178 0.2269178 4.12 E-226 2.74 E-1133 1.18 E-225
PM 5 0.2269178 0.2269178 6.10 E-229 1.00 E-1147 1.77 E-228
CHMT 7 0.2269178 0.2269178 4.51 E-628 0 2.56 E-627
PM 7 0.2269178 0.2269178 4.51 E-628 0 2.56 E-627
Conclusion

In this study, we have proposed an iterative scheme for systems of nonlinear equations of fifth-order of convergence. We have improved the proposed scheme to a generalized scheme of arbitrary odd order. The proposed method is based on Frontini–Sormani iterative method and developed using additional step with the usage of first derivative approximation. The software Mathematica has been used to show the order of convergence of the proposed method. Different comparisons were used to compare our proposed scheme to the other schemes of the same order, including the efficiency index, computational efficiency index, basins of attractions and several numerical problems. Comparisons show that the efficiency index and the computational efficiency index need not be proper tools for the efficiency of the iterative scheme. As an application, we test the proposed method on the mixed Hammerstein integral equation and Burgers’ equation. Comparisons show that the proposed scheme is of excellent performance and overall, it is comparable to the other iterative techniques used in the comparisons regarding the convergence speed, accuracy and the area of convergence in the basins of attraction.

Funding Statement: We are grateful for the financial support from UKM’s research Grant GUP-2019-033.

Conflicts of Interest: The authors declare that they have no conflicts of interest to report regarding the present study.

References J. M. Ortega and W. C. Rheinboldt , Iterative Solution of Nonlinear Equations in Several Variables. Academic Press, New York, NY, USA, 1970. H. Jafari and V. Daftardar-Gejji , “ Revised Adomian decomposition method for solving a system of nonlinear equations,” Applied Mathematics and Computation, vol. 175, no. 1, pp. 17, 2006. D. Kaya and S. M. El-Sayed , “ Adomian’s decomposition method applied to systems of nonlinear algebraic equations,” Applied Mathematics and Computation, vol. 154, no. 2, pp. 487493, 2004. M. Waseem, M. A. Noor and K. I. Noor , “ Efficient method for solving a system of nonlinear equations,” Applied Mathematics and Computation, vol. 275, pp. 134146, 2016. A. Cordero, E. Martnez and J. R. Torregrosa , “ Iterative methods of order four and five for systems of nonlinear equations,” Journal of Computational and Applied Mathematics, vol. 231, no. 2, pp. 541551, 2009. M. T. Darvishi and A. Barati , “ A third-order Newton-type method to solve systems of nonlinear equations,” Applied Mathematics and Computation, vol. 187, no. 2, pp. 630635, 2007. F. Awawdeh , “ On new iterative method for solving systems of nonlinear equations,” Numerical Algorithms, vol. 54, no. 3, pp. 395409, 2010. A. Golbabai and M. Javidi , “ Newton-like iterative methods for solving system of nonlinear equations,” Applied Mathematics and Computation, vol. 192, no. 2, pp. 546551, 2007. M. Grau-Sánchez, A. Grau and M. Noguera , “ On the computational efficiency index and some iterative methods for solving systems of nonlinear equations,” Journal of Computational and Applied Mathematics, vol. 236, no. 6, pp. 12591266, 2011. M. Frontini and E. Sormani , “ Some variants of Newton’s method with third-order convergence,” Applied Mathematics and Computation, vol. 140, no. 2–3, pp. 419426, 2003. S. Weerakoon and T. G. I. Fernando , “ A variant of Newton’s method with accelerated third-order convergence,” Applied Mathematics Letters, vol. 13, no. 8, pp. 8793, 2000. J. Kou, Y. Li and X. Wang , “ A modification of Newton method with third-order convergence,” Applied Mathematics and Computation, vol. 181, no. 2, pp. 11061111, 2006. F. Ahmad, F. Soleymani, F. K. Haghani and S. Serra-Capizzano , “ Higher order derivative-free iterative methods with and without memory for systems of nonlinear equations,” Applied Mathematics and Computation, vol. 314, pp. 199211, 2017. A. Cordero, C. Jordán, E. Sanabria and J. R. Torregrosa , “ A new class of iterative processes for solving nonlinear systems by using one divided differences operator,” Mathematics, vol. 7, no. 9, pp. 776, 2019. J. R. Sharma, D. Kumar and L. Jäntschi , “ On a reduced cost higher order Traub–Steffensen-like method for nonlinear systems,” Symmetry, vol. 11, no. 7, pp. 891, 2019. A. Cordero, J. L. Hueso, E. Martínez and J. R. Torregrosa , “ A modified Newton–Jarratt’s composition,” Numerical Algorithms, vol. 55, no. 1, pp. 8799, 2010. M. U. D. Junjua, S. Akram, N. Yasmin and F. Zafar , “ A new Jarratt-type fourth-order method for solving system of nonlinear equations and applications,” Journal of Applied Mathematics, vol. 2015, no. 2, pp. 114, 2015. A. K. H. Alzahrani, R. Behl and A. S. Alshomrani , “ Some higher-order iteration functions for solving nonlinear models,” Applied Mathematics and Computation, vol. 334, pp. 8093, 2018. R. Behl, D. Sarría, R. González and Á. A. Magreñán , “ Highly efficient family of iterative methods for solving nonlinear models,” Journal of Computational and Applied Mathematics, vol. 346, pp. 110132, 2019. J. R. Sharma and P. Gupta , “ An efficient fifth order method for solving systems of nonlinear equations,” Computers and Mathematics with Applications, vol. 67, no. 3, pp. 591601, 2014. H. Esmaeili and M. Ahmadi , “ An efficient three-step method to solve system of nonlinear equations,” Applied Mathematics and Computation, vol. 266, pp. 10931101, 2015. X. Xiao and H. Yin , “ Achieving higher order of convergence for solving systems of nonlinear equations,” Applied Mathematics and Computation, vol. 311, pp. 251261, 2017. A. Cordero, J. L. Hueso, E. Martínez and J. R. Torregrosa , “ Increasing the convergence order of an iterative method for nonlinear systems,” Applied Mathematics Letters, vol. 25, no. 12, pp. 23692374, 2012. H. H. H. Homeier , “ A modified Newton method with cubic convergence: The multivariate case,” Journal of Computational and Applied Mathematics, vol. 169, no. 1, pp. 161169, 2004. T. Sauer , Numerical Analysis. 2nd ed. Boston, MA, USA: Pearson Education, 2012.