# American Institute of Mathematical Sciences

December  2020, 10(4): 463-474. doi: 10.3934/naco.2020045

## Convergence of a randomized Douglas-Rachford method for linear system

 School of Mathematical Sciences, Key Laboratory for NSLSCS of Jiangsu Province, Nanjing Normal University, Nanjing, 210023, China

Received  March 2020 Revised  September 2020 Published  September 2020

Fund Project: The research of the second author is partially supported by the NSFC grants 11871279, 11571178

In this article, we propose a randomized Douglas-Rachford(DR) method for linear system. This algorithm is based on the cyclic DR method. We consider a linear system as a feasible problem of finding intersection of hyperplanes. In each iteration, the next iteration point is determined by a random DR operator. We prove the convergence of the iteration points based on expectation. And the variance of the iteration points declines to zero. The numerical experiment shows that the proposed algorithm performs better than the cyclic DR method.

Citation: Leyu Hu, Xingju Cai. Convergence of a randomized Douglas-Rachford method for linear system. Numerical Algebra, Control & Optimization, 2020, 10 (4) : 463-474. doi: 10.3934/naco.2020045
##### References:

show all references

##### References:
Comparison of number of projections/reflections between randomized Kaczmarz(RK), cyclic DR(CDR) and randomized DR(RDR) when the size of $A$ and $b$ is $m = 1000$ and $n = 100$
Number of Projections/Reflections(NPR) for $n = 50$
 $m$ $1000$ $2000$ $3000$ $4000$ $5000$ NPR CDR 1264 1404 1282 1488 1390 RK 725.3 701.1 696.1 671.3 683.8 RDR 705.2 683.8 696 669.6 698.8
 $m$ $1000$ $2000$ $3000$ $4000$ $5000$ NPR CDR 1264 1404 1282 1488 1390 RK 725.3 701.1 696.1 671.3 683.8 RDR 705.2 683.8 696 669.6 698.8
Number of Projections/Reflections(NPR) for $n = 100$
 $m$ $1000$ $2000$ $3000$ $4000$ $5000$ NPR CDR 2620 2604 2692 2770 2770 RK 1508.4 1419 1425.5 1422.5 1395.1 RDR 1523.2 1425.8 1409.6 1421.4 1381.8
 $m$ $1000$ $2000$ $3000$ $4000$ $5000$ NPR CDR 2620 2604 2692 2770 2770 RK 1508.4 1419 1425.5 1422.5 1395.1 RDR 1523.2 1425.8 1409.6 1421.4 1381.8
Number of Projections/Reflections(NPR) for $n = 150$
 $m$ $1000$ $2000$ $3000$ $4000$ $5000$ NPR CDR 4272 4286 4104 4096 3854 RK 2466.9 2194.4 2175.4 2092.1 2152 RDR 2574.2 2227.8 2160.8 2133 2113.8
 $m$ $1000$ $2000$ $3000$ $4000$ $5000$ NPR CDR 4272 4286 4104 4096 3854 RK 2466.9 2194.4 2175.4 2092.1 2152 RDR 2574.2 2227.8 2160.8 2133 2113.8
 [1] Jiulong Liu, Nanguang Chen, Hui Ji. Learnable Douglas-Rachford iteration and its applications in DOT imaging. Inverse Problems & Imaging, 2020, 14 (4) : 683-700. doi: 10.3934/ipi.2020031 [2] Yixuan Yang, Yuchao Tang, Meng Wen, Tieyong Zeng. Preconditioned Douglas-Rachford type primal-dual method for solving composite monotone inclusion problems with applications. Inverse Problems & Imaging, 2021, 15 (4) : 787-825. doi: 10.3934/ipi.2021014 [3] Tahereh Salimi Siahkolaei, Davod Khojasteh Salkuyeh. A preconditioned SSOR iteration method for solving complex symmetric system of linear equations. Numerical Algebra, Control & Optimization, 2019, 9 (4) : 483-492. doi: 10.3934/naco.2019033 [4] Jahnabi Chakravarty, Ashiho Athikho, Manideepa Saha. Convergence of interval AOR method for linear interval equations. Numerical Algebra, Control & Optimization, 2021  doi: 10.3934/naco.2021006 [5] Zhong-Zhi Bai. On convergence of the inner-outer iteration method for computing PageRank. Numerical Algebra, Control & Optimization, 2012, 2 (4) : 855-862. doi: 10.3934/naco.2012.2.855 [6] Raphael Kruse, Yue Wu. A randomized Milstein method for stochastic differential equations with non-differentiable drift coefficients. Discrete & Continuous Dynamical Systems - B, 2019, 24 (8) : 3475-3502. doi: 10.3934/dcdsb.2018253 [7] Yves Bourgault, Damien Broizat, Pierre-Emmanuel Jabin. Convergence rate for the method of moments with linear closure relations. Kinetic & Related Models, 2015, 8 (1) : 1-27. doi: 10.3934/krm.2015.8.1 [8] Olivier Bokanowski, Maurizio Falcone, Roberto Ferretti, Lars Grüne, Dante Kalise, Hasnaa Zidani. Value iteration convergence of $\epsilon$-monotone schemes for stationary Hamilton-Jacobi equations. Discrete & Continuous Dynamical Systems, 2015, 35 (9) : 4041-4070. doi: 10.3934/dcds.2015.35.4041 [9] Mehdi Bastani, Davod Khojasteh Salkuyeh. On the GSOR iteration method for image restoration. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 27-43. doi: 10.3934/naco.2020013 [10] Purnima Pandit. Fuzzy system of linear equations. Conference Publications, 2013, 2013 (special) : 619-627. doi: 10.3934/proc.2013.2013.619 [11] Yu-Ning Yang, Su Zhang. On linear convergence of projected gradient method for a class of affine rank minimization problems. Journal of Industrial & Management Optimization, 2016, 12 (4) : 1507-1519. doi: 10.3934/jimo.2016.12.1507 [12] Wei-Zhe Gu, Li-Yong Lu. The linear convergence of a derivative-free descent method for nonlinear complementarity problems. Journal of Industrial & Management Optimization, 2017, 13 (2) : 531-548. doi: 10.3934/jimo.2016030 [13] Parikshit Upadhyaya, Elias Jarlebring, Emanuel H. Rubensson. A density matrix approach to the convergence of the self-consistent field iteration. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 99-115. doi: 10.3934/naco.2020018 [14] Jiangxing Wang. Convergence analysis of an accurate and efficient method for nonlinear Maxwell's equations. Discrete & Continuous Dynamical Systems - B, 2021, 26 (5) : 2429-2440. doi: 10.3934/dcdsb.2020185 [15] Su-Hong Jiang, Min Li. A modified strictly contractive peaceman-rachford splitting method for multi-block separable convex programming. Journal of Industrial & Management Optimization, 2018, 14 (1) : 397-412. doi: 10.3934/jimo.2017052 [16] Liu Liu. Uniform spectral convergence of the stochastic Galerkin method for the linear semiconductor Boltzmann equation with random inputs and diffusive scaling. Kinetic & Related Models, 2018, 11 (5) : 1139-1156. doi: 10.3934/krm.2018044 [17] Nizami A. Gasilov. Solving a system of linear differential equations with interval coefficients. Discrete & Continuous Dynamical Systems - B, 2021, 26 (5) : 2739-2747. doi: 10.3934/dcdsb.2020203 [18] Michela Eleuteri, Pavel Krejčí. An asymptotic convergence result for a system of partial differential equations with hysteresis. Communications on Pure & Applied Analysis, 2007, 6 (4) : 1131-1143. doi: 10.3934/cpaa.2007.6.1131 [19] Saeed Ketabchi, Hossein Moosaei, M. Parandegan, Hamidreza Navidi. Computing minimum norm solution of linear systems of equations by the generalized Newton method. Numerical Algebra, Control & Optimization, 2017, 7 (2) : 113-119. doi: 10.3934/naco.2017008 [20] Z. K. Eshkuvatov, M. Kammuji, Bachok M. Taib, N. M. A. Nik Long. Effective approximation method for solving linear Fredholm-Volterra integral equations. Numerical Algebra, Control & Optimization, 2017, 7 (1) : 77-88. doi: 10.3934/naco.2017004

Impact Factor: