Knowledge

Minimal residual method

Source 📝

31: 101:
method is essentially a generalization of MINRES for arbitrary matrices. Both minimize the 2-norm of the residual and do the same calculations in exact arithmetic when the matrix is symmetric. MINRES is a short-recurrence method with a constant memory requirement, whereas GMRES requires storing the
1835:
In the case of positive definite matrices, the convergence rate of the MINRES method can be estimated in a way similar to that of the CG method. In contrast to the CG method, however, the estimation does not apply to the errors of the iterates, but to the residual. The following applies:
2133: 1961: 1154: 942: 1676: 407: 619: 2041: 1841: 1824: 1750: 826: 1314: 1234: 1033: 821: 181: 1561: 816: 449: 2205: 2169: 1496: 1447: 220: 678: 498: 102:
whole Krylov space, so its memory requirement is roughly proportional to the number of iterations. On the other hand, GMRES tends to suffer less from loss of orthogonality.
982: 299: 1027: 1992: 645: 271: 1347: 63: 1530: 1401: 1374: 771: 744: 528: 140: 1556: 719:(CR) method was therefore produced below as a substitute. It differs from MINRES in that in MINRES, the columns of a basis of the Krylov space (denoted below by 2229: 2036: 2016: 701: 291: 773:) can be orthogonalized via the Lanczos recursion. There are more efficient and preconditioned variants with fewer AXPYs. Compare with the article. 533: 1754: 1680: 707:, it is possible to carry out this minimization process recursively, storing only two previous steps (short recurrence). This saves memory. 1238: 1158: 1452: 2814: 1406: 704: 2862: 145: 2128:{\displaystyle \kappa (A)={\frac {\left|\lambda _{\text{max}}(A)\right|}{\left|\lambda _{\text{min}}(A)\right|}},} 1956:{\displaystyle \|r_{k}\|\leq 2\left({\frac {{\sqrt {\kappa (A)}}-1}{{\sqrt {\kappa (A)}}+1}}\right)^{k}\|r_{0}\|,} 779: 412: 2174: 2138: 715:
Note: The MINRES method is more complicated than the algebraically equivalent Conjugate Residual method. The
110:
The MINRES method iteratively calculates an approximate solution of a linear system of equations of the form
2830: 190: 113: 1149:{\displaystyle \alpha _{k-1}={\frac {\langle r_{k-1},s_{k-1}\rangle }{\langle s_{k-1},s_{k-1}\rangle }}} 59: 937:{\displaystyle {\begin{aligned}r_{0}&=b-Ax_{0}\\p_{0}&=r_{0}\\s_{0}&=Ap_{0}\end{aligned}}} 654: 1671:{\displaystyle \beta _{k,l}={\frac {\langle s_{k},s_{k-l}\rangle }{\langle s_{k-l},s_{k-l}\rangle }}} 716: 454: 74: 35: 1349:
is smaller than a specified tolerance, the algorithm is interrupted with the approximate solution
949: 992: 1968: 624: 232: 1319: 55: 39: 17: 67: 2846: 1503: 1379: 1352: 749: 722: 506: 78: 8: 1535: 2824: 2214: 2021: 2001: 686: 276: 2810: 402:{\displaystyle V_{k}=x_{0}+\operatorname {span} \{r_{0},Ar_{0}\ldots ,A^{k-1}r_{0}\}} 2789:"Effcient solvers for constrained optimization in parameter identification problems" 2769: 1995: 184: 86: 294: 82: 648: 2856: 223: 2788: 2755: 30: 746:) can be orthogonalized, whereas in CR their images (below labeled with 2208: 38:(blue) and the MINRES method (green). The matrix used comes from a 2D 2773: 2757: 614:{\displaystyle x_{k}:=\mathrm {argmin} _{x\in V_{k}}\|r(x)\|,} 98: 2758:"Solution of sparse indefinite systems of linear equations" 1558:
is not carried out in the first iteration step) calculate:
1819:{\displaystyle s_{k}\leftarrow s_{k}-\beta _{k,l}s_{k-l}} 1745:{\displaystyle p_{k}\leftarrow p_{k}-\beta _{k,l}p_{k-l}} 2234: 1830: 2804: 34:
A comparison of the norm of error and residual in the
2217: 2177: 2141: 2044: 2024: 2004: 1971: 1844: 1757: 1683: 1564: 1538: 1506: 1455: 1409: 1382: 1355: 1322: 1241: 1161: 1036: 995: 952: 824: 782: 752: 725: 689: 657: 627: 536: 509: 457: 415: 302: 279: 235: 193: 148: 116: 2807:
Numerical Methods for Two-phase Incompressible Flows
503:
More precisely, we define the approximate solutions
2756:Christopher C. Paige, Michael A. Saunders (1975). 2223: 2199: 2163: 2127: 2030: 2010: 1986: 1955: 1818: 1744: 1670: 1550: 1524: 1490: 1441: 1395: 1368: 1341: 1309:{\displaystyle r_{k}=r_{k-1}-\alpha _{k-1}s_{k-1}} 1308: 1229:{\displaystyle x_{k}=x_{k-1}+\alpha _{k-1}p_{k-1}} 1228: 1148: 1021: 976: 936: 810: 765: 738: 695: 672: 639: 613: 522: 492: 443: 401: 285: 265: 214: 175: 134: 105: 2854: 176:{\displaystyle A\in \mathbb {R} ^{n\times n}} 77:, the MINRES method does not assume that the 1947: 1934: 1858: 1845: 1662: 1624: 1619: 1587: 1336: 1323: 1140: 1102: 1097: 1059: 634: 628: 605: 590: 396: 335: 811:{\displaystyle x_{0}\in \mathbb {R} ^{n}} 798: 660: 444:{\displaystyle x_{0}\in \mathbb {R} ^{n}} 431: 202: 157: 2200:{\displaystyle \lambda _{\text{min}}(A)} 2164:{\displaystyle \lambda _{\text{max}}(A)} 1491:{\displaystyle s_{k}\leftarrow As_{k-1}} 58:for the iterative solution of symmetric 29: 1442:{\displaystyle p_{k}\leftarrow s_{k-1}} 14: 2855: 2235:Implementation in GNU Octave / MATLAB 1831:Convergence rate of the MINRES method 1376:. Otherwise, a new descent direction 451:is an initial value (often zero) and 215:{\displaystyle b\in \mathbb {R} ^{n}} 2751: 2749: 62:. It was proposed by mathematicians 710: 229:For this, the norm of the residual 92: 24: 2849:, Wolfram MathWorld, Jul 26, 2022. 2794:(Doctoral Thesis). pp. 51–52. 2762:SIAM Journal on Numerical Analysis 567: 564: 561: 558: 555: 552: 25: 2874: 2840: 2746: 2786: 673:{\displaystyle \mathbb {R} ^{n}} 493:{\displaystyle r_{0}:=r(x_{0})} 106:Properties of the MINRES method 2798: 2780: 2194: 2188: 2158: 2152: 2112: 2106: 2083: 2077: 2054: 2048: 1981: 1975: 1910: 1904: 1886: 1880: 1768: 1694: 1466: 1420: 602: 596: 487: 474: 245: 239: 13: 1: 2740: 2805:Sven Gross, Arnold Reusken. 977:{\displaystyle k=1,2,\dots } 89:of the matrix is mandatory. 7: 1022:{\displaystyle x_{k},r_{k}} 683:Because of the symmetry of 73:In contrast to the popular 10: 2879: 1987:{\displaystyle \kappa (A)} 640:{\displaystyle \|\cdot \|} 266:{\displaystyle r(x):=b-Ax} 2809:. section 5.2: Springer. 1342:{\displaystyle \|r_{k}\|} 2863:Numerical linear algebra 2829:: CS1 maint: location ( 2238: 2207:are maximal and minimal 984:in the following steps: 64:Christopher Conway Paige 2847:Minimal Residual Method 60:linear equation systems 48:Minimal Residual Method 2225: 2201: 2165: 2129: 2032: 2012: 1988: 1957: 1820: 1746: 1672: 1552: 1526: 1492: 1443: 1403:is calculated through 1397: 1370: 1343: 1310: 1230: 1150: 1023: 978: 938: 818:arbitrary and compute 812: 767: 740: 697: 674: 641: 615: 524: 494: 445: 403: 287: 267: 216: 177: 136: 56:Krylov subspace method 43: 40:boundary-value problem 2226: 2202: 2166: 2130: 2033: 2013: 1989: 1958: 1821: 1747: 1673: 1553: 1527: 1525:{\displaystyle l=1,2} 1493: 1444: 1398: 1396:{\displaystyle p_{k}} 1371: 1369:{\displaystyle x_{k}} 1344: 1311: 1231: 1151: 1024: 979: 939: 813: 768: 766:{\displaystyle s_{k}} 741: 739:{\displaystyle p_{k}} 698: 675: 642: 616: 525: 523:{\displaystyle x_{k}} 495: 446: 404: 288: 268: 217: 178: 137: 135:{\displaystyle Ax=b,} 68:Michael Alan Saunders 33: 2249:A, b, x0, maxit, tol 2215: 2175: 2139: 2042: 2022: 2002: 1969: 1842: 1755: 1681: 1562: 1536: 1504: 1453: 1407: 1380: 1353: 1320: 1239: 1159: 1034: 993: 950: 946:Then we iterate for 822: 780: 750: 723: 687: 655: 625: 534: 507: 455: 413: 300: 277: 233: 191: 146: 114: 27:Computational method 2038:is normal, we have 1551:{\displaystyle l=2} 409:is minimized. Here 2787:Nifa, M. Naoufal. 2221: 2197: 2161: 2125: 2028: 2008: 1984: 1953: 1816: 1742: 1668: 1548: 1522: 1488: 1439: 1393: 1366: 1339: 1306: 1226: 1146: 1019: 974: 934: 932: 808: 763: 736: 717:Conjugate Residual 693: 670: 637: 611: 520: 490: 441: 399: 283: 263: 212: 173: 132: 44: 2816:978-3-642-19685-0 2224:{\displaystyle A} 2185: 2149: 2120: 2103: 2074: 2031:{\displaystyle A} 2011:{\displaystyle A} 1922: 1913: 1889: 1666: 1144: 776:First you choose 696:{\displaystyle A} 286:{\displaystyle k} 83:positive definite 16:(Redirected from 2870: 2835: 2834: 2828: 2820: 2802: 2796: 2795: 2793: 2784: 2778: 2777: 2753: 2736: 2733: 2730: 2727: 2724: 2721: 2718: 2715: 2712: 2709: 2706: 2703: 2700: 2697: 2694: 2691: 2688: 2685: 2682: 2679: 2676: 2673: 2670: 2667: 2664: 2661: 2658: 2655: 2652: 2649: 2646: 2643: 2640: 2637: 2634: 2631: 2628: 2625: 2622: 2619: 2616: 2613: 2610: 2607: 2604: 2601: 2598: 2595: 2592: 2589: 2586: 2583: 2580: 2577: 2574: 2571: 2568: 2565: 2562: 2559: 2556: 2553: 2550: 2547: 2544: 2541: 2538: 2535: 2532: 2529: 2526: 2523: 2520: 2517: 2514: 2510: 2507: 2504: 2501: 2498: 2495: 2492: 2489: 2486: 2483: 2480: 2477: 2474: 2471: 2468: 2465: 2462: 2459: 2456: 2453: 2450: 2447: 2444: 2441: 2438: 2435: 2432: 2429: 2426: 2423: 2420: 2417: 2414: 2411: 2408: 2405: 2402: 2399: 2396: 2393: 2390: 2387: 2384: 2381: 2378: 2375: 2372: 2369: 2366: 2363: 2360: 2357: 2354: 2351: 2348: 2345: 2342: 2339: 2336: 2333: 2330: 2327: 2324: 2321: 2318: 2315: 2312: 2309: 2306: 2303: 2300: 2297: 2294: 2291: 2288: 2285: 2282: 2279: 2276: 2273: 2270: 2267: 2264: 2261: 2258: 2255: 2252: 2248: 2245: 2242: 2231:, respectively. 2230: 2228: 2227: 2222: 2206: 2204: 2203: 2198: 2187: 2186: 2183: 2170: 2168: 2167: 2162: 2151: 2150: 2147: 2134: 2132: 2131: 2126: 2121: 2119: 2115: 2105: 2104: 2101: 2090: 2086: 2076: 2075: 2072: 2061: 2037: 2035: 2034: 2029: 2017: 2015: 2014: 2009: 1996:condition number 1993: 1991: 1990: 1985: 1962: 1960: 1959: 1954: 1946: 1945: 1933: 1932: 1927: 1923: 1921: 1914: 1900: 1897: 1890: 1876: 1873: 1857: 1856: 1825: 1823: 1822: 1817: 1815: 1814: 1799: 1798: 1780: 1779: 1767: 1766: 1751: 1749: 1748: 1743: 1741: 1740: 1725: 1724: 1706: 1705: 1693: 1692: 1677: 1675: 1674: 1669: 1667: 1665: 1661: 1660: 1642: 1641: 1622: 1618: 1617: 1599: 1598: 1585: 1580: 1579: 1557: 1555: 1554: 1549: 1531: 1529: 1528: 1523: 1497: 1495: 1494: 1489: 1487: 1486: 1465: 1464: 1448: 1446: 1445: 1440: 1438: 1437: 1419: 1418: 1402: 1400: 1399: 1394: 1392: 1391: 1375: 1373: 1372: 1367: 1365: 1364: 1348: 1346: 1345: 1340: 1335: 1334: 1315: 1313: 1312: 1307: 1305: 1304: 1289: 1288: 1270: 1269: 1251: 1250: 1235: 1233: 1232: 1227: 1225: 1224: 1209: 1208: 1190: 1189: 1171: 1170: 1155: 1153: 1152: 1147: 1145: 1143: 1139: 1138: 1120: 1119: 1100: 1096: 1095: 1077: 1076: 1057: 1052: 1051: 1028: 1026: 1025: 1020: 1018: 1017: 1005: 1004: 983: 981: 980: 975: 943: 941: 940: 935: 933: 929: 928: 909: 908: 895: 894: 878: 877: 864: 863: 838: 837: 817: 815: 814: 809: 807: 806: 801: 792: 791: 772: 770: 769: 764: 762: 761: 745: 743: 742: 737: 735: 734: 711:MINRES algorithm 703:, unlike in the 702: 700: 699: 694: 679: 677: 676: 671: 669: 668: 663: 647:is the standard 646: 644: 643: 638: 620: 618: 617: 612: 589: 588: 587: 586: 570: 546: 545: 529: 527: 526: 521: 519: 518: 499: 497: 496: 491: 486: 485: 467: 466: 450: 448: 447: 442: 440: 439: 434: 425: 424: 408: 406: 405: 400: 395: 394: 385: 384: 363: 362: 347: 346: 325: 324: 312: 311: 292: 290: 289: 284: 272: 270: 269: 264: 221: 219: 218: 213: 211: 210: 205: 185:symmetric matrix 182: 180: 179: 174: 172: 171: 160: 141: 139: 138: 133: 93:GMRES vs. MINRES 21: 2878: 2877: 2873: 2872: 2871: 2869: 2868: 2867: 2853: 2852: 2843: 2838: 2822: 2821: 2817: 2803: 2799: 2791: 2785: 2781: 2774:10.1137/0712047 2754: 2747: 2743: 2738: 2737: 2734: 2731: 2728: 2725: 2722: 2719: 2716: 2713: 2710: 2707: 2704: 2701: 2698: 2695: 2692: 2689: 2686: 2683: 2680: 2677: 2674: 2671: 2668: 2665: 2662: 2659: 2656: 2653: 2650: 2647: 2644: 2641: 2638: 2635: 2632: 2629: 2626: 2623: 2620: 2617: 2614: 2611: 2608: 2605: 2602: 2599: 2596: 2593: 2590: 2587: 2584: 2581: 2578: 2575: 2572: 2569: 2566: 2563: 2560: 2557: 2554: 2551: 2548: 2545: 2542: 2539: 2536: 2533: 2530: 2527: 2524: 2521: 2518: 2515: 2512: 2508: 2505: 2502: 2499: 2496: 2493: 2490: 2487: 2484: 2481: 2478: 2475: 2472: 2469: 2466: 2463: 2460: 2457: 2454: 2451: 2448: 2445: 2442: 2439: 2436: 2433: 2430: 2427: 2424: 2421: 2418: 2415: 2412: 2409: 2406: 2403: 2400: 2397: 2394: 2391: 2388: 2385: 2382: 2379: 2376: 2373: 2370: 2367: 2364: 2361: 2358: 2355: 2352: 2349: 2346: 2343: 2340: 2337: 2334: 2331: 2328: 2325: 2322: 2319: 2316: 2313: 2310: 2307: 2304: 2301: 2298: 2295: 2292: 2289: 2286: 2283: 2280: 2277: 2274: 2271: 2268: 2265: 2262: 2259: 2256: 2253: 2250: 2246: 2243: 2240: 2237: 2216: 2213: 2212: 2182: 2178: 2176: 2173: 2172: 2146: 2142: 2140: 2137: 2136: 2100: 2096: 2095: 2091: 2071: 2067: 2066: 2062: 2060: 2043: 2040: 2039: 2023: 2020: 2019: 2003: 2000: 1999: 1970: 1967: 1966: 1941: 1937: 1928: 1899: 1898: 1875: 1874: 1872: 1868: 1867: 1852: 1848: 1843: 1840: 1839: 1833: 1828: 1804: 1800: 1788: 1784: 1775: 1771: 1762: 1758: 1756: 1753: 1752: 1730: 1726: 1714: 1710: 1701: 1697: 1688: 1684: 1682: 1679: 1678: 1650: 1646: 1631: 1627: 1623: 1607: 1603: 1594: 1590: 1586: 1584: 1569: 1565: 1563: 1560: 1559: 1537: 1534: 1533: 1505: 1502: 1501: 1476: 1472: 1460: 1456: 1454: 1451: 1450: 1427: 1423: 1414: 1410: 1408: 1405: 1404: 1387: 1383: 1381: 1378: 1377: 1360: 1356: 1354: 1351: 1350: 1330: 1326: 1321: 1318: 1317: 1294: 1290: 1278: 1274: 1259: 1255: 1246: 1242: 1240: 1237: 1236: 1214: 1210: 1198: 1194: 1179: 1175: 1166: 1162: 1160: 1157: 1156: 1128: 1124: 1109: 1105: 1101: 1085: 1081: 1066: 1062: 1058: 1056: 1041: 1037: 1035: 1032: 1031: 1013: 1009: 1000: 996: 994: 991: 990: 951: 948: 947: 931: 930: 924: 920: 910: 904: 900: 897: 896: 890: 886: 879: 873: 869: 866: 865: 859: 855: 839: 833: 829: 825: 823: 820: 819: 802: 797: 796: 787: 783: 781: 778: 777: 757: 753: 751: 748: 747: 730: 726: 724: 721: 720: 713: 688: 685: 684: 664: 659: 658: 656: 653: 652: 626: 623: 622: 582: 578: 571: 551: 550: 541: 537: 535: 532: 531: 514: 510: 508: 505: 504: 481: 477: 462: 458: 456: 453: 452: 435: 430: 429: 420: 416: 414: 411: 410: 390: 386: 374: 370: 358: 354: 342: 338: 320: 316: 307: 303: 301: 298: 297: 295:Krylov subspace 278: 275: 274: 234: 231: 230: 206: 201: 200: 192: 189: 188: 161: 156: 155: 147: 144: 143: 115: 112: 111: 108: 95: 28: 23: 22: 15: 12: 11: 5: 2876: 2866: 2865: 2851: 2850: 2842: 2841:External links 2839: 2837: 2836: 2815: 2797: 2779: 2768:(4): 617–629. 2744: 2742: 2739: 2239: 2236: 2233: 2220: 2196: 2193: 2190: 2181: 2160: 2157: 2154: 2145: 2124: 2118: 2114: 2111: 2108: 2099: 2094: 2089: 2085: 2082: 2079: 2070: 2065: 2059: 2056: 2053: 2050: 2047: 2027: 2007: 1983: 1980: 1977: 1974: 1952: 1949: 1944: 1940: 1936: 1931: 1926: 1920: 1917: 1912: 1909: 1906: 1903: 1896: 1893: 1888: 1885: 1882: 1879: 1871: 1866: 1863: 1860: 1855: 1851: 1847: 1832: 1829: 1827: 1826: 1813: 1810: 1807: 1803: 1797: 1794: 1791: 1787: 1783: 1778: 1774: 1770: 1765: 1761: 1739: 1736: 1733: 1729: 1723: 1720: 1717: 1713: 1709: 1704: 1700: 1696: 1691: 1687: 1664: 1659: 1656: 1653: 1649: 1645: 1640: 1637: 1634: 1630: 1626: 1621: 1616: 1613: 1610: 1606: 1602: 1597: 1593: 1589: 1583: 1578: 1575: 1572: 1568: 1547: 1544: 1541: 1521: 1518: 1515: 1512: 1509: 1498: 1485: 1482: 1479: 1475: 1471: 1468: 1463: 1459: 1436: 1433: 1430: 1426: 1422: 1417: 1413: 1390: 1386: 1363: 1359: 1338: 1333: 1329: 1325: 1303: 1300: 1297: 1293: 1287: 1284: 1281: 1277: 1273: 1268: 1265: 1262: 1258: 1254: 1249: 1245: 1223: 1220: 1217: 1213: 1207: 1204: 1201: 1197: 1193: 1188: 1185: 1182: 1178: 1174: 1169: 1165: 1142: 1137: 1134: 1131: 1127: 1123: 1118: 1115: 1112: 1108: 1104: 1099: 1094: 1091: 1088: 1084: 1080: 1075: 1072: 1069: 1065: 1061: 1055: 1050: 1047: 1044: 1040: 1016: 1012: 1008: 1003: 999: 986: 973: 970: 967: 964: 961: 958: 955: 927: 923: 919: 916: 913: 911: 907: 903: 899: 898: 893: 889: 885: 882: 880: 876: 872: 868: 867: 862: 858: 854: 851: 848: 845: 842: 840: 836: 832: 828: 827: 805: 800: 795: 790: 786: 760: 756: 733: 729: 712: 709: 692: 667: 662: 649:Euclidean norm 636: 633: 630: 610: 607: 604: 601: 598: 595: 592: 585: 581: 577: 574: 569: 566: 563: 560: 557: 554: 549: 544: 540: 517: 513: 489: 484: 480: 476: 473: 470: 465: 461: 438: 433: 428: 423: 419: 398: 393: 389: 383: 380: 377: 373: 369: 366: 361: 357: 353: 350: 345: 341: 337: 334: 331: 328: 323: 319: 315: 310: 306: 282: 262: 259: 256: 253: 250: 247: 244: 241: 238: 209: 204: 199: 196: 170: 167: 164: 159: 154: 151: 131: 128: 125: 122: 119: 107: 104: 94: 91: 26: 9: 6: 4: 3: 2: 2875: 2864: 2861: 2860: 2858: 2848: 2845: 2844: 2832: 2826: 2818: 2812: 2808: 2801: 2790: 2783: 2775: 2771: 2767: 2763: 2759: 2752: 2750: 2745: 2232: 2218: 2210: 2191: 2179: 2155: 2143: 2122: 2116: 2109: 2097: 2092: 2087: 2080: 2068: 2063: 2057: 2051: 2045: 2025: 2005: 1997: 1978: 1972: 1963: 1950: 1942: 1938: 1929: 1924: 1918: 1915: 1907: 1901: 1894: 1891: 1883: 1877: 1869: 1864: 1861: 1853: 1849: 1837: 1811: 1808: 1805: 1801: 1795: 1792: 1789: 1785: 1781: 1776: 1772: 1763: 1759: 1737: 1734: 1731: 1727: 1721: 1718: 1715: 1711: 1707: 1702: 1698: 1689: 1685: 1657: 1654: 1651: 1647: 1643: 1638: 1635: 1632: 1628: 1614: 1611: 1608: 1604: 1600: 1595: 1591: 1581: 1576: 1573: 1570: 1566: 1545: 1542: 1539: 1519: 1516: 1513: 1510: 1507: 1499: 1483: 1480: 1477: 1473: 1469: 1461: 1457: 1449: 1434: 1431: 1428: 1424: 1415: 1411: 1388: 1384: 1361: 1357: 1331: 1327: 1301: 1298: 1295: 1291: 1285: 1282: 1279: 1275: 1271: 1266: 1263: 1260: 1256: 1252: 1247: 1243: 1221: 1218: 1215: 1211: 1205: 1202: 1199: 1195: 1191: 1186: 1183: 1180: 1176: 1172: 1167: 1163: 1135: 1132: 1129: 1125: 1121: 1116: 1113: 1110: 1106: 1092: 1089: 1086: 1082: 1078: 1073: 1070: 1067: 1063: 1053: 1048: 1045: 1042: 1038: 1014: 1010: 1006: 1001: 997: 988: 987: 985: 971: 968: 965: 962: 959: 956: 953: 944: 925: 921: 917: 914: 912: 905: 901: 891: 887: 883: 881: 874: 870: 860: 856: 852: 849: 846: 843: 841: 834: 830: 803: 793: 788: 784: 774: 758: 754: 731: 727: 718: 708: 706: 690: 681: 665: 650: 631: 608: 599: 593: 583: 579: 575: 572: 547: 542: 538: 515: 511: 501: 482: 478: 471: 468: 463: 459: 436: 426: 421: 417: 391: 387: 381: 378: 375: 371: 367: 364: 359: 355: 351: 348: 343: 339: 332: 329: 326: 321: 317: 313: 308: 304: 296: 293:-dimensional 280: 260: 257: 254: 251: 248: 242: 236: 227: 225: 207: 197: 194: 186: 168: 165: 162: 152: 149: 129: 126: 123: 120: 117: 103: 100: 90: 88: 84: 80: 76: 71: 69: 65: 61: 57: 53: 49: 41: 37: 32: 19: 2806: 2800: 2782: 2765: 2761: 1964: 1838: 1834: 1030: 945: 775: 714: 705:GMRES method 682: 502: 228: 109: 96: 72: 51: 47: 45: 2209:eigenvalues 85:, only the 2741:References 2018:. Because 1998:of matrix 1532:(the step 2825:cite book 2180:λ 2144:λ 2098:λ 2069:λ 2046:κ 1973:κ 1948:‖ 1935:‖ 1902:κ 1892:− 1878:κ 1862:≤ 1859:‖ 1846:‖ 1809:− 1786:β 1782:− 1769:← 1735:− 1712:β 1708:− 1695:← 1663:⟩ 1655:− 1636:− 1625:⟨ 1620:⟩ 1612:− 1588:⟨ 1567:β 1481:− 1467:← 1432:− 1421:← 1337:‖ 1324:‖ 1299:− 1283:− 1276:α 1272:− 1264:− 1219:− 1203:− 1196:α 1184:− 1141:⟩ 1133:− 1114:− 1103:⟨ 1098:⟩ 1090:− 1071:− 1060:⟨ 1046:− 1039:α 972:… 850:− 794:∈ 635:‖ 632:⋅ 629:‖ 606:‖ 591:‖ 576:∈ 427:∈ 379:− 365:… 333:⁡ 255:− 198:∈ 166:× 153:∈ 75:CG method 70:in 1975. 36:CG method 2857:Category 2244:= minres 2241:function 1029:through 989:Compute 530:through 87:symmetry 1994:is the 2813:  2672:'* 2657:'* 2579:'* 2564:'* 2500:'* 2434:'* 2419:'* 2135:where 1965:where 621:where 224:vector 142:where 79:matrix 52:MINRES 18:MINRES 2792:(PDF) 2717:beta2 2693:beta2 2648:beta2 2624:beta1 2600:beta1 2555:beta1 2519:break 2479:alpha 2455:alpha 2410:alpha 2359:maxit 273:in a 183:is a 99:GMRES 54:is a 2831:link 2811:ISBN 2642:> 2639:iter 2506:< 2347:iter 2171:and 1500:for 330:span 187:and 97:The 66:and 46:The 2770:doi 2735:end 2732:end 2729:end 2522:end 2509:tol 2344:for 2211:of 2184:min 2148:max 2102:min 2073:max 1316:if 651:on 81:is 50:or 2859:: 2827:}} 2823:{{ 2766:12 2764:. 2760:. 2748:^ 2723:s2 2711:s0 2705:s0 2699:p2 2687:p0 2681:p0 2678:); 2675:s2 2669:s2 2660:s2 2654:s0 2636:if 2630:s1 2618:s0 2612:s0 2606:p1 2594:p0 2588:p0 2585:); 2582:s1 2576:s1 2567:s1 2561:s0 2549:s1 2537:s0 2531:s1 2525:p0 2491:if 2485:s1 2461:p1 2440:); 2437:s1 2431:s1 2422:s1 2404:s0 2398:s1 2392:s1 2386:s2 2380:p0 2374:p1 2368:p1 2362:p2 2338:s0 2332:s1 2326:p0 2320:p1 2314:p0 2302:s0 2290:p0 2284:x0 2260:x0 680:. 548::= 500:. 469::= 249::= 226:. 222:a 2833:) 2819:. 2776:. 2772:: 2726:; 2720:* 2714:- 2708:= 2702:; 2696:* 2690:- 2684:= 2666:( 2663:/ 2651:= 2645:1 2633:; 2627:* 2621:- 2615:= 2609:; 2603:* 2597:- 2591:= 2573:( 2570:/ 2558:= 2552:; 2546:* 2543:A 2540:= 2534:; 2528:= 2516:) 2513:2 2511:^ 2503:r 2497:r 2494:( 2488:; 2482:* 2476:- 2473:r 2470:= 2467:r 2464:; 2458:* 2452:+ 2449:x 2446:= 2443:x 2428:( 2425:/ 2416:r 2413:= 2407:; 2401:= 2395:; 2389:= 2383:; 2377:= 2371:; 2365:= 2356:: 2353:1 2350:= 2341:; 2335:= 2329:; 2323:= 2317:; 2311:* 2308:A 2305:= 2299:; 2296:r 2293:= 2287:; 2281:* 2278:A 2275:- 2272:b 2269:= 2266:r 2263:; 2257:= 2254:x 2251:) 2247:( 2219:A 2195:) 2192:A 2189:( 2159:) 2156:A 2153:( 2123:, 2117:| 2113:) 2110:A 2107:( 2093:| 2088:| 2084:) 2081:A 2078:( 2064:| 2058:= 2055:) 2052:A 2049:( 2026:A 2006:A 1982:) 1979:A 1976:( 1951:, 1943:0 1939:r 1930:k 1925:) 1919:1 1916:+ 1911:) 1908:A 1905:( 1895:1 1887:) 1884:A 1881:( 1870:( 1865:2 1854:k 1850:r 1812:l 1806:k 1802:s 1796:l 1793:, 1790:k 1777:k 1773:s 1764:k 1760:s 1738:l 1732:k 1728:p 1722:l 1719:, 1716:k 1703:k 1699:p 1690:k 1686:p 1658:l 1652:k 1648:s 1644:, 1639:l 1633:k 1629:s 1615:l 1609:k 1605:s 1601:, 1596:k 1592:s 1582:= 1577:l 1574:, 1571:k 1546:2 1543:= 1540:l 1520:2 1517:, 1514:1 1511:= 1508:l 1484:1 1478:k 1474:s 1470:A 1462:k 1458:s 1435:1 1429:k 1425:s 1416:k 1412:p 1389:k 1385:p 1362:k 1358:x 1332:k 1328:r 1302:1 1296:k 1292:s 1286:1 1280:k 1267:1 1261:k 1257:r 1253:= 1248:k 1244:r 1222:1 1216:k 1212:p 1206:1 1200:k 1192:+ 1187:1 1181:k 1177:x 1173:= 1168:k 1164:x 1136:1 1130:k 1126:s 1122:, 1117:1 1111:k 1107:s 1093:1 1087:k 1083:s 1079:, 1074:1 1068:k 1064:r 1054:= 1049:1 1043:k 1015:k 1011:r 1007:, 1002:k 998:x 969:, 966:2 963:, 960:1 957:= 954:k 926:0 922:p 918:A 915:= 906:0 902:s 892:0 888:r 884:= 875:0 871:p 861:0 857:x 853:A 847:b 844:= 835:0 831:r 804:n 799:R 789:0 785:x 759:k 755:s 732:k 728:p 691:A 666:n 661:R 609:, 603:) 600:x 597:( 594:r 584:k 580:V 573:x 568:n 565:i 562:m 559:g 556:r 553:a 543:k 539:x 516:k 512:x 488:) 483:0 479:x 475:( 472:r 464:0 460:r 437:n 432:R 422:0 418:x 397:} 392:0 388:r 382:1 376:k 372:A 368:, 360:0 356:r 352:A 349:, 344:0 340:r 336:{ 327:+ 322:0 318:x 314:= 309:k 305:V 281:k 261:x 258:A 252:b 246:) 243:x 240:( 237:r 208:n 203:R 195:b 169:n 163:n 158:R 150:A 130:, 127:b 124:= 121:x 118:A 42:. 20:)

Index

MINRES

CG method
boundary-value problem
Krylov subspace method
linear equation systems
Christopher Conway Paige
Michael Alan Saunders
CG method
matrix
positive definite
symmetry
GMRES
symmetric matrix
vector
Krylov subspace
Euclidean norm
GMRES method
Conjugate Residual
condition number
eigenvalues


"Solution of sparse indefinite systems of linear equations"
doi
10.1137/0712047
"Effcient solvers for constrained optimization in parameter identification problems"
ISBN
978-3-642-19685-0
cite book

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.