Knowledge

Monte Carlo algorithm

Source 📝

32: 141:
If there is a procedure for verifying whether the answer given by a Monte Carlo algorithm is correct, and the probability of a correct answer is bounded above zero, then with probability one, running the algorithm repeatedly while testing the answers will eventually give a correct answer. Whether
784:(SO) group of algorithms, where probability is not known in advance and is empirically determined, it is sometimes possible to merge Monte Carlo and such an algorithm "to have both probability bound calculated in advance and a Stochastic Optimization component." "Example of such an algorithm is 367:, but it is not known whether any of these complexity classes is distinct from each other; that is, Monte Carlo algorithms may have more computational power than Las Vegas algorithms, but this has not been proven. Another complexity class, 137:
of Monte Carlo algorithms and never return an incorrect answer. However, they may make random choices as part of their work. As a result, the time taken might vary between runs, even with the same input.
371:, describes decision problems with a polynomial-time Monte Carlo algorithm that is more accurate than flipping a coin but where the error probability cannot necessarily be bounded away from 389:
Randomized algorithms are primarily divided by its two main types, Monte Carlo and Las Vegas, however, these represent only a top of the hierarchy and can be further categorized.
670: 624: 554: 490: 303:. Thus, if the number is prime then the answer is always correct, and if the number is composite then the answer is correct with probability at least 1−(1− 430:
can be used on numerical problems as well, problems where the output is not simple ‘yes’/‘no’, but where one needs to receive a result that is numerical in nature."
751: 705: 590: 731: 270:
For a Monte Carlo algorithm with one-sided errors, the failure probability can be reduced (and the success probability amplified) by running the algorithm
961:
Kudelić, Robert; Ivković, Nikola; Šmaguc, Tamara (2023). Choudrie, Jyoti; Mahalle, Parikshit N.; Perumal, Thinagaran; Joshi, Amit (eds.).
347:
describes problems that can be solved by a Monte Carlo algorithm with a bounded probability of one-sided error: if the correct answer is
713:
Previous table represents a general framework for Monte Carlo and Las Vegas randomized algorithms. Instead of the mathematical symbol
343:
that can be solved by polynomial-time Monte Carlo algorithms with a bounded probability of two-sided errors, and the complexity class
316:
For Monte Carlo decision algorithms with two-sided error, the failure probability may again be reduced by running the algorithm
336: 142:
this process is a Las Vegas algorithm depends on whether halting with probability one is considered to satisfy the definition.
982: 202: 785: 123:, which is well-known around the world as an icon of gambling. The term "Monte Carlo" was first introduced in 1947 by 1128: 1105: 1065: 788:
Monte Carlo." In this way, "drawback of SO has been mitigated, and a confidence in a solution has been established."
75: 53: 46: 766: 426:." "This however should not give a wrong impression and confine these algorithms to such problems—both types of 1148: 762: 770: 643: 597: 527: 463: 1091: 886:
Kudelić, Robert (2016-04-01). "Monte-Carlo randomized algorithm for minimal feedback arc set problem".
774: 801: 109: 40: 962: 807: 781: 410: 151: 57: 1115:
Berman, Kenneth A.; Paul, Jerome L. (2005). "Ch 24. Probabilistic and Randomized Algorithms".
105: 1079: 736: 687: 572: 427: 97: 716: 8: 913: 812: 399: 130: 124: 1049: 925: 868: 797: 154:
is always expected to be correct, this is not the case for Monte Carlo algorithms. For
134: 116: 20: 1124: 1101: 1061: 1022: 978: 860: 321: 422:"Both Las Vegas and Monte Carlo are dealing with decisions, i.e., problems in their 1075: 1014: 970: 895: 872: 850: 761:
Well-known Monte Carlo algorithms include the Solovay–Strassen primality test, the
423: 360: 340: 333: 155: 974: 368: 344: 1087: 1045: 1018: 917: 899: 756: 363:
describes problems solvable by polynomial expected time Las Vegas algorithms.
1142: 1083: 1057: 1026: 1002: 864: 206: 855: 838: 101: 89: 1090:(2001). "Ch 5. Probabilistic Analysis and Randomized Algorithms". 384: 245:
answers from the algorithm are certain to be correct, whereas the
1003:"Ant inspired Monte Carlo algorithm for minimum feedback arc set" 592:(probability which through repeated runs grows sub-exponentially 198:) will be incorrect, or correct, with some bounded probability. 170:-biased Monte Carlo algorithm is always correct when it returns 1120: 1097: 120: 100:
whose output may be incorrect with a certain (typically small)
274:
times. Consider again the Solovay–Strassen algorithm which is
396:
Sherwood—"performant and effective special case of Las Vegas"
757:
Applications in computational number theory and other areas
355:
incorrectly for some instances where the correct answer is
1074: 929:(1987 Special Issue dedicated to Stanislaw Ulam): 125–130. 594:
will inhibit usefulness of the algorithm; typical case is
213:
for prime number inputs; for composite inputs, it answers
287:. One may run this algorithm multiple times returning a 651: 605: 535: 471: 158:, these algorithms are generally classified as either 753:, thus making probabilities in the worst case equal. 739: 719: 690: 646: 600: 575: 530: 466: 960: 186:, others might have no bias; these are said to have 178:-biased algorithm is always correct when it returns 434:Comparison of Las Vegas and Monte Carlo algorithms 745: 725: 699: 664: 618: 584: 548: 484: 351:, the algorithm always says so, but it may answer 1117:Algorithms: Sequential, Parallel, and Distributed 205:is used to determine whether a given number is a 1140: 1044: 837:Karger, David R.; Stein, Clifford (July 1996). 416:Numerical—"numerical approximation Monte Carlo" 385:Classes of Monte Carlo and Las Vegas algorithms 249:answers remain uncertain; this is said to be a 145: 1000: 800:, algorithms used in physical simulation and 413:—"bounded error special case of Monte Carlo" 963:"A Brief Overview of Randomized Algorithms" 839:"A New Approach to the Minimum Cut Problem" 836: 1114: 912: 104:. Two examples of such algorithms are the 1001:Kudelić, Robert; Ivković, Nikola (2019). 918:"The beginning of the Monte Carlo method" 854: 76:Learn how and when to remove this message 39:This article includes a list of general 969:. Singapore: Springer Nature: 651–667. 885: 182:. While this describes algorithms with 1141: 956: 327: 996: 994: 954: 952: 950: 948: 946: 944: 942: 940: 938: 936: 359:. In contrast, the complexity class 299:iterations, and otherwise returning 25: 769:, and certain fast variants of the 665:{\displaystyle <{\tfrac {1}{4}}} 619:{\displaystyle <{\tfrac {1}{2}}} 549:{\displaystyle <{\tfrac {1}{2}}} 499:Certain, or Sherwood probabilistic 485:{\displaystyle <{\tfrac {1}{2}}} 13: 780:For algorithms that are a part of 190:. The answer they provide (either 108:and the Monte Carlo algorithm for 45:it lacks sufficient corresponding 14: 1160: 991: 933: 501:(stronger bound than regular LV) 1007:Expert Systems with Applications 265: 30: 260:-correct false-biased algorithm 203:Solovay–Strassen primality test 150:While the answer returned by a 1060:: Cambridge University Press. 906: 879: 830: 804:based on taking random samples 1: 1100:: MIT Press and McGraw-Hill. 818: 975:10.1007/978-981-99-3761-5_57 823: 146:One-sided vs two-sided error 16:Type of randomized algorithm 7: 791: 767:Miller–Rabin primality test 707:(algorithm type dependent) 516:Probabilistic, certain, or 231:with probability less than 10: 1165: 1093:Introduction to Algorithms 1037: 1019:10.1016/j.eswa.2018.12.021 900:10.1016/j.asoc.2015.12.018 775:computational group theory 763:Baillie–PSW primality test 447:Failure (LV) / Error (MC) 217:with probability at least 18: 313:) = 1−2. 802:computational statistics 320:times and returning the 110:minimum feedback arc set 19:Not to be confused with 808:Atlantic City algorithm 782:Stochastic Optimization 771:Schreier–Sims algorithm 518:Sherwood probabilistic 291:answer if it reaches a 152:deterministic algorithm 115:The name refers to the 60:more precise citations. 967:IOT with Smart Systems 888:Applied Soft Computing 747: 727: 701: 666: 620: 586: 550: 486: 402:—"numerical Las Vegas" 121:Principality of Monaco 106:Karger–Stein algorithm 1149:Randomized algorithms 1123:: Course Technology. 1080:Leiserson, Charles E. 1054:Randomized Algorithms 856:10.1145/234533.234534 748: 746:{\displaystyle \leq } 728: 702: 700:{\displaystyle <1} 667: 621: 587: 585:{\displaystyle <1} 551: 487: 428:randomized algorithms 285:-correct false-biased 94:Monte Carlo algorithm 737: 726:{\displaystyle <} 717: 688: 644: 598: 573: 528: 464: 209:. It always answers 131:Las Vegas algorithms 98:randomized algorithm 1050:Raghavan, Prabhakar 813:Las Vegas algorithm 798:Monte Carlo methods 435: 125:Nicholas Metropolis 926:Los Alamos Science 743: 723: 697: 662: 660: 616: 614: 582: 546: 544: 482: 480: 433: 328:Complexity classes 201:For instance, the 117:Monte Carlo casino 21:Monte Carlo method 1084:Rivest, Ronald L. 1076:Cormen, Thomas H. 984:978-981-99-3761-5 711: 710: 659: 613: 561:Monte Carlo (MC) 543: 479: 341:decision problems 322:majority function 156:decision problems 86: 85: 78: 1156: 1134: 1111: 1096:(2nd ed.). 1071: 1031: 1030: 998: 989: 988: 958: 931: 930: 922: 910: 904: 903: 883: 877: 876: 858: 834: 752: 750: 749: 744: 732: 730: 729: 724: 706: 704: 703: 698: 671: 669: 668: 663: 661: 652: 625: 623: 622: 617: 615: 606: 591: 589: 588: 583: 555: 553: 552: 547: 545: 536: 491: 489: 488: 483: 481: 472: 436: 432: 424:decision version 380: 379: 375: 366: 334:complexity class 324:of the answers. 312: 311: 307: 295:response within 284: 283: 279: 259: 258: 254: 240: 239: 235: 226: 225: 221: 188:two-sided errors 184:one-sided errors 81: 74: 70: 67: 61: 56:this article by 47:inline citations 34: 33: 26: 1164: 1163: 1159: 1158: 1157: 1155: 1154: 1153: 1139: 1138: 1137: 1131: 1108: 1088:Stein, Clifford 1068: 1046:Motwani, Rajeev 1040: 1035: 1034: 999: 992: 985: 959: 934: 920: 911: 907: 884: 880: 835: 831: 826: 821: 794: 759: 738: 735: 734: 718: 715: 714: 689: 686: 685: 650: 645: 642: 641: 604: 599: 596: 595: 574: 571: 570: 534: 529: 526: 525: 470: 465: 462: 461: 452:Las Vegas (LV) 387: 377: 373: 372: 364: 330: 309: 305: 304: 281: 277: 276: 268: 256: 252: 251: 237: 233: 232: 223: 219: 218: 148: 82: 71: 65: 62: 52:Please help to 51: 35: 31: 24: 17: 12: 11: 5: 1162: 1152: 1151: 1136: 1135: 1129: 1112: 1106: 1072: 1066: 1041: 1039: 1036: 1033: 1032: 990: 983: 932: 914:Metropolis, N. 905: 878: 849:(4): 601–640. 828: 827: 825: 822: 820: 817: 816: 815: 810: 805: 793: 790: 758: 755: 742: 733:one could use 722: 709: 708: 696: 693: 683: 682:Probabilistic 680: 677: 673: 672: 658: 655: 649: 639: 638:Probabilistic 636: 633: 632:Atlantic City 629: 628: 612: 609: 603: 581: 578: 568: 567:Probabilistic 565: 562: 558: 557: 542: 539: 533: 523: 520: 514: 510: 509: 506: 503: 497: 493: 492: 478: 475: 469: 459: 456: 455:Probabilistic 453: 449: 448: 445: 442: 439: 420: 419: 418: 417: 414: 405: 404: 403: 397: 386: 383: 365:ZPP ⊆ RP ⊆ BPP 329: 326: 267: 264: 147: 144: 84: 83: 38: 36: 29: 15: 9: 6: 4: 3: 2: 1161: 1150: 1147: 1146: 1144: 1132: 1130:0-534-42057-5 1126: 1122: 1118: 1113: 1109: 1107:0-262-53196-8 1103: 1099: 1095: 1094: 1089: 1085: 1081: 1077: 1073: 1069: 1067:0-521-47465-5 1063: 1059: 1055: 1051: 1047: 1043: 1042: 1028: 1024: 1020: 1016: 1012: 1008: 1004: 997: 995: 986: 980: 976: 972: 968: 964: 957: 955: 953: 951: 949: 947: 945: 943: 941: 939: 937: 928: 927: 919: 915: 909: 901: 897: 893: 889: 882: 874: 870: 866: 862: 857: 852: 848: 844: 840: 833: 829: 814: 811: 809: 806: 803: 799: 796: 795: 789: 787: 783: 778: 776: 772: 768: 764: 754: 740: 720: 694: 691: 684: 681: 678: 675: 674: 656: 653: 647: 640: 637: 634: 631: 630: 627: 610: 607: 601: 579: 576: 569: 566: 563: 560: 559: 540: 537: 531: 524: 521: 519: 515: 512: 511: 507: 504: 502: 498: 495: 494: 476: 473: 467: 460: 457: 454: 451: 450: 446: 443: 440: 438: 437: 431: 429: 425: 415: 412: 411:Atlantic City 409: 408: 406: 401: 398: 395: 394: 392: 391: 390: 382: 370: 362: 358: 354: 350: 346: 342: 338: 335: 325: 323: 319: 314: 302: 298: 294: 290: 286: 273: 266:Amplification 263: 261: 248: 244: 230: 216: 212: 208: 204: 199: 197: 193: 189: 185: 181: 177: 173: 169: 165: 161: 157: 153: 143: 139: 136: 132: 128: 126: 122: 118: 113: 111: 107: 103: 99: 95: 91: 80: 77: 69: 59: 55: 49: 48: 42: 37: 28: 27: 22: 1116: 1092: 1053: 1010: 1006: 966: 924: 908: 891: 887: 881: 846: 842: 832: 786:Ant Inspired 779: 760: 712: 593: 517: 500: 421: 407:Monte Carlo 388: 356: 352: 348: 331: 317: 315: 300: 296: 292: 288: 275: 271: 269: 250: 246: 242: 228: 214: 210: 207:prime number 200: 195: 191: 187: 183: 179: 175: 171: 167: 163: 159: 149: 140: 129: 114: 93: 87: 72: 63: 44: 1013:: 108–117. 894:: 235–246. 441:Efficiency 166:-biased. A 162:-biased or 102:probability 66:August 2011 58:introducing 819:References 676:Numerical 513:Numerical 393:Las Vegas 339:describes 41:references 1027:0957-4174 865:0004-5411 824:Citations 741:≤ 496:Sherwood 400:Numerical 90:computing 1143:Category 1058:New York 1052:(1995). 916:(1987). 792:See also 679:Certain 635:Certain 564:Certain 522:Certain 505:Certain 458:Certain 444:Optimum 241:. Thus, 1038:Sources 873:5385337 376:⁄ 308:⁄ 280:⁄ 255:⁄ 236:⁄ 222:⁄ 119:in the 54:improve 1127:  1121:Boston 1104:  1098:Boston 1064:  1025:  981:  871:  863:  843:J. ACM 765:, the 133:are a 43:, but 921:(PDF) 869:S2CID 556:or 0 353:false 349:false 293:false 289:false 243:false 215:false 196:false 172:false 168:false 160:false 96:is a 1125:ISBN 1102:ISBN 1062:ISBN 1023:ISSN 979:ISBN 861:ISSN 721:< 692:< 648:< 602:< 577:< 532:< 468:< 357:true 332:The 301:true 247:true 229:true 227:and 211:true 192:true 180:true 176:true 174:; a 164:true 135:dual 92:, a 1015:doi 1011:122 971:doi 896:doi 851:doi 773:in 361:ZPP 337:BPP 194:or 88:In 1145:: 1119:. 1086:; 1082:; 1078:; 1056:. 1048:; 1021:. 1009:. 1005:. 993:^ 977:. 965:. 935:^ 923:. 892:41 890:. 867:. 859:. 847:43 845:. 841:. 777:. 626:) 508:0 381:. 369:PP 345:RP 262:. 127:. 112:. 1133:. 1110:. 1070:. 1029:. 1017:: 987:. 973:: 902:. 898:: 875:. 853:: 695:1 657:4 654:1 611:2 608:1 580:1 541:2 538:1 477:2 474:1 378:2 374:1 318:k 310:2 306:1 297:k 282:2 278:1 272:k 257:2 253:1 238:2 234:1 224:2 220:1 79:) 73:( 68:) 64:( 50:. 23:.

Index

Monte Carlo method
references
inline citations
improve
introducing
Learn how and when to remove this message
computing
randomized algorithm
probability
Karger–Stein algorithm
minimum feedback arc set
Monte Carlo casino
Principality of Monaco
Nicholas Metropolis
Las Vegas algorithms
dual
deterministic algorithm
decision problems
Solovay–Strassen primality test
prime number
majority function
complexity class
BPP
decision problems
RP
ZPP
PP
Numerical
Atlantic City
decision version

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑