Knowledge

Sanity check

Source đź“ť

306:. For example, in a bank account management application, a sanity check will fail if a withdrawal requests more money than the total account balance rather than allowing the account to go negative (which wouldn't be sane). Another sanity test might be that deposits or purchases correspond to patterns established by historical data—for example, large purchase transactions or ATM withdrawals in foreign locations never before visited by the cardholder may be flagged for confirmation. 239:
as a particular bug fix works as expected without testing the wider functionality of the software. In other words, a sanity test determines whether the intended result of a code change works correctly while a smoke test ensures that nothing else important was broken in the process. Sanity testing and smoke testing avoid wasting time and effort by quickly determining whether an application is too flawed to merit more rigorous
238:
to continue testing further. On the other hand, a distinction is sometimes made that a smoke test is a non-exhaustive test that ascertains whether the most crucial functions of a programme work before proceeding with further testing whereas a sanity test refers to whether specific functionality such
294:
of a function indicated success or failure, and to therefore cease further processing upon failure. This return value is actually often itself the result of a sanity check. For example, if the function attempted to open, write to, and close a file, a sanity check may be used to ensure that it did
225:
which offers "quick, broad, and shallow testing") evaluates the result of a subset of application functionality to determine whether it is possible and reasonable to proceed with further testing of the entire application. Sanity tests may sometimes be used interchangeably with
289:
programme code, usually on arguments to functions or returns therefrom, to see if the answers can be assumed to be correct. The more complicated the routine, the more important that its response be checked. The trivial case is checking to see whether the
27:
is a basic test to quickly evaluate whether a claim or the result of a calculation can possibly be true. It is a simple check to see if the produced material is rational (that the material's creator was thinking rationally, applying
343:
similarly. Rather than a complicated script running a set of unit tests, if this simple programme fails to compile or execute, it proves that the supporting environment likely has a configuration problem that will prevent
348:
code from compiling or executing. But if "Hello world" executes, then any problems experienced with other programmes likely can be attributed to errors in that application's code rather than the environment.
574: 490:
Sammi, Rabia; Masood, Iram; Jabeen, Shunaila (2011). Zain, Jasni Mohamad; Wan Mohd, Wan Maseri bt; El-Qawasmeh, Eyas (eds.). "A Framework to Assure the Quality of Sanity Check Process".
332:. When a computing environment has passed all the sanity checks, it's known as a sane environment for the installation programme to proceed with reasonable expectation of success. 74:, system, calculation, or other analysis, to assure that part of the system or methodology works roughly as expected. This is often prior to a more exhaustive round of testing. 161:
may be used as a sanity check of physical equations: the two sides of any equation must be commensurable or have the same dimensions. A person who has calculated the
188:, comparing to known or similar substances will often yield insight on whether the result is reasonable. For instance, most metals sink in water, so the 1018: 1089: 766: 1127: 1198: 40:
may be checked to perform the test. The advantage of performing an initial sanity test is that of speedily evaluating basic function.
122: 1254: 881: 442: 32:). The point of a sanity test is to rule out certain classes of obviously false results, not to catch every possible error. A 511: 353: 628: 303: 591:
Chasidim, Hadas; Almog, Dani; Sohacheski, Dov Benyomin; Gillenson, Mark Lee; Poston, Robin S.; Mark, Shlomo (2018).
759: 526:
ISTQB® Glossary for the International Software Testing Qualification Board® software testing qualification scheme,
37: 1228: 1203: 1178: 952: 318: 970: 581:(September 18 â€“ 22, 2006). Automated Software Engineering. IEEE Computer Society, Washington, DC, 189–198. 336: 1061: 389: 1168: 937: 893: 889: 877: 873: 869: 865: 340: 110:
738 and calculated 54,464, a quick sanity check could show that this result cannot be true. Consider that
752: 310: 263: 357: 240: 931: 927: 919: 298:
These kinds of sanity checks may be used during development for debugging purposes and also to aid in
1249: 857: 541: 990: 852: 789: 675: 227: 216: 542:"Putting it all in the trunk: incremental software development in the FreeBSD open source project" 148:
An even quicker check is that the product of even and odd numbers is even, whereas 142,135 is odd.
809: 623:(1st ed., with minor revisions. ed.). Newton, Mass.: O'Reilly & Associates. p. 19. 255: 915: 862: 271: 136:
is not 142,135 since 918 is divisible by three but 142,135 is not (digits add up to 16, not a
618: 275: 724: 125:, the result cannot be true, and so the calculated result is incorrect. The correct answer, 1213: 1033: 579:
Proceedings of the 21st IEEE/ACM international Conference on Automated Software Engineering
401: 158: 8: 1218: 799: 329: 654: 465: 416: 326: 295:
not fail on any of these actions—which is a sanity check often ignored by programmers.
88: 1188: 1013: 975: 962: 624: 560: 507: 185: 44: 469: 1071: 1000: 842: 556: 499: 473: 457: 421: 322: 291: 267: 259: 222: 193: 107: 71: 63: 1223: 1173: 1051: 985: 942: 847: 642:
A common programming habit is to ignore the return value from fprintf(stderr, ...
503: 299: 162: 527: 1084: 1046: 1008: 923: 314: 203: 140:). Also, the product must end in the same digit as the product of end-digits: 1243: 1112: 980: 947: 592: 411: 92: 33: 1117: 1023: 817: 251: 99: 206:
will often provide insight on the order of magnitude of an expected value.
144:
but 142,135 does not end in "0" like "40", while the correct answer does:
1208: 1122: 1103: 1056: 1041: 905: 901: 897: 885: 822: 96: 443:"Lessons learned from automating tests for an operations support system" 1099: 166: 744: 700: 833: 361: 244: 170: 48: 461: 1143: 1079: 575:
Using Decision Trees to Predict the Certification Result of a Build
406: 55:
multiplication error, but is a quick and simple method to discover
51:
of the result is divisible by 9 is a sanity test—it will not catch
784: 385: 365: 230:
insofar as both terms denote tests which determine whether it is
189: 137: 590: 250:
Groups of sanity tests are often bundled together for automated
178: 29: 1193: 1183: 1161: 1156: 1151: 910: 43:
In arithmetic, for example, when multiplying by 9, using the
593:"The Unit Test: Facing CICD - Are They Elusive Definitions?" 441:
Fecko, Mariusz A.; Lott, Christopher M. (October 2002).
494:. Communications in Computer and Information Science. 309:
Sanity checks are also performed upon installation of
70:
is a very brief run-through of the functionality of a
530:International Software Testing Qualification Board 254:of functions, libraries, or applications prior to 221:In software development, a sanity test (a form of 489: 121:Since squaring positive integers preserves their 1241: 760: 600:Journal of Information Technology Management 1128:The quick brown fox jumps over the lazy dog 767: 753: 173:may have omitted a factor, since the unit 77: 539: 498:. Berlin, Heidelberg: Springer: 143–150. 492:Software Engineering and Computer Systems 440: 129:is more than 10 times higher than 54,464. 16:Test to check if a hypothesis is rational 285:is to denote checks which are performed 774: 210: 1242: 701:"Inclusive language/en-gb - MediaWiki" 616: 384:, as part of a wider attempt to avoid 192:of most metals should be greater than 748: 339:is often used as a sanity test for a 354:Association for Computing Machinery 313:software code into a new computing 258:development code into a testing or 181:, not power (energy per unit time). 87:A sanity test can refer to various 13: 573:Hassan, A. E. and Zhang, K. 2006. 14: 1266: 450:Software: Practice and Experience 372:in favour of other terms such as 561:10.1046/J.1365-2575.2001.00113.X 356:, and software projects such as 38:back-of-the-envelope calculation 1229:1951 USAF resolution test chart 717: 693: 617:Darwin, Ian F. (January 1991). 368:, discourage use of the phrase 95:devices applied to cross-check 82: 1255:Error detection and correction 668: 647: 610: 584: 567: 533: 520: 483: 434: 321:are met, such as a compatible 1: 620:Checking C programs with lint 427: 1199:"The North Wind and the Sun" 504:10.1007/978-3-642-22203-0_13 7: 981:Trabb Pardo–Knuth algorithm 680:Android Open Source Project 549:Information Systems Journal 395: 243:, but needs more developer 152: 10: 1271: 1179:functions for optimization 938:Snell & Wilcox SW2/SW4 214: 106:If one were to attempt to 1136: 1098: 1070: 1032: 999: 961: 858:EIA 1956 resolution chart 831: 808: 780: 540:Jørgensen, Niels (2001). 47:for 9 to verify that the 991:Just another Perl hacker 853:Indian-head test pattern 790:Reference implementation 281:Another common usage of 217:Smoke testing (software) 971:"Hello, World!" program 810:Artificial intelligence 341:development environment 337:"Hello, World!" program 78:Use in different fields 1209:SMPTE universal leader 916:Philips circle pattern 388:language and increase 272:continuous integration 725:"Twitter Engineering" 676:"Coding with respect" 276:continuous deployment 215:Further information: 1214:EURion constellation 1034:3D computer graphics 402:Certifying algorithm 211:Software development 159:Dimensional analysis 146:918 Ă— 155 = 142,290. 119:490,000 > 54,464. 800:Standard test image 775:Standard test items 317:to ensure that all 186:physical properties 132:In multiplication, 89:orders of magnitude 963:Computer languages 417:Mental calculation 311:stable, production 268:automated building 1237: 1236: 1189:Harvard sentences 1014:Canterbury corpus 705:www.mediawiki.org 513:978-3-642-22203-0 456:(15): 1485–1506. 184:When determining 138:multiple of three 91:and other simple 59:possible errors. 45:divisibility rule 1262: 1250:Software testing 1072:Machine learning 1001:Data compression 843:SMPTE color bars 769: 762: 755: 746: 745: 739: 738: 736: 735: 721: 715: 714: 712: 711: 697: 691: 690: 688: 687: 672: 666: 665: 663: 662: 651: 645: 644: 639: 637: 614: 608: 607: 597: 588: 582: 571: 565: 564: 546: 537: 531: 524: 518: 517: 487: 481: 480: 479:on 17 July 2003. 478: 472:. Archived from 447: 438: 422:Proof of concept 323:operating system 262:version control 223:software testing 199: 177:is a measure of 147: 143: 135: 128: 120: 117: 113: 72:computer program 64:computer science 1270: 1269: 1265: 1264: 1263: 1261: 1260: 1259: 1240: 1239: 1238: 1233: 1224:Webdriver Torso 1174:EICAR test file 1132: 1094: 1066: 1052:Stanford dragon 1028: 995: 986:Man or boy test 957: 943:Telefunken FuBK 848:EBU colour bars 827: 804: 776: 773: 743: 742: 733: 731: 723: 722: 718: 709: 707: 699: 698: 694: 685: 683: 674: 673: 669: 660: 658: 653: 652: 648: 635: 633: 631: 615: 611: 595: 589: 585: 572: 568: 544: 538: 534: 525: 521: 514: 488: 484: 476: 462:10.1002/spe.491 445: 439: 435: 430: 398: 378:coherence check 374:confidence test 300:troubleshooting 219: 213: 204:Fermi estimates 197: 155: 145: 141: 133: 126: 118: 116:700 = 7 Ă— 100 = 115: 111: 102:. For example: 85: 80: 17: 12: 11: 5: 1268: 1258: 1257: 1252: 1235: 1234: 1232: 1231: 1226: 1221: 1216: 1211: 1206: 1201: 1196: 1191: 1186: 1181: 1176: 1171: 1166: 1165: 1164: 1159: 1154: 1146: 1140: 1138: 1134: 1133: 1131: 1130: 1125: 1120: 1115: 1109: 1107: 1096: 1095: 1093: 1092: 1087: 1085:MNIST database 1082: 1076: 1074: 1068: 1067: 1065: 1064: 1059: 1054: 1049: 1047:Stanford bunny 1044: 1038: 1036: 1030: 1029: 1027: 1026: 1024:enwik8, enwik9 1021: 1019:Silesia corpus 1016: 1011: 1009:Calgary corpus 1005: 1003: 997: 996: 994: 993: 988: 983: 978: 973: 967: 965: 959: 958: 956: 955: 950: 945: 940: 935: 913: 908: 860: 855: 850: 845: 839: 837: 829: 828: 826: 825: 820: 814: 812: 806: 805: 803: 802: 797: 792: 787: 781: 778: 777: 772: 771: 764: 757: 749: 741: 740: 716: 692: 667: 655:"Words Matter" 646: 629: 609: 583: 566: 532: 528:ISTQB Glossary 519: 512: 482: 432: 431: 429: 426: 425: 424: 419: 414: 409: 404: 397: 394: 304:runtime errors 288: 212: 209: 208: 207: 201: 198:1000 kg/m 182: 154: 151: 150: 149: 130: 127:738 = 544,644, 84: 81: 79: 76: 15: 9: 6: 4: 3: 2: 1267: 1256: 1253: 1251: 1248: 1247: 1245: 1230: 1227: 1225: 1222: 1220: 1217: 1215: 1212: 1210: 1207: 1205: 1204:"Tom's Diner" 1202: 1200: 1197: 1195: 1192: 1190: 1187: 1185: 1182: 1180: 1177: 1175: 1172: 1170: 1169:"Bad Apple!!" 1167: 1163: 1160: 1158: 1155: 1153: 1150: 1149: 1147: 1145: 1142: 1141: 1139: 1135: 1129: 1126: 1124: 1121: 1119: 1116: 1114: 1113:Etaoin shrdlu 1111: 1110: 1108: 1105: 1101: 1097: 1091: 1088: 1086: 1083: 1081: 1078: 1077: 1075: 1073: 1069: 1063: 1060: 1058: 1055: 1053: 1050: 1048: 1045: 1043: 1040: 1039: 1037: 1035: 1031: 1025: 1022: 1020: 1017: 1015: 1012: 1010: 1007: 1006: 1004: 1002: 998: 992: 989: 987: 984: 982: 979: 977: 974: 972: 969: 968: 966: 964: 960: 954: 951: 949: 948:TVE test card 946: 944: 941: 939: 936: 933: 929: 925: 921: 917: 914: 912: 909: 907: 903: 899: 895: 891: 887: 883: 879: 875: 871: 867: 864: 863:BBC Test Card 861: 859: 856: 854: 851: 849: 846: 844: 841: 840: 838: 835: 830: 824: 821: 819: 816: 815: 813: 811: 807: 801: 798: 796: 793: 791: 788: 786: 783: 782: 779: 770: 765: 763: 758: 756: 751: 750: 747: 730: 726: 720: 706: 702: 696: 681: 677: 671: 656: 650: 643: 632: 630:0-937175-30-7 626: 622: 621: 613: 605: 601: 594: 587: 580: 576: 570: 562: 558: 554: 550: 543: 536: 529: 523: 515: 509: 505: 501: 497: 493: 486: 475: 471: 467: 463: 459: 455: 451: 444: 437: 433: 423: 420: 418: 415: 413: 412:Fermi problem 410: 408: 405: 403: 400: 399: 393: 391: 387: 383: 379: 375: 371: 367: 363: 359: 355: 350: 347: 342: 338: 333: 331: 328: 324: 320: 316: 312: 307: 305: 301: 296: 293: 286: 284: 279: 277: 273: 269: 265: 261: 257: 253: 248: 246: 242: 237: 233: 229: 224: 218: 205: 202: 195: 194:that of water 191: 187: 183: 180: 176: 172: 168: 164: 160: 157: 156: 139: 131: 124: 112:700 < 738, 109: 105: 104: 103: 101: 98: 94: 93:rule-of-thumb 90: 75: 73: 69: 65: 60: 58: 54: 50: 49:sum of digits 46: 41: 39: 35: 34:rule-of-thumb 31: 26: 22: 1118:Hamburgevons 832:Television ( 818:Chinese room 795:Sanity check 794: 732:. Retrieved 728: 719: 708:. Retrieved 704: 695: 684:. Retrieved 682:. 2022-11-16 679: 670: 659:. Retrieved 657:. 2020-11-20 649: 641: 634:. Retrieved 619: 612: 603: 599: 586: 578: 569: 552: 548: 535: 522: 495: 491: 485: 474:the original 453: 449: 436: 381: 380:, or simply 377: 373: 370:sanity check 369: 351: 345: 334: 319:dependencies 308: 297: 292:return value 282: 280: 252:unit testing 249: 235: 231: 220: 174: 165:output of a 100:calculations 97:mathematical 86: 83:Mathematical 67: 61: 56: 52: 42: 24: 21:sanity check 20: 18: 1123:Lorem ipsum 1104:filler text 1057:Utah teapot 1042:Cornell box 823:Turing test 606:(2): 40–54. 390:inclusivity 315:environment 283:sanity test 228:smoke tests 142:8 Ă— 5 = 40, 68:sanity test 25:sanity test 1244:Categories 1100:Typography 734:2023-01-23 710:2023-01-23 686:2023-01-23 661:2023-06-29 555:(4): 321. 428:References 241:QA testing 236:reasonable 169:to be 700 123:inequality 1219:Shakedown 834:test card 636:7 October 362:MediaWiki 330:libraries 302:software 270:, or for 245:debugging 134:918 Ă— 155 1144:3DBenchy 1080:ImageNet 470:16820529 407:Checksum 396:See also 232:possible 153:Physical 932:PM 5644 928:PM 5544 924:PM 5540 920:PM 5538 785:Pangram 729:Twitter 386:ableist 366:Twitter 358:Android 256:merging 190:density 627:  510:  468:  287:within 266:, for 264:branch 179:energy 175:joules 108:square 30:sanity 1194:Lenna 1184:GTUBE 1148:Acid 1137:Other 976:Quine 911:ETP-1 596:(PDF) 577:. In 545:(PDF) 477:(PDF) 466:S2CID 446:(PDF) 260:trunk 163:power 53:every 1090:List 1062:List 953:UEIT 638:2014 625:ISBN 508:ISBN 382:test 364:and 352:The 327:link 325:and 274:and 234:and 114:yet 66:, a 57:many 557:doi 500:doi 496:181 458:doi 346:any 167:car 62:In 36:or 23:or 1246:: 930:, 926:, 922:, 904:, 900:, 896:, 892:, 888:, 884:, 880:, 876:, 872:, 868:, 727:. 703:. 678:. 640:. 604:29 602:. 598:. 553:11 551:. 547:. 506:. 464:. 454:32 452:. 448:. 392:. 376:, 360:, 335:A 278:. 247:. 200:). 196:(~ 171:kJ 19:A 1162:3 1157:2 1152:1 1106:) 1102:( 934:) 918:( 906:X 902:W 898:J 894:H 890:G 886:F 882:E 878:D 874:C 870:B 866:A 836:) 768:e 761:t 754:v 737:. 713:. 689:. 664:. 563:. 559:: 516:. 502:: 460::

Index

sanity
rule-of-thumb
back-of-the-envelope calculation
divisibility rule
sum of digits
computer science
computer program
orders of magnitude
rule-of-thumb
mathematical
calculations
square
inequality
multiple of three
Dimensional analysis
power
car
kJ
energy
physical properties
density
that of water
Fermi estimates
Smoke testing (software)
software testing
smoke tests
QA testing
debugging
unit testing
merging

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑