Knowledge

Law of comparative judgment

Source 📝

32:, such as the weights of objects, and comparisons of the extremity of an attitude expressed within statements, such as statements about capital punishment. The measurements represent how we perceive entities, rather than measurements of actual physical properties. This kind of measurement is the focus of 996:
estimation. With this in mind, the specification of uniform discriminal dispersions is equivalent to the requirement of parallel Item Characteristic Curves (ICCs) in the Rasch model. Accordingly, as shown by Andrich (1978), the Rasch model should, in principle, yield essentially the same results as
82:
and handwriting specimens, in pairs. He soon extended the domain of application of the law of comparative judgment to things that have no obvious physical counterpart, such as attitudes and values (Thurstone, 1929). For example, in one experiment, people compared statements about capital punishment
136:
Thurstone stated Weber's law as follows: "The stimulus increase which is correctly discriminated in any specified proportion of attempts (except 0 and 100 per cent) is a constant fraction of the stimulus magnitude" (Thurstone, 1959, p. 61). He considered that Weber's law said nothing directly
124:
the discriminal dispersions associated with stimuli are constant (as in Case 5 of the LCJ outlined below), then Weber's law will also be verified. He considered that the Weber-Fechner law and the LCJ both involve a linear measurement on a psychological continuum whereas Weber's law does not.
128:
Weber's law essentially states that how much people perceive physical stimulus intensity to change depends on that intensity. For example, if someone compares a light object of 1 kg with one slightly heavier, one notices a relatively small difference, perhaps when the second object is
108:. It represents a general theoretical model which, applied in a particular empirical context, constitutes a scientific hypothesis regarding the outcomes of comparisons between some collection of objects. If data agree with the model, it is possible to produce a scale from the data. 93:. For example, suppose that someone wishes to measure the perceived weights of a series of five objects of varying masses. By having people compare the weights of the objects in pairs, data can be obtained and the law of comparative judgment applied to estimate scale values of the 129:
1.2 kg. On the other hand, if someone compares a heavy object of 30 kg with a second, the second must be quite a bit larger for a person to notice the difference, perhaps when the second object is 36 kg. People tend to perceive differences that are
572:
Thurstone specified five particular cases of the 'law', or measurement model. An important case of the model is Case 5, in which the discriminal dispersions are specified to be uniform and uncorrelated. This form of the model can be represented as follows:
162:. Accordingly, from the point of view of Thurstone's approach, treating the JND as a unit is justifiable provided only that the discriminal dispersions are uniform for all stimuli considered in a given experimental context. Similar issues are associated with 120:, which are sometimes (and misleadingly) regarded as one and the same, are independent, in the sense that one may be applicable but not the other to a given collection of experimental data. In particular, Thurstone showed that if Fechner's law applies 173:
involve a physical stimulus, whereas the other 'laws' do. Another key difference is that Weber's law and the LCJ involve proportions of comparisons in which one stimulus is judged greater than another whereas the so-called Weber-Fechner law does not.
318: 137:
about sensation intensities at all. In terms of Thurstone's conceptual framework, the association posited between perceived stimulus intensity and the physical magnitude of the stimulus in the Weber-Fechner law will only hold when Weber's law holds
563:
of such values. Thurstone (1959, p. 20) used the term discriminal process to refer to the "psychological values of psychophysics"; that is, the values on a psychological continuum associated with a given stimulus.
712: 157:
in order to ascertain whether specific theoretical criteria for measurement have been satisfied. Some of the relevant criteria were articulated by Thurstone, in a preliminary fashion, including what he termed the
169:
In addition, Thurstone employed the approach to clarify other similarities and differences between Weber's law, the Weber-Fechner law, and the LCJ. An important clarification is that the LCJ does not
86:
The essential idea behind Thurstone's process and model is that it can be used to scale a collection of stimuli based on simple comparisons between stimuli two at a time: that is, based on a series of
1068:"Relative Measurement and its Generalization in Decision Making: Why Pairwise Comparisons are Central in Mathematics for the Measurement of Intangible Factors - The Analytic Hierarchy/Network Process" 640: 1206: 149:
of measurement. Importantly, this is not simply given a priori (Michell, 1997, p. 355), as is implied by purely mathematical derivations of the one law from the other. It is, rather, an
97:
weights. This is the perceptual counterpart to the physical weight of the objects. That is, the scale represents how heavy people perceive the objects to be based on the comparisons.
1143: 975: 1001:. Like the Rasch model, when applied in a given empirical context, Case 5 of the LCJ constitutes a mathematized hypothesis which embodies theoretical criteria for measurement. 188: 757: 899: 422: 1166:. (Copenhagen, Danish Institute for Educational Research), expanded edition (1980) with foreword and afterword by B.D. Wright. Chicago: The University of Chicago Press. 821: 929: 855: 795: 480: 386: 557: 530: 449: 351: 133:
to the size rather than noticing a specific difference irrespective of the size. The same applies to brightness, pressure, warmth, loudness, and so on.
1184:. In T.V. Smith and W.K. Wright (Eds.), Essays in Philosophy by Seventeen Doctors of Philosophy of the University of Chicago. Chicago: Open Court. 797:
is distributed according to some density function, such as the normal distribution or logistic function. In order to do so, it is necessary to let
47:, which is any process in which a comparison is made between pairs of a collection of entities with respect to magnitudes of an attribute, trait, 153:
question whether measurements have been obtained; one which requires justification through the process of stating and testing a well-defined
651: 1211: 67:
Thurstone published a paper on the law of comparative judgment in 1927. In this paper he introduced the underlying concept of a
1047: 579: 980:
When a simple logistic function is employed instead of the normal density function, then the model has the structure of the
24:. In modern-day terminology, it is more aptly described as a model that is used to obtain measurements from any process of 992:
of the Rasch model has been eliminated, as is achieved through statistical conditioning during the process of Conditional
1131:
Bradley, R.A. and Terry, M.E. (1952). Rank analysis of incomplete block designs, I. the method of paired comparisons.
1075: 87: 25: 1138:
Krus, D.J., & Kennedy, P.H. (1977) Normal scaling of dominance matrices: The domain-referenced model.
313:{\displaystyle S_{i}-S_{j}=x_{ij}{\sqrt {\sigma _{i}^{2}+\sigma _{j}^{2}-2r_{ij}\sigma _{i}\sigma _{j}}},} 934: 43:
In somewhat more technical terms, the law of comparative judgment is a mathematical representation of a
1018: 1010: 142: 1089: 1076:
Review of the Royal Academy of Exact, Physical and Natural Sciences, Series A: Mathematics (RACSAM)
981: 720: 1201: 1124:
Andrich, D. (1978b). Relationships between the Thurstone and Rasch approaches to item scaling.
868: 400: 1231: 1226: 1170: 1084: 800: 388:
is the sigma corresponding with the proportion of occasions on which the magnitude of stimulus
1207:
How to Analyze Paired Comparisons (tutorial on using Thurstone's Law of Comparative Judgement)
163: 48: 29: 1040:
Decision Making for Leaders: The Analytic Hierarchy Process for Decisions in a Complex World
904: 830: 770: 455: 361: 59:, which are used in psychology and education to analyse data from questionnaires and tests. 1014: 824: 535: 508: 427: 329: 146: 52: 1155:
Michell, J. (1997). Quantitative science and the definition of measurement in psychology.
116:
Thurstone showed that in terms of his conceptual framework, Weber's law and the so-called
8: 1102: 1009:
One important application involving the law of comparative judgment is the widely used
993: 988:
for dichotomous data (Rasch, 1960/1980) is identical to the BTL model after the person
71: 1043: 117: 1106: 28:. Examples of such processes are the comparisons of perceived intensity of physical 1094: 105: 104:
theory the 'law' of comparative judgment is more aptly described as a measurement
83:
to judge which of each pair expressed a stronger positive (or negative) attitude.
1063: 1013:, a structured technique for helping people deal with complex decisions. It uses 998: 21: 100:
Although Thurstone referred to it as a law, as stated above, in terms of modern
1220: 68: 37: 33: 1067: 101: 985: 79: 75: 56: 1098: 154: 51:, and so on. The theoretical basis for the model is closely related to 707:{\displaystyle {\sigma }={\sqrt {\sigma _{i}^{2}+\sigma _{j}^{2}}}.\,} 111: 989: 150: 759:
can be inferred directly from the proportion of instances in which
984:(BTL model) (Bradley & Terry, 1952; Luce, 1959). In turn, the 482:
is the correlation between the discriminal deviations of stimuli
78:' involving the comparison between a series of stimuli, such as 1164:
Probabilistic models for some intelligence and attainment tests
931:
is normally distributed, then it would be inferred that
635:{\displaystyle x_{ij}={\frac {S_{i}-S_{j}}{\sigma }}\,} 937: 907: 871: 833: 803: 773: 723: 654: 582: 538: 511: 458: 430: 403: 364: 332: 191: 112:
Relationships to pre-existing psychophysical theory
969: 923: 893: 849: 815: 789: 751: 706: 634: 551: 524: 474: 443: 416: 380: 345: 312: 1218: 1017:of tangible and intangible factors to construct 823:, which is in effect an arbitrary choice of the 1021:that are useful in making important decisions. 1042:. Pittsburgh, Pennsylvania: RWS Publications. 392:is judged to exceed the magnitude of stimulus 1152:: A Theoretical Analysis. New York: J. Wiley. 1191:. Chicago: The University of Chicago Press. 424:is the discriminal dispersion of a stimulus 353:is the psychological scale value of stimuli 1140:Educational and Psychological Measurement, 717:In this case of the model, the difference 1088: 703: 631: 505:for a uniform repeated stimulus, denoted 501:is the dispersion of fluctuations of the 1202:"The Measurement of Psychological Value" 857:be the proportion of occasions on which 1219: 1212:L.L. Thurstone psychometric laboratory 1182:The Measurement of Psychological Value 1062: 1056: 1037: 182:The most general form of the LCJ is 1031: 177: 13: 970:{\displaystyle S_{i}-S_{j}\cong 1} 14: 1243: 1195: 1126:Applied Psychological Measurement 1038:Saaty, Thomas L. (1999-05-01). 1004: 1171:A law of comparative judgement 55:and the theory underlying the 1: 1157:British Journal of Psychology 1024: 752:{\displaystyle {S_{i}-S_{j}}} 74:for a particular 'project in 62: 1150:Individual Choice Behaviours 901:and it is hypothesised that 7: 894:{\displaystyle P_{ij}=0.84} 767:if it is hypothesised that 417:{\displaystyle \sigma _{i}} 18:law of comparative judgment 10: 1248: 1011:Analytic Hierarchy Process 143:just noticeable difference 1189:The Measurement of Values 1187:Thurstone, L.L. (1959). 1180:Thurstone, L.L. (1929). 1169:Thurstone, L.L. (1927). 827:of measurement. Letting 816:{\displaystyle \sigma =1} 567: 982:Bradley-Terry-Luce model 1162:Rasch, G. (1960/1980). 861:is judged greater than 763:is judged greater than 997:those obtained from a 971: 925: 924:{\displaystyle x_{ij}} 895: 851: 850:{\displaystyle P_{ij}} 817: 791: 790:{\displaystyle x_{ij}} 753: 708: 636: 553: 526: 495:discriminal dispersion 476: 475:{\displaystyle r_{ij}} 445: 418: 382: 381:{\displaystyle x_{ij}} 347: 314: 145:(JND) is treated as a 972: 926: 896: 852: 818: 792: 754: 709: 637: 554: 552:{\displaystyle S_{i}} 527: 525:{\displaystyle R_{i}} 477: 446: 444:{\displaystyle R_{i}} 419: 383: 348: 346:{\displaystyle S_{i}} 315: 1175:Psychological Review 1015:pairwise comparisons 935: 905: 869: 831: 801: 771: 721: 652: 580: 536: 509: 456: 428: 401: 362: 330: 189: 160:additivity criterion 53:item response theory 1148:Luce, R.D. (1959). 865:, if, for example, 697: 679: 503:discriminal process 265: 247: 45:discriminal process 26:pairwise comparison 1144:(Request reprint). 1099:10.1007/bf03191825 1066:(September 2008). 994:Maximum Likelihood 967: 921: 891: 847: 813: 787: 749: 704: 683: 665: 632: 549: 522: 472: 441: 414: 378: 343: 310: 251: 233: 164:Stevens' power law 1049:978-0-9620317-8-6 698: 629: 305: 118:Weber-Fechner law 20:was conceived by 1239: 1117: 1116: 1114: 1113: 1092: 1072: 1064:Saaty, Thomas L. 1060: 1054: 1053: 1035: 976: 974: 973: 968: 960: 959: 947: 946: 930: 928: 927: 922: 920: 919: 900: 898: 897: 892: 884: 883: 856: 854: 853: 848: 846: 845: 822: 820: 819: 814: 796: 794: 793: 788: 786: 785: 758: 756: 755: 750: 748: 747: 746: 734: 733: 713: 711: 710: 705: 699: 696: 691: 678: 673: 664: 659: 641: 639: 638: 633: 630: 625: 624: 623: 611: 610: 600: 595: 594: 558: 556: 555: 550: 548: 547: 531: 529: 528: 523: 521: 520: 481: 479: 478: 473: 471: 470: 450: 448: 447: 442: 440: 439: 423: 421: 420: 415: 413: 412: 387: 385: 384: 379: 377: 376: 352: 350: 349: 344: 342: 341: 319: 317: 316: 311: 306: 304: 303: 294: 293: 284: 283: 264: 259: 246: 241: 232: 230: 229: 214: 213: 201: 200: 178:The general form 1247: 1246: 1242: 1241: 1240: 1238: 1237: 1236: 1217: 1216: 1198: 1121: 1120: 1111: 1109: 1090:10.1.1.455.3274 1070: 1061: 1057: 1050: 1036: 1032: 1027: 1007: 999:Thurstone scale 955: 951: 942: 938: 936: 933: 932: 912: 908: 906: 903: 902: 876: 872: 870: 867: 866: 838: 834: 832: 829: 828: 802: 799: 798: 778: 774: 772: 769: 768: 742: 738: 729: 725: 724: 722: 719: 718: 692: 687: 674: 669: 663: 655: 653: 650: 649: 619: 615: 606: 602: 601: 599: 587: 583: 581: 578: 577: 570: 559:represents the 543: 539: 537: 534: 533: 516: 512: 510: 507: 506: 463: 459: 457: 454: 453: 435: 431: 429: 426: 425: 408: 404: 402: 399: 398: 369: 365: 363: 360: 359: 337: 333: 331: 328: 327: 299: 295: 289: 285: 276: 272: 260: 255: 242: 237: 231: 222: 218: 209: 205: 196: 192: 190: 187: 186: 180: 114: 65: 22:L. L. Thurstone 12: 11: 5: 1245: 1235: 1234: 1229: 1215: 1214: 1209: 1204: 1197: 1196:External links 1194: 1193: 1192: 1185: 1178: 1177:, 34, 273-286. 1167: 1160: 1159:, 88, 355-383. 1153: 1146: 1136: 1135:, 39, 324-345. 1129: 1119: 1118: 1083:(2): 251–318. 1055: 1048: 1029: 1028: 1026: 1023: 1006: 1003: 966: 963: 958: 954: 950: 945: 941: 918: 915: 911: 890: 887: 882: 879: 875: 844: 841: 837: 812: 809: 806: 784: 781: 777: 745: 741: 737: 732: 728: 715: 714: 702: 695: 690: 686: 682: 677: 672: 668: 662: 658: 643: 642: 628: 622: 618: 614: 609: 605: 598: 593: 590: 586: 569: 566: 546: 542: 519: 515: 497:of a stimulus 491: 490: 469: 466: 462: 451: 438: 434: 411: 407: 396: 375: 372: 368: 357: 340: 336: 321: 320: 309: 302: 298: 292: 288: 282: 279: 275: 271: 268: 263: 258: 254: 250: 245: 240: 236: 228: 225: 221: 217: 212: 208: 204: 199: 195: 179: 176: 113: 110: 64: 61: 9: 6: 4: 3: 2: 1244: 1233: 1232:Psychophysics 1230: 1228: 1227:Psychometrics 1225: 1224: 1222: 1213: 1210: 1208: 1205: 1203: 1200: 1199: 1190: 1186: 1183: 1179: 1176: 1172: 1168: 1165: 1161: 1158: 1154: 1151: 1147: 1145: 1141: 1137: 1134: 1130: 1128:, 2, 449-460. 1127: 1123: 1122: 1108: 1104: 1100: 1096: 1091: 1086: 1082: 1078: 1077: 1069: 1065: 1059: 1051: 1045: 1041: 1034: 1030: 1022: 1020: 1016: 1012: 1002: 1000: 995: 991: 987: 983: 978: 964: 961: 956: 952: 948: 943: 939: 916: 913: 909: 888: 885: 880: 877: 873: 864: 860: 842: 839: 835: 826: 810: 807: 804: 782: 779: 775: 766: 762: 743: 739: 735: 730: 726: 700: 693: 688: 684: 680: 675: 670: 666: 660: 656: 648: 647: 646: 626: 620: 616: 612: 607: 603: 596: 591: 588: 584: 576: 575: 574: 565: 562: 544: 540: 517: 513: 504: 500: 496: 489: 485: 467: 464: 460: 452: 436: 432: 409: 405: 397: 395: 391: 373: 370: 366: 358: 356: 338: 334: 326: 325: 324: 307: 300: 296: 290: 286: 280: 277: 273: 269: 266: 261: 256: 252: 248: 243: 238: 234: 226: 223: 219: 215: 210: 206: 202: 197: 193: 185: 184: 183: 175: 172: 167: 165: 161: 156: 152: 148: 144: 140: 134: 132: 126: 123: 119: 109: 107: 103: 98: 96: 92: 90: 84: 81: 77: 73: 70: 69:psychological 60: 58: 54: 50: 46: 41: 39: 38:psychophysics 35: 34:psychometrics 31: 27: 23: 19: 1188: 1181: 1174: 1163: 1156: 1149: 1142:37, 189-193 1139: 1132: 1125: 1110:. Retrieved 1080: 1074: 1058: 1039: 1033: 1019:ratio scales 1008: 1005:Applications 979: 862: 858: 764: 760: 716: 644: 571: 560: 502: 498: 494: 492: 487: 483: 393: 389: 354: 322: 181: 170: 168: 159: 138: 135: 131:proportional 130: 127: 121: 115: 102:psychometric 99: 94: 88: 85: 66: 44: 42: 17: 15: 986:Rasch model 171:necessarily 91:comparisons 76:measurement 57:Rasch model 1221:Categories 1133:Biometrika 1112:2008-12-22 1025:References 323:in which: 155:hypothesis 63:Background 1085:CiteSeerX 990:parameter 962:≅ 949:− 805:σ 736:− 685:σ 667:σ 657:σ 627:σ 613:− 406:σ 297:σ 287:σ 267:− 253:σ 235:σ 203:− 151:empirical 95:perceived 72:continuum 1107:42215574 532:, where 89:pairwise 49:attitude 80:weights 30:stimuli 1105:  1087:  1046:  645:where 568:Case 5 1103:S2CID 1071:(PDF) 106:model 1044:ISBN 889:0.84 825:unit 561:mode 493:The 486:and 147:unit 141:the 36:and 16:The 1095:doi 1081:102 139:and 122:and 1223:: 1173:. 1101:. 1093:. 1079:. 1073:. 977:. 166:. 40:. 1115:. 1097:: 1052:. 965:1 957:j 953:S 944:i 940:S 917:j 914:i 910:x 886:= 881:j 878:i 874:P 863:j 859:i 843:j 840:i 836:P 811:1 808:= 783:j 780:i 776:x 765:i 761:j 744:j 740:S 731:i 727:S 701:. 694:2 689:j 681:+ 676:2 671:i 661:= 621:j 617:S 608:i 604:S 597:= 592:j 589:i 585:x 545:i 541:S 518:i 514:R 499:i 488:j 484:i 468:j 465:i 461:r 437:i 433:R 410:i 394:j 390:i 374:j 371:i 367:x 355:i 339:i 335:S 308:, 301:j 291:i 281:j 278:i 274:r 270:2 262:2 257:j 249:+ 244:2 239:i 227:j 224:i 220:x 216:= 211:j 207:S 198:i 194:S

Index

L. L. Thurstone
pairwise comparison
stimuli
psychometrics
psychophysics
attitude
item response theory
Rasch model
psychological
continuum
measurement
weights
pairwise comparisons
psychometric
model
Weber-Fechner law
just noticeable difference
unit
empirical
hypothesis
Stevens' power law
unit
Bradley-Terry-Luce model
Rasch model
parameter
Maximum Likelihood
Thurstone scale
Analytic Hierarchy Process
pairwise comparisons
ratio scales

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.