Knowledge

Multinomial probit

Source đź“ť

391: 1284: 1735: 440: 1044: 1593: 1279:{\displaystyle {\begin{aligned}Y_{i}^{1\ast }&={\boldsymbol {\beta }}_{1}\cdot \mathbf {X} _{i}+\varepsilon _{1}\,\\Y_{i}^{2\ast }&={\boldsymbol {\beta }}_{2}\cdot \mathbf {X} _{i}+\varepsilon _{2}\,\\\ldots &\ldots \\Y_{i}^{m\ast }&={\boldsymbol {\beta }}_{m}\cdot \mathbf {X} _{i}+\varepsilon _{m}\,\\\end{aligned}}} 1350: 868: 647:
The observed outcomes might be "has disease A, has disease B, has disease C, has none of the diseases" for a set of rare diseases with similar symptoms, and the explanatory variables might be characteristics of the patients thought to be pertinent (sex, race, age,
1588:{\displaystyle Y_{i}={\begin{cases}1&{\text{if }}Y_{i}^{1\ast }>Y_{i}^{2\ast },\ldots ,Y_{i}^{m\ast }\\2&{\text{if }}Y_{i}^{2\ast }>Y_{i}^{1\ast },Y_{i}^{3\ast },\ldots ,Y_{i}^{m\ast }\\\ldots &\ldots \\m&{\text{otherwise.}}\end{cases}}} 668:
that can be used to predict the likely outcome of an unobserved multi-way trial given the associated explanatory variables. In the process, the model attempts to explain the relative effect of differing explanatory variables on the different outcomes.
1339: 659:
The observed outcomes are the votes of people for a given party or candidate in a multi-way election, and the explanatory variables are the demographic characteristics of each person (e.g. sex, race, age, income,
712: 1674: 1013: 1712: 1049: 1295: 863:{\displaystyle Y_{i}|x_{1,i},\ldots ,x_{k,i}\ \sim \operatorname {Categorical} (p_{i,1},\ldots ,p_{i,m}),{\text{ for }}i=1,\dots ,n} 421: 1684: 508: 450: 331: 480: 1604: 1791: 879: 529:
This article is about modeling a single event with multiple outcomes. For modeling several correlated binary outcomes, see
321: 1693: 487: 1815: 706:
at hand because it is determined by the values of the explanatory variables associated with that observation. That is:
494: 285: 336: 274: 94: 69: 476: 465: 196: 155: 1810: 414: 1746: 357: 1779: 326: 295: 222: 565: 561: 530: 316: 305: 269: 176: 1372: 682: 597: 377: 248: 171: 64: 43: 407: 300: 501: 264: 259: 201: 1035: 352: 48: 571:, which is used to model correlated binary outcomes for more than one independent variable. 461: 640: 372: 362: 243: 211: 166: 145: 53: 1334:{\displaystyle {\boldsymbol {\varepsilon }}\sim {\mathcal {N}}(0,{\boldsymbol {\Sigma }})} 8: 290: 191: 186: 140: 89: 79: 24: 1715: 553: 395: 124: 1787: 665: 557: 390: 181: 84: 38: 206: 135: 653: 367: 74: 1680: 649: 119: 457: 1804: 238: 114: 1766: 549: 541: 104: 150: 99: 1734: 537: 439: 1679:
Note that this model allows for arbitrary correlation between the
1786:(Seventh ed.). Boston: Pearson Education. pp. 810–811. 1765:
For details on how the equations are estimated, see the article
1714:
is the identity matrix (such that there is no correlation or
1581: 552:
used when there are several possible categories that the
1669:{\displaystyle Y_{i}=\arg \max _{h=1}^{m}Y_{i}^{h\ast }} 643:, predictor variables, features, etc.). Some examples: 1008:{\displaystyle \Pr=p_{i,h},{\text{ for }}i=1,\dots ,n,} 1697: 1696: 1607: 1353: 1298: 1047: 882: 715: 1707:{\displaystyle \scriptstyle {\boldsymbol {\Sigma }}} 579:
It is assumed that we have a series of observations
556:
can fall into. As such, it is an alternative to the
1706: 1668: 1587: 1333: 1278: 1034:Multinomial probit is often written in terms of a 1007: 862: 656:, presence or absence of various symptoms, etc.). 1802: 1628: 883: 608:possible choices). Along with each observation 596:, of the outcomes of multi-way choices from a 415: 466:introducing citations to additional sources 422: 408: 1683:, so that it doesn't necessarily respect 1271: 1187: 1117: 639:of explanatory variables (also known as 1029: 574: 456:Relevant discussion may be found on the 1685:independence of irrelevant alternatives 1300: 1233: 1149: 1079: 1803: 1778: 693:occurs with an unobserved probability 1729: 702:that is specific to the observation 564:. It is not to be confused with the 433: 13: 1309: 664:The multinomial probit model is a 14: 1827: 1733: 1699: 1324: 1248: 1164: 1094: 449:relies largely or entirely on a 438: 389: 685:data, where each outcome value 337:Least-squares spectral analysis 275:Generalized estimating equation 95:Multinomial logistic regression 70:Vector generalized linear model 1328: 1314: 951: 906: 886: 828: 784: 727: 1: 1772: 1725: 156:Nonlinear mixed-effects model 7: 548:is a generalization of the 358:Mean and predicted response 10: 1832: 1816:Statistical classification 528: 151:Linear mixed-effects model 683:categorically-distributed 562:multiclass classification 531:multivariate probit model 317:Least absolute deviations 598:categorical distribution 560:model as one method of 546:multinomial probit model 65:Generalized linear model 1718:), the model is called 681:are described as being 672:Formally, the outcomes 1708: 1670: 1647: 1589: 1335: 1280: 1009: 864: 396:Mathematics portal 322:Iteratively reweighted 1709: 1671: 1627: 1590: 1336: 1281: 1036:latent variable model 1030:Latent variable model 1010: 865: 641:independent variables 575:General specification 353:Regression validation 332:Bayesian multivariate 49:Polynomial regression 1784:Econometric Analysis 1694: 1605: 1351: 1296: 1045: 880: 713: 477:"Multinomial probit" 462:improve this article 378:Gauss–Markov theorem 373:Studentized residual 363:Errors and residuals 197:Principal components 167:Nonlinear regression 54:General linear model 1811:Regression analysis 1665: 1551: 1524: 1503: 1482: 1450: 1423: 1402: 1223: 1139: 1069: 1022:possible values of 223:Errors-in-variables 90:Logistic regression 80:Binomial regression 25:Regression analysis 19:Part of a series on 1780:Greene, William H. 1745:. You can help by 1720:independent probit 1716:heteroscedasticity 1704: 1703: 1666: 1648: 1585: 1580: 1534: 1507: 1486: 1465: 1433: 1406: 1385: 1331: 1276: 1274: 1206: 1122: 1052: 1005: 860: 554:dependent variable 110:Multinomial probit 1793:978-0-273-75356-8 1763: 1762: 1576: 1463: 1383: 979: 837: 774: 666:statistical model 558:multinomial logit 527: 526: 512: 432: 431: 85:Binary regression 44:Simple regression 39:Linear regression 1823: 1797: 1758: 1755: 1737: 1730: 1713: 1711: 1710: 1705: 1702: 1675: 1673: 1672: 1667: 1664: 1656: 1646: 1641: 1617: 1616: 1594: 1592: 1591: 1586: 1584: 1583: 1577: 1574: 1550: 1542: 1523: 1515: 1502: 1494: 1481: 1473: 1464: 1461: 1449: 1441: 1422: 1414: 1401: 1393: 1384: 1381: 1363: 1362: 1340: 1338: 1337: 1332: 1327: 1313: 1312: 1303: 1285: 1283: 1282: 1277: 1275: 1270: 1269: 1257: 1256: 1251: 1242: 1241: 1236: 1222: 1214: 1186: 1185: 1173: 1172: 1167: 1158: 1157: 1152: 1138: 1130: 1116: 1115: 1103: 1102: 1097: 1088: 1087: 1082: 1068: 1060: 1014: 1012: 1011: 1006: 980: 977: 972: 971: 950: 949: 925: 924: 909: 898: 897: 873:or equivalently 869: 867: 866: 861: 838: 835: 827: 826: 802: 801: 772: 771: 770: 746: 745: 730: 725: 724: 689:for observation 621:observed values 522: 519: 513: 511: 470: 442: 434: 424: 417: 410: 394: 393: 301:Ridge regression 136:Multilevel model 16: 15: 1831: 1830: 1826: 1825: 1824: 1822: 1821: 1820: 1801: 1800: 1794: 1775: 1759: 1753: 1750: 1743:needs expansion 1728: 1698: 1695: 1692: 1691: 1681:error variables 1657: 1652: 1642: 1631: 1612: 1608: 1606: 1603: 1602: 1579: 1578: 1573: 1571: 1565: 1564: 1559: 1553: 1552: 1543: 1538: 1516: 1511: 1495: 1490: 1474: 1469: 1460: 1458: 1452: 1451: 1442: 1437: 1415: 1410: 1394: 1389: 1380: 1378: 1368: 1367: 1358: 1354: 1352: 1349: 1348: 1323: 1308: 1307: 1299: 1297: 1294: 1293: 1273: 1272: 1265: 1261: 1252: 1247: 1246: 1237: 1232: 1231: 1224: 1215: 1210: 1203: 1202: 1195: 1189: 1188: 1181: 1177: 1168: 1163: 1162: 1153: 1148: 1147: 1140: 1131: 1126: 1119: 1118: 1111: 1107: 1098: 1093: 1092: 1083: 1078: 1077: 1070: 1061: 1056: 1048: 1046: 1043: 1042: 1032: 978: for  976: 961: 957: 939: 935: 914: 910: 905: 893: 889: 881: 878: 877: 836: for  834: 816: 812: 791: 787: 760: 756: 735: 731: 726: 720: 716: 714: 711: 710: 701: 680: 654:body-mass index 638: 629: 616: 587: 577: 534: 523: 517: 514: 471: 469: 455: 443: 428: 388: 368:Goodness of fit 75:Discrete choice 12: 11: 5: 1829: 1819: 1818: 1813: 1799: 1798: 1792: 1774: 1771: 1761: 1760: 1740: 1738: 1727: 1724: 1701: 1677: 1676: 1663: 1660: 1655: 1651: 1645: 1640: 1637: 1634: 1630: 1626: 1623: 1620: 1615: 1611: 1596: 1595: 1582: 1572: 1570: 1567: 1566: 1563: 1560: 1558: 1555: 1554: 1549: 1546: 1541: 1537: 1533: 1530: 1527: 1522: 1519: 1514: 1510: 1506: 1501: 1498: 1493: 1489: 1485: 1480: 1477: 1472: 1468: 1459: 1457: 1454: 1453: 1448: 1445: 1440: 1436: 1432: 1429: 1426: 1421: 1418: 1413: 1409: 1405: 1400: 1397: 1392: 1388: 1379: 1377: 1374: 1373: 1371: 1366: 1361: 1357: 1342: 1341: 1330: 1326: 1322: 1319: 1316: 1311: 1306: 1302: 1287: 1286: 1268: 1264: 1260: 1255: 1250: 1245: 1240: 1235: 1230: 1227: 1225: 1221: 1218: 1213: 1209: 1205: 1204: 1201: 1198: 1196: 1194: 1191: 1190: 1184: 1180: 1176: 1171: 1166: 1161: 1156: 1151: 1146: 1143: 1141: 1137: 1134: 1129: 1125: 1121: 1120: 1114: 1110: 1106: 1101: 1096: 1091: 1086: 1081: 1076: 1073: 1071: 1067: 1064: 1059: 1055: 1051: 1050: 1031: 1028: 1016: 1015: 1004: 1001: 998: 995: 992: 989: 986: 983: 975: 970: 967: 964: 960: 956: 953: 948: 945: 942: 938: 934: 931: 928: 923: 920: 917: 913: 908: 904: 901: 896: 892: 888: 885: 871: 870: 859: 856: 853: 850: 847: 844: 841: 833: 830: 825: 822: 819: 815: 811: 808: 805: 800: 797: 794: 790: 786: 783: 780: 777: 769: 766: 763: 759: 755: 752: 749: 744: 741: 738: 734: 729: 723: 719: 697: 676: 662: 661: 657: 650:blood pressure 634: 625: 612: 583: 576: 573: 525: 524: 460:. Please help 446: 444: 437: 430: 429: 427: 426: 419: 412: 404: 401: 400: 399: 398: 383: 382: 381: 380: 375: 370: 365: 360: 355: 347: 346: 342: 341: 340: 339: 334: 329: 324: 319: 311: 310: 309: 308: 303: 298: 293: 288: 280: 279: 278: 277: 272: 267: 262: 254: 253: 252: 251: 246: 241: 233: 232: 228: 227: 226: 225: 217: 216: 215: 214: 209: 204: 199: 194: 189: 184: 179: 177:Semiparametric 174: 169: 161: 160: 159: 158: 153: 148: 146:Random effects 143: 138: 130: 129: 128: 127: 122: 120:Ordered probit 117: 112: 107: 102: 97: 92: 87: 82: 77: 72: 67: 59: 58: 57: 56: 51: 46: 41: 33: 32: 28: 27: 21: 20: 9: 6: 4: 3: 2: 1828: 1817: 1814: 1812: 1809: 1808: 1806: 1795: 1789: 1785: 1781: 1777: 1776: 1770: 1768: 1757: 1754:February 2017 1748: 1744: 1741:This section 1739: 1736: 1732: 1731: 1723: 1721: 1717: 1688: 1686: 1682: 1661: 1658: 1653: 1649: 1643: 1638: 1635: 1632: 1624: 1621: 1618: 1613: 1609: 1601: 1600: 1599: 1568: 1561: 1556: 1547: 1544: 1539: 1535: 1531: 1528: 1525: 1520: 1517: 1512: 1508: 1504: 1499: 1496: 1491: 1487: 1483: 1478: 1475: 1470: 1466: 1455: 1446: 1443: 1438: 1434: 1430: 1427: 1424: 1419: 1416: 1411: 1407: 1403: 1398: 1395: 1390: 1386: 1375: 1369: 1364: 1359: 1355: 1347: 1346: 1345: 1320: 1317: 1304: 1292: 1291: 1290: 1266: 1262: 1258: 1253: 1243: 1238: 1228: 1226: 1219: 1216: 1211: 1207: 1199: 1197: 1192: 1182: 1178: 1174: 1169: 1159: 1154: 1144: 1142: 1135: 1132: 1127: 1123: 1112: 1108: 1104: 1099: 1089: 1084: 1074: 1072: 1065: 1062: 1057: 1053: 1041: 1040: 1039: 1037: 1027: 1025: 1021: 1002: 999: 996: 993: 990: 987: 984: 981: 973: 968: 965: 962: 958: 954: 946: 943: 940: 936: 932: 929: 926: 921: 918: 915: 911: 902: 899: 894: 890: 876: 875: 874: 857: 854: 851: 848: 845: 842: 839: 831: 823: 820: 817: 813: 809: 806: 803: 798: 795: 792: 788: 781: 778: 775: 767: 764: 761: 757: 753: 750: 747: 742: 739: 736: 732: 721: 717: 709: 708: 707: 705: 700: 696: 692: 688: 684: 679: 675: 670: 667: 658: 655: 651: 646: 645: 644: 642: 637: 633: 628: 624: 620: 615: 611: 607: 603: 599: 595: 591: 586: 582: 572: 570: 568: 563: 559: 555: 551: 547: 543: 539: 532: 521: 510: 507: 503: 500: 496: 493: 489: 486: 482: 479: â€“  478: 474: 473:Find sources: 467: 463: 459: 453: 452: 451:single source 447:This article 445: 441: 436: 435: 425: 420: 418: 413: 411: 406: 405: 403: 402: 397: 392: 387: 386: 385: 384: 379: 376: 374: 371: 369: 366: 364: 361: 359: 356: 354: 351: 350: 349: 348: 344: 343: 338: 335: 333: 330: 328: 325: 323: 320: 318: 315: 314: 313: 312: 307: 304: 302: 299: 297: 294: 292: 289: 287: 284: 283: 282: 281: 276: 273: 271: 268: 266: 263: 261: 258: 257: 256: 255: 250: 247: 245: 242: 240: 239:Least squares 237: 236: 235: 234: 230: 229: 224: 221: 220: 219: 218: 213: 210: 208: 205: 203: 200: 198: 195: 193: 190: 188: 185: 183: 180: 178: 175: 173: 172:Nonparametric 170: 168: 165: 164: 163: 162: 157: 154: 152: 149: 147: 144: 142: 141:Fixed effects 139: 137: 134: 133: 132: 131: 126: 123: 121: 118: 116: 115:Ordered logit 113: 111: 108: 106: 103: 101: 98: 96: 93: 91: 88: 86: 83: 81: 78: 76: 73: 71: 68: 66: 63: 62: 61: 60: 55: 52: 50: 47: 45: 42: 40: 37: 36: 35: 34: 30: 29: 26: 23: 22: 18: 17: 1783: 1767:Probit model 1764: 1751: 1747:adding to it 1742: 1719: 1689: 1678: 1597: 1343: 1288: 1033: 1023: 1019: 1018:for each of 1017: 872: 703: 698: 694: 690: 686: 677: 673: 671: 663: 635: 631: 626: 622: 618: 617:is a set of 613: 609: 605: 601: 593: 589: 584: 580: 578: 569:probit model 567:multivariate 566: 550:probit model 545: 542:econometrics 535: 515: 505: 498: 491: 484: 472: 448: 296:Non-negative 109: 779:Categorical 604:(there are 306:Regularized 270:Generalized 202:Least angle 100:Mixed logit 1805:Categories 1773:References 1726:Estimation 1575:otherwise. 538:statistics 488:newspapers 345:Background 249:Non-linear 231:Estimation 1700:Σ 1662:∗ 1625:⁡ 1598:That is, 1562:… 1557:… 1548:∗ 1529:… 1521:∗ 1500:∗ 1479:∗ 1447:∗ 1428:… 1420:∗ 1399:∗ 1325:Σ 1305:∼ 1301:ε 1263:ε 1244:⋅ 1234:β 1220:∗ 1200:… 1193:… 1179:ε 1160:⋅ 1150:β 1136:∗ 1109:ε 1090:⋅ 1080:β 1066:∗ 994:… 930:… 852:… 807:… 782:⁡ 776:∼ 751:… 518:July 2015 458:talk page 212:Segmented 1782:(2012). 1462:if  1382:if  600:of size 327:Bayesian 265:Weighted 260:Ordinary 192:Isotonic 187:Quantile 630:, ..., 502:scholar 286:Partial 125:Poisson 1790:  1289:where 773:  660:etc.). 592:= 1... 588:, for 544:, the 504:  497:  490:  483:  475:  244:Linear 182:Robust 105:Probit 31:Models 1690:When 1344:Then 509:JSTOR 495:books 291:Total 207:Local 1788:ISBN 1484:> 1404:> 540:and 481:news 1749:. 1629:max 1622:arg 699:i,h 636:k,i 627:1,i 536:In 464:by 1807:: 1769:. 1722:. 1687:. 1038:: 1026:. 884:Pr 652:, 1796:. 1756:) 1752:( 1659:h 1654:i 1650:Y 1644:m 1639:1 1636:= 1633:h 1619:= 1614:i 1610:Y 1569:m 1545:m 1540:i 1536:Y 1532:, 1526:, 1518:3 1513:i 1509:Y 1505:, 1497:1 1492:i 1488:Y 1476:2 1471:i 1467:Y 1456:2 1444:m 1439:i 1435:Y 1431:, 1425:, 1417:2 1412:i 1408:Y 1396:1 1391:i 1387:Y 1376:1 1370:{ 1365:= 1360:i 1356:Y 1329:) 1321:, 1318:0 1315:( 1310:N 1267:m 1259:+ 1254:i 1249:X 1239:m 1229:= 1217:m 1212:i 1208:Y 1183:2 1175:+ 1170:i 1165:X 1155:2 1145:= 1133:2 1128:i 1124:Y 1113:1 1105:+ 1100:i 1095:X 1085:1 1075:= 1063:1 1058:i 1054:Y 1024:h 1020:m 1003:, 1000:n 997:, 991:, 988:1 985:= 982:i 974:, 969:h 966:, 963:i 959:p 955:= 952:] 947:i 944:, 941:k 937:x 933:, 927:, 922:i 919:, 916:1 912:x 907:| 903:h 900:= 895:i 891:Y 887:[ 858:n 855:, 849:, 846:1 843:= 840:i 832:, 829:) 824:m 821:, 818:i 814:p 810:, 804:, 799:1 796:, 793:i 789:p 785:( 768:i 765:, 762:k 758:x 754:, 748:, 743:i 740:, 737:1 733:x 728:| 722:i 718:Y 704:i 695:p 691:i 687:h 678:i 674:Y 632:x 623:x 619:k 614:i 610:Y 606:m 602:m 594:n 590:i 585:i 581:Y 533:. 520:) 516:( 506:· 499:· 492:· 485:· 468:. 454:. 423:e 416:t 409:v

Index

Regression analysis
Linear regression
Simple regression
Polynomial regression
General linear model
Generalized linear model
Vector generalized linear model
Discrete choice
Binomial regression
Binary regression
Logistic regression
Multinomial logistic regression
Mixed logit
Probit
Multinomial probit
Ordered logit
Ordered probit
Poisson
Multilevel model
Fixed effects
Random effects
Linear mixed-effects model
Nonlinear mixed-effects model
Nonlinear regression
Nonparametric
Semiparametric
Robust
Quantile
Isotonic
Principal components

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑