56:
The purpose of this page is to measure the efficacy of different user talk templates through randomized testing. This effort does not entail creating new categories of user warnings or to organize them more efficiently, but rather to improve on the quality of our current communication methods.
1597:
A "randomizer" that delivers all the templates in your test. This is the template that should be included in the configuration of whichever bot or tool you are testing with, and it randomly delivers one of the templates via a
1609:, usually the existing default template. Note that you should replicate the default in a new template rather than use the current template page, in order to avoid including old instances of the default in your experiment.
428:
Those pages each have lists and dates of all the templates tested including results if available. The following are tracking tables with start and end dates. For tests in projects other than
English Knowledge, please see
60:
We're aiming to fine tune the template messages we send to editors, in order to encourage more good faith contributors and discourage outright vandals, spammers, and other bad faith contributors.
1593:
of any user talk template. Doing randomized experiments allows us to get hard data about what kinds of content are most successful at helping us achieve these goals. What you'll need is...
406:
44:
This page is the tracking page for efforts on the
English Knowledge to improve the quality of user talk warnings. Links to this project on other Wikipedias can be found on the
1619:
tracking template for all templates being tested. If you do not include a separate Z number in each template, you will lose track of your test cases once they are substituted.
894:
Level 1-4 spam warnings, 4 total. 1 test template (personal + no directives) and 1 control; Welcomeg and welcomeanon, 1 test template (personal + no directives) and 1 control
430:
412:
417:
1612:
A new version or versions of the template you want to test. Try to use a canonical name that matches the type, purpose, and level of the warning you're interested in.
1631:
We have so far used a mixed method of both quantitative measurement and qualitative assessment. If you'd like to help sort and analyze tests, please sign up above.
310:
1616:
396:
337:
295:
391:
345:
401:
349:
77:
386:
340:
new templates or assess the templates that are currently in the draft phase and suggest improvements in their content or structure. We aim to lessen the
381:
422:
355:
252:
1571:
1562:
1553:
1544:
1513:
1504:
1495:
1486:
1477:
1468:
1459:
1450:
1441:
1432:
1423:
1414:
1382:
1373:
1364:
1355:
1346:
1337:
1328:
1319:
1310:
1301:
1292:
1283:
1193:
1184:
1175:
1166:
1157:
1148:
1139:
1130:
1121:
1112:
1103:
1094:
1085:
1076:
1067:
1058:
1049:
1040:
1010:
1001:
992:
983:
973:
964:
955:
946:
937:
928:
919:
910:
879:
870:
861:
831:
822:
813:
804:
774:
765:
756:
747:
738:
729:
720:
711:
702:
693:
684:
675:
666:
657:
648:
639:
630:
621:
591:
582:
573:
543:
534:
525:
516:
507:
498:
489:
480:
155:
1399:
Copyvio notifications, 6 total. 1 test template (personal + no directives) and 1 control; welcomelaws, 1 test (short) and 1 control.
137:
17:
1652:
1225:
1636:
1268:
Image notifications about sourcing/licensing, 4 total. 2 test templates (directives, no directives) and 1 control.
1530:
Test edit warning, registered and unregistered, 2 total. 1 test template (personal + no directives) and 1 control
1623:
In some cases, such as for bots where all contribs are by one account, this method can be greatly simplified.
606:
All level 1 warnings (except vandalism), 9 total. 1 test template (personal + no directives) and 1 control
261:
333:
Any effort to make templates more simple, friendly, and accessible is welcome. Specifically, you can:
304:
241:
362:
45:
1232:
558:
Level 1 vandalism warning. 2 test templates (personal, personal + no directives) and 1 control
465:
Level 1 vandalism warning. 3 test templates (image/no image; teaching, personal) and 1 control
257:
151:
1263:
846:
Level 1 vandalism warning. 2 test templates (personal + no directives, short) and 1 control
361:
Help us analyze our data. We're using mixed methods, with both quantitative statistics and
301:
63:
35:
8:
1394:
170:
97:
1210:
Newbie CSD tag removal warning, 1 test template (personal + no directives) and 1 control
1606:
789:
AfD and PROD notices, 2 total. 1 test template (personal + no directives) and 1 control
322:
277:
194:
117:
27:
1237:
archiving of shared and dynamic IP talk pages regularly to remove irrelevant warnings
92:
72:
1205:
1025:
All issue-specific level 1 warnings, 9 total. 1 test template (short) and 1 control
147:
142:
292:
175:
341:
221:
211:
206:
122:
87:
1646:
267:
216:
186:
180:
160:
107:
1599:
287:
236:
102:
82:
1252:
1626:
1590:
317:
282:
272:
246:
127:
1525:
1256:
231:
226:
1584:
165:
132:
112:
68:
Sign up here if you'd like to stay notified about testing updates.
358:
which templates to test next and what changes should be made.
1589:
The following are the requirements to conduct comparative
344:
of warnings, but templates should still comply with the
377:
Templates have been tested in the following places:
372:
328:
51:
1644:
14:
1645:
1635:Testing results from all projects are
189:(as one of the operators of XLinkBot)
138:User:The Blade of the Northern Lights
23:
18:Knowledge:WikiProject User warnings
24:
1664:
1248:
1221:
1253:List of all archived talk pages
311:02:49, 15 September 2012 (UTC)
13:
1:
156:21:53, 25 October 2011 (UTC)
7:
10:
1669:
368:Recruit more participants.
25:
1653:WikiProject User warnings
296:19:49, 27 June 2012 (UTC)
242:User:Johannes Rohr (WMDE)
183:(forced by its operators)
1257:SharedIPArchiveBot's log
407:Articles for creation
457:Data (if available)
1233:Shared IP archiving
98:User:Philippe (WMF)
561:September 25, 2011
454:Tracking templates
363:qualitative coding
323:User:Rdicerb_(WMF)
118:User:Fluffernutter
78:User:Maryana (WMF)
1582:
1581:
1277:30 days (minimum)
1274:February 21, 2012
1271:December 21, 2011
1243:February 19, 2012
1240:December 19, 2011
1031:December 22, 2011
1028:November 22, 2011
900:December 17, 2011
897:November 17, 2011
612:November 19, 2011
442:Brief description
346:design guidelines
314:
93:User:Vitor Mazuco
73:User:Steven (WMF)
1660:
1576:
1570:
1567:
1561:
1558:
1552:
1549:
1543:
1533:January 19, 2012
1518:
1512:
1509:
1503:
1500:
1494:
1491:
1485:
1482:
1476:
1473:
1467:
1464:
1458:
1455:
1449:
1446:
1440:
1437:
1431:
1428:
1422:
1419:
1413:
1405:January 31, 2012
1402:January 12, 2012
1387:
1381:
1378:
1372:
1369:
1363:
1360:
1354:
1351:
1345:
1342:
1336:
1333:
1327:
1324:
1318:
1315:
1309:
1306:
1300:
1297:
1291:
1288:
1282:
1213:November 3, 2011
1198:
1192:
1189:
1183:
1180:
1174:
1171:
1165:
1162:
1156:
1153:
1147:
1144:
1138:
1135:
1129:
1126:
1120:
1117:
1111:
1108:
1102:
1099:
1093:
1090:
1084:
1081:
1075:
1072:
1066:
1063:
1057:
1054:
1048:
1045:
1039:
1015:
1009:
1006:
1000:
997:
991:
988:
982:
978:
972:
969:
963:
960:
954:
951:
945:
942:
936:
933:
927:
924:
918:
915:
909:
884:
878:
875:
869:
866:
860:
852:December 9, 2011
849:November 8, 2011
836:
830:
827:
821:
818:
812:
809:
803:
795:December 9, 2011
792:November 9, 2011
779:
773:
770:
764:
761:
755:
752:
746:
743:
737:
734:
728:
725:
719:
716:
710:
707:
701:
698:
692:
689:
683:
680:
674:
671:
665:
662:
656:
653:
647:
644:
638:
635:
629:
626:
620:
609:October 18, 2011
596:
590:
587:
581:
578:
572:
564:October 10, 2011
548:
542:
539:
533:
530:
524:
521:
515:
512:
506:
503:
497:
494:
488:
485:
479:
436:
435:
350:usage and layout
309:
258:Martijn Hoekstra
203:
201:
197:
143:User:Writ Keeper
38:
1668:
1667:
1663:
1662:
1661:
1659:
1658:
1657:
1643:
1642:
1629:
1600:parser function
1587:
1574:
1568:
1565:
1559:
1556:
1550:
1547:
1541:
1516:
1510:
1507:
1501:
1498:
1492:
1489:
1483:
1480:
1474:
1471:
1465:
1462:
1456:
1453:
1447:
1444:
1438:
1435:
1429:
1426:
1420:
1417:
1411:
1385:
1379:
1376:
1370:
1367:
1361:
1358:
1352:
1349:
1343:
1340:
1334:
1331:
1325:
1322:
1316:
1313:
1307:
1304:
1298:
1295:
1289:
1286:
1280:
1264:ImageTaggingBot
1216:January 3, 2012
1196:
1190:
1187:
1181:
1178:
1172:
1169:
1163:
1160:
1154:
1151:
1145:
1142:
1136:
1133:
1127:
1124:
1118:
1115:
1109:
1106:
1100:
1097:
1091:
1088:
1082:
1079:
1073:
1070:
1064:
1061:
1055:
1052:
1046:
1043:
1037:
1013:
1007:
1004:
998:
995:
989:
986:
980:
976:
970:
967:
961:
958:
952:
949:
943:
940:
934:
931:
925:
922:
916:
913:
907:
882:
876:
873:
867:
864:
858:
834:
828:
825:
819:
816:
810:
807:
801:
777:
771:
768:
762:
759:
753:
750:
744:
741:
735:
732:
726:
723:
717:
714:
708:
705:
699:
696:
690:
687:
681:
678:
672:
669:
663:
660:
654:
651:
645:
642:
636:
633:
627:
624:
618:
594:
588:
585:
579:
576:
570:
546:
540:
537:
531:
528:
522:
519:
513:
510:
504:
501:
495:
492:
486:
483:
477:
431:our hub on Meta
413:ImageTaggingBot
375:
352:best practices.
331:
278:User:Rcsprinter
199:
193:
192:
66:
54:
42:
41:
34:
30:
22:
21:
20:
12:
11:
5:
1666:
1656:
1655:
1637:available here
1628:
1625:
1621:
1620:
1613:
1610:
1603:
1586:
1585:Testing method
1583:
1580:
1579:
1577:
1539:
1537:
1536:March 27, 2012
1534:
1531:
1528:
1522:
1521:
1519:
1409:
1406:
1403:
1400:
1397:
1395:CorenSearchBot
1391:
1390:
1388:
1278:
1275:
1272:
1269:
1266:
1260:
1259:
1250:
1247:
1244:
1241:
1238:
1235:
1229:
1228:
1223:
1220:
1217:
1214:
1211:
1208:
1202:
1201:
1199:
1035:
1032:
1029:
1026:
1023:
1022:Huggle short 2
1019:
1018:
1016:
904:
901:
898:
895:
892:
888:
887:
885:
856:
853:
850:
847:
844:
843:Huggle short 1
840:
839:
837:
799:
796:
793:
790:
787:
783:
782:
780:
616:
613:
610:
607:
604:
600:
599:
597:
568:
565:
562:
559:
556:
552:
551:
549:
475:
472:
471:August 5, 2011
469:
466:
463:
459:
458:
455:
452:
449:
446:
443:
440:
426:
425:
420:
418:CorenSearchBot
415:
410:
404:
399:
394:
389:
384:
374:
371:
370:
369:
366:
359:
353:
330:
327:
326:
325:
320:
315:
298:
290:
285:
280:
275:
270:
265:
255:
250:
244:
239:
234:
229:
224:
222:User:gwickwire
219:
214:
212:User:Recon Etc
209:
207:User:Racconish
204:
190:
184:
178:
173:
171:Hurricanefan25
168:
163:
158:
145:
140:
135:
130:
125:
123:User:Wikipelli
120:
115:
110:
105:
100:
95:
90:
88:User:EpochFail
85:
80:
75:
65:
62:
53:
50:
46:cross-wiki hub
40:
39:
31:
26:
15:
9:
6:
4:
3:
2:
1665:
1654:
1651:
1650:
1648:
1641:
1640:
1638:
1632:
1624:
1618:
1614:
1611:
1608:
1604:
1601:
1596:
1595:
1594:
1592:
1578:
1573:
1564:
1555:
1546:
1540:
1538:
1535:
1532:
1529:
1527:
1524:
1523:
1520:
1515:
1506:
1497:
1488:
1479:
1470:
1461:
1452:
1443:
1434:
1425:
1416:
1410:
1407:
1404:
1401:
1398:
1396:
1393:
1392:
1389:
1384:
1375:
1366:
1357:
1348:
1339:
1330:
1321:
1312:
1303:
1294:
1285:
1279:
1276:
1273:
1270:
1267:
1265:
1262:
1261:
1258:
1254:
1251:
1245:
1242:
1239:
1236:
1234:
1231:
1230:
1227:
1224:
1218:
1215:
1212:
1209:
1207:
1204:
1203:
1200:
1195:
1186:
1177:
1168:
1159:
1150:
1141:
1132:
1123:
1114:
1105:
1096:
1087:
1078:
1069:
1060:
1051:
1042:
1036:
1033:
1030:
1027:
1024:
1021:
1020:
1017:
1012:
1003:
994:
985:
975:
966:
957:
948:
939:
930:
921:
912:
905:
902:
899:
896:
893:
890:
889:
886:
881:
872:
863:
857:
854:
851:
848:
845:
842:
841:
838:
833:
824:
815:
806:
800:
797:
794:
791:
788:
785:
784:
781:
776:
767:
758:
749:
740:
731:
722:
713:
704:
695:
686:
677:
668:
659:
650:
641:
632:
623:
617:
614:
611:
608:
605:
602:
601:
598:
593:
584:
575:
569:
566:
563:
560:
557:
554:
553:
550:
545:
536:
527:
518:
509:
500:
491:
482:
476:
473:
470:
468:July 19, 2011
467:
464:
461:
460:
456:
453:
450:
447:
444:
441:
438:
437:
434:
432:
424:
421:
419:
416:
414:
411:
408:
405:
403:
400:
398:
395:
393:
390:
388:
385:
383:
380:
379:
378:
367:
364:
360:
357:
354:
351:
347:
343:
339:
336:
335:
334:
324:
321:
319:
316:
312:
307:
306:
303:
299:
297:
294:
291:
289:
286:
284:
281:
279:
276:
274:
271:
269:
268:User:Gaijin42
266:
263:
259:
256:
254:
251:
249:(AFC related)
248:
245:
243:
240:
238:
235:
233:
230:
228:
225:
223:
220:
218:
217:User:Jayen466
215:
213:
210:
208:
205:
200:Pigsonthewing
196:
191:
188:
185:
182:
179:
177:
174:
172:
169:
167:
164:
162:
161:User:Jtmorgan
159:
157:
153:
149:
146:
144:
141:
139:
136:
134:
131:
129:
126:
124:
121:
119:
116:
114:
111:
109:
108:User:Kubigula
106:
104:
101:
99:
96:
94:
91:
89:
86:
84:
81:
79:
76:
74:
71:
70:
69:
61:
58:
49:
47:
37:
33:
32:
29:
19:
1634:
1633:
1630:
1622:
1588:
979:; welcomes:
445:Date started
427:
376:
332:
300:
288:User:Ciphers
237:User:Snowolf
195:Andy Mabbett
103:User:Kudpung
83:User:Staeiou
67:
64:Participants
59:
55:
43:
1591:A/B testing
1206:SDPatrolBot
397:SDPatrolBot
318:User:Lexein
283:User:JohnCD
273:User:DMacks
247:User:mabdul
148:Eraserhead1
906:spam 1-4:
448:Date ended
392:Shared IPs
342:bitey-ness
305:Farmbrough
293:Nathan2055
232:User:Logan
227:User:Thogo
176:Ljhenshall
48:on Meta.
1226:Wikitable
786:Twinkle 1
439:Test name
253:Katarighe
166:User:Chzz
36:WP:UWTEST
1647:Category
1627:Analysis
1617:Z number
1246:2 months
1219:2 months
891:XLinkBot
603:Huggle 3
567:~2 weeks
555:Huggle 2
474:~2 weeks
462:Huggle 1
451:Duration
402:XLinkBot
348:and the
187:Beetstra
181:XLinkBot
113:User:DGG
28:Shortcut
1607:control
1408:1 month
1034:1 month
903:1 month
855:1 month
798:1 month
615:1 month
387:Twinkle
356:Suggest
382:Huggle
128:Ebe123
1526:28bot
423:28bot
409:(Afc)
373:Tests
338:Draft
329:Tasks
154:: -->
52:Scope
16:<
1572:z146
1563:z145
1554:z144
1545:z143
1514:z128
1505:z127
1496:z126
1487:z125
1478:z124
1469:z123
1460:z122
1451:z121
1442:z120
1433:z119
1424:z118
1415:z117
1383:z142
1374:z141
1365:z140
1356:z139
1347:z138
1338:z137
1329:z136
1320:z135
1311:z134
1302:z133
1293:z132
1284:z131
1194:z116
1185:z115
1176:z114
1167:z113
1158:z112
1149:z111
1140:z110
1131:z109
1122:z108
1113:z107
1104:z106
1095:z105
1086:z104
1077:z103
1068:z102
1059:z101
1050:z100
302:Rich
262:talk
152:talk
150:<
1041:z99
1011:z98
1002:z97
993:z96
984:z95
974:z94
965:z93
956:z92
947:z91
938:z90
929:z89
920:z88
911:z87
880:z86
871:z85
862:z84
832:z82
823:z81
814:z79
805:z78
775:z77
766:z76
757:z75
748:z74
739:z73
730:z72
721:z71
712:z70
703:z69
694:z68
685:z67
676:z66
667:z65
658:z64
649:z63
640:z62
631:z61
622:z60
592:z59
583:z58
574:z57
544:z56
535:z55
526:z54
517:z53
508:z52
499:z51
490:z50
481:z49
1649::
1615:A
1605:A
1575:}}
1569:{{
1566:}}
1560:{{
1557:}}
1551:{{
1548:}}
1542:{{
1517:}}
1511:{{
1508:}}
1502:{{
1499:}}
1493:{{
1490:}}
1484:{{
1481:}}
1475:{{
1472:}}
1466:{{
1463:}}
1457:{{
1454:}}
1448:{{
1445:}}
1439:{{
1436:}}
1430:{{
1427:}}
1421:{{
1418:}}
1412:{{
1386:}}
1380:{{
1377:}}
1371:{{
1368:}}
1362:{{
1359:}}
1353:{{
1350:}}
1344:{{
1341:}}
1335:{{
1332:}}
1326:{{
1323:}}
1317:{{
1314:}}
1308:{{
1305:}}
1299:{{
1296:}}
1290:{{
1287:}}
1281:{{
1255:,
1197:}}
1191:{{
1188:}}
1182:{{
1179:}}
1173:{{
1170:}}
1164:{{
1161:}}
1155:{{
1152:}}
1146:{{
1143:}}
1137:{{
1134:}}
1128:{{
1125:}}
1119:{{
1116:}}
1110:{{
1107:}}
1101:{{
1098:}}
1092:{{
1089:}}
1083:{{
1080:}}
1074:{{
1071:}}
1065:{{
1062:}}
1056:{{
1053:}}
1047:{{
1044:}}
1038:{{
1014:}}
1008:{{
1005:}}
999:{{
996:}}
990:{{
987:}}
981:{{
977:}}
971:{{
968:}}
962:{{
959:}}
953:{{
950:}}
944:{{
941:}}
935:{{
932:}}
926:{{
923:}}
917:{{
914:}}
908:{{
883:}}
877:{{
874:}}
868:{{
865:}}
859:{{
835:}}
829:{{
826:}}
820:{{
817:}}
811:{{
808:}}
802:{{
778:}}
772:{{
769:}}
763:{{
760:}}
754:{{
751:}}
745:{{
742:}}
736:{{
733:}}
727:{{
724:}}
718:{{
715:}}
709:{{
706:}}
700:{{
697:}}
691:{{
688:}}
682:{{
679:}}
673:{{
670:}}
664:{{
661:}}
655:{{
652:}}
646:{{
643:}}
637:{{
634:}}
628:{{
625:}}
619:{{
595:}}
589:{{
586:}}
580:{{
577:}}
571:{{
547:}}
541:{{
538:}}
532:{{
529:}}
523:{{
520:}}
514:{{
511:}}
505:{{
502:}}
496:{{
493:}}
487:{{
484:}}
478:{{
433:.
308:,
1639:.
1602:.
1249:—
1222:—
365:.
313:.
264:)
260:(
202:)
198:(
133:Σ
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.