240:
966:
are fixed. They are also responsible that QA teams produce formal and complete reports. This includes discarding duplicate and erroneous bug reports, as well as requesting clarifications. As the game nears alpha and beta stages, lead tester brings more testers into the team, coordinates with external testing teams and works with management and producers. Some companies may prevent the game going gold until lead tester approves it. Lead testers are also typically responsible for compiling representative samples of game footage for submission to regulatory bodies such as the
1322:. Although general text issues are a part of functionality testing, QA departments may employ dedicated localization testers. In particular, early Japanese game translations were rife with errors, and in recent years localization testers are employed to make technical corrections and review translation work of game scripts - catalogued collections of all the in-game text. Testers native to the region where a game is marketed may be employed to ensure the accuracy and quality of a game's localization.
1043:
840:
reference any problems they find in detailed reports, meet deadlines with assignments and have the skill level to complete the game titles on their most difficult settings. Most of the time the position of game tester is a highly stressful and competitive position with little pay yet is highly sought after for it serves as a doorway into the industry. Game testers are observant individuals and can spot minor defects in the game build.
118:
74:
33:
1458:
are not normally used by game testers, but are used by programmers for lower-level testing. In addition to the features of a test kit, dev kits usually have higher hardware specifications, most notably increased system memory. This allows developers to estimate early game performance without worrying
987:
are responsible for building automated test cases and frameworks as well as managing complex test problems such as overall game performance and security. These individuals usually have strong software development skills but with a focus on writing software which exposes defects in other applications.
965:
is the person responsible for the game working correctly and managing bug lists. A lead tester manages the QA staff. The lead tester works closely with designers and programmers, especially towards the end of the project. The lead tester is responsible for tracking bug reports and ensuring that they
980:
are responsible for checking that the game works, is easy to use, has actions that make sense, and contains fun gameplay. Testers need to write accurate and specific bug reports, and if possible providing descriptions of how the bug can be reproduced. Testers may be assigned to a single game during
1100:
10–12 an hour). Testing management is usually more lucrative, and requires experience and often a college education. An annual survey found that testers earn an average of $ 39k annually. Testers with less than three years' experience earn an average of US$ 25k while testers with over three years'
1431:
kits. The main difference from consumer units is the ability to load games from a burned disc, USB stick, or hard drive. The console can also be set to any publishing region. This allows game developers to produce copies for testing. This functionality is not present in consumer units to combat
1013:
Some games studios are starting to take a more technical approach to game QA that is more inline with traditional software testing. Technical Test positions are still fairly rare throughout the industry but these jobs are often full-time positions with long term career paths and require a 4-year
852:
Quality assurance is a critical component in game development, though the video game industry does not have a standard methodology. Instead developers and publishers have their own methods. Small developers do not generally have QA staff; however, large companies may employ QA teams full-time.
1196:
is most commonly associated with the phrase "game testing", as it entails playing the game in some form. Functionality testing does not require extensive technical knowledge. Functionality testers look for general problems within the game itself or its user interface, such as stability issues,
856:
Testing starts as soon as first code is written and increases as the game progresses towards completion. The main QA team will monitor the game from its first submission to QA until as late as post-production. Early in the game development process the testing team is small and focuses on daily
866:
stage, the testing team will have clear assignments for each day. Tester feedback may determine final decisions of exclusion or inclusion of final features. Introducing testers with fresh perspectives may help identify new bugs. At this point the lead tester communicates with the producer and
839:
Now most game developers rely on their highly technical and game savvy testers to find glitches and 'bugs' in either the programming code or graphic layers. Game testers usually have a background playing a variety of different games on a multitude of platforms. They must be able to notate and
1236:
material, are the responsibility of the game testers. Even a single violation in submission for license approval may have the game rejected, possibly incurring additional costs in further testing and resubmission. In addition, the delay may cause the title to miss an important launch window,
861:
stage, more team members are employed and test plans are written. Sometimes features that are not bugs are reported as bugs and sometimes the programming team fails to fix issues first time around. A good bug-reporting system may help the programmers work efficiently. As the projects enters
887:
before a deadline, the game-test team is required to test late-added features and content without delay. During this period staff from other departments may contribute to the testing—especially in multiplayer games. One example of sustained crunch, especially among the QA team, was at
1146:. After the developer fixes the issue, the tester verifies that the bug no longer occurs. Not all bugs are addressed by the developer, for example, some bugs may be claimed as features (expressed as "NAB" or "not a bug"), and may also be "waived" (given permission to be ignored) by
1395:
may involve separate multiplayer QA team if the game has significant multiplayer portions. This testing is more common with PC games. The testers ensure that all connectivity methods (modem, LAN, Internet) are working. This allows single player and multiplayer testing to occur in
1009:
testers. In some cases, testers employed by a publisher may be sent to work at the developer's site. The most aggressive recruiting season is late summer/early autumn, as this is the start of the crunch period for games to be finished and shipped in time for the holiday season.
1256:, if the game targets a particular content rating. Testers must report objectionable content that may be inappropriate for the desired rating. Similar to licensing, games that do not receive the desired rating must be re-edited, retested, and resubmitted at additional cost.
867:
department heads daily. If the developer has an external publisher, then coordination with publisher's QA team starts. For console games, a build for the console company QA team is sent. Beta testing may involve volunteers, for example, if the game is multiplayer.
1330:, in the context of video games, involves leaving the game running for prolonged periods time in various modes of operation, such as idling, paused, or at the title screen. This testing requires no user interaction beyond initial setup, and is usually managed by
946:
are responsible for setting testing deadlines in coordination with marketing and quality assurance. They also manage many items outside of game testing, relating to the overall production of a title. Their approval is typically required for final submission or
1227:
publishes a set of "guidelines" (Lotcheck). Some of these requirements are highly technical and fall outside the scope of game testing. Other parts, most notably the formatting of standard error messages, handling of memory card data, and handling of legally
1242:
The requirements are proprietary documents released to developers and publishers under confidentiality agreements. They are not available for the general public to review, although familiarity with these standards is considered a valuable skill to have as a
843:
A common misconception is that all game testers enjoy alpha or beta version of the game and report occasionally found bugs. In contrast, game testing is highly focused on finding bugs using established and often tedious methodologies before alpha version.
1370:. QA checks to see whether the bug is still there (regression) and then runs similar tests to see whether the fix broke something else. That second stage is often called "halo testing"; it involves testing all around a bug, looking for other bugs.
811:
expertise, analytic competence, critical evaluation skills, and endurance. In recent years the field of game testing has come under fire for being extremely strenuous and unrewarding, both financially and emotionally.
1447:
and connectors for other testing equipment. Test kits contain additional options, such as running automated compliance checks, especially with regard to save data. The system software also allows the user to capture
1388:
running in a particular program. Load testing may require a large group of testers or software that emulates heavy activity. Load testing also measures the capability of an application to function correctly under
835:
employ a large QA staff for testing various games from different developers. Despite the large QA infrastructure most publishers have, many developers retain a small group of testers to provide on-the-spot QA.
875:
bugs. Testing requires creative gameplay to discover often subtle bugs. Some bugs are easy to document, but many require detailed description so a developer can replicate or find the bug. Testers implement
870:
Testers receive scheduled uniquely identifiable game builds from the developers. The game is play-tested and testers note any uncovered errors. These may range from bugs to art glitches to logic errors and
1354:
stage of development. Often this refers to the first publicly available version of a game. Public betas are effective because thousands of fans may find bugs that the developer's testers did not.
1017:
Some testers use the job as a stepping stone in the game industry. QA résumés, which display non-technical skill sets, tend towards management, than to marketing or production. Applicants for
880:
to avoid logging bugs multiple times. Many video game companies separate technical requirement testing from functionality testing altogether since a different testing skillset is required.
1278:. Compatibility testing team test major functionality of the game on various configurations of hardware. Usually a list of commercially important hardware is supplied by the publisher.
1207:
is the reason for the existence of game testing labs. First-party licensors for console platforms have strict technical requirements titles licensed for their platforms. For example,
824:
was in charge of all the testing. No more than one or two testers were required due to the limited scope of the games. In some cases, the programmers could handle all the testing.
1927:
1140:
checks the malfunction. This is outside the scope of game tester duties, although inconsistencies in the report may require more information or evidence from the tester.
1270:
titles, nearing the end of development as much of the compatibility depends on the final build of the game. Often two rounds of compatibility tests are done - early in
2047:
1314:
1001:
diploma and with no technical expertise, suffice. Game testing is normally a full-time job for experienced testers; however, many employees are hired as
514:
1189:, are borrowed directly from general software testing techniques. Outlined below are the most important methodologies, specific to video games.
1308:. Compatibility or performance issues may be either fixed by the developer or, in case of legacy hardware and software, support may be dropped.
1053:
937:
The organization of staff differs between organizations; a typical company may employ the following roles associated with testing disciplines:
759:
2072:
1765:
914:
are essential problems that require attention; however, the game may still be playable. Multiple B bugs are equally severe to an A bug.
2030:
2042:
948:
1177:. Methodologies are continuously refined and may differ for different types of games (for example, the methodology for testing an
1130:
are included in the report. Developers may request additional documentation such as a real-time video of the bug's manifestation.
454:
321:
1994:
997:
Game QA is less technical than general software QA. Game testers most often require experience however occasionally only a
182:
1249:
967:
540:
154:
721:
2013:
1975:
1956:
1913:
1377:
1083:
752:
219:
201:
60:
161:
494:
464:
981:
its entire production, or brought onto other projects as demanded by the department's schedule and specific needs.
2062:
1402:
refers to attempts to mathematically model player experience and predict player's preference for or liking of a
2029:
Lahti, M., Game testing in
Finnish game companies, Master's thesis, Aalto University, School of Science, 2014,
1101:
experience earn US$ 43k. Testing leads, with over six years' experience, earn on an average of US$ 71k a year.
139:
1713:
1443:
have the same hardware specifications and overall appearance as a consumer unit, though often with additional
168:
1253:
971:
716:
709:
704:
370:
135:
46:
988:
Specific roles and duties will vary between studios. Many games are developed without any
Technical Testers.
745:
731:
1577:
1334:. Automated tools may be used for simulating repetitive actions, such as mouse clicks. Soaking can detect
1484:
726:
578:
150:
17:
1381:
650:
474:
1419:. Special test equipment is provided to developers and publishers. The most significant tools are the
304:
2067:
1856:
1459:
about optimizations. Dev kits are usually larger and look different from a test kit or consumer unit.
1385:
894:
635:
556:
519:
1291:. The hardware encompasses brands of different manufacturers and assorted input peripherals such as
853:
High-profile commercial games are professionally and efficiently tested by publisher QA department.
1444:
284:
279:
1169:
There is no standard method for game testing, and most methodologies are developed by individual
908:
are critical bugs that prevent the game from being shipped, for example, they may crash the game.
544:
484:
128:
239:
400:
311:
261:
1892:
1865:
1773:
1262:
827:
As games become more complex, a larger pool of QA resources, called "Quality
Assessment" or "
686:
489:
447:
385:
289:
1174:
1170:
1097:
884:
872:
832:
821:
583:
469:
459:
432:
273:
175:
8:
1305:
1304:
The testers also evaluate performance and results are used for game's advertised minimum
1147:
942:
877:
788:
656:
566:
328:
268:
252:
1919:
1358:
1127:
591:
427:
1061:
88:
2009:
1990:
1971:
1952:
1909:
1288:
1284:
1275:
1267:
1065:
828:
611:
504:
422:
380:
299:
92:
52:
1923:
1901:
1479:
1469:
1164:
1018:
807:. Interactive entertainment software testing is a highly technical field requiring
792:
616:
509:
333:
1433:
1367:
1123:
920:
are small and obscure problems, often in form of recommendation rather than bugs.
796:
524:
1342:
that manifest only over time. Soak tests are one of the compliance requirements.
1283:
Compatibility testing ensures that the game runs on different configurations of
1339:
1198:
1022:
1002:
561:
2056:
1415:
For consoles, the majority of testing is not performed on a normal system or
1151:
1137:
803:. The primary function of game testing is the discovery and documentation of
1905:
1363:
1346:
1326:
1186:
929:
A game tester is a member of a development team who performs game testing.
804:
681:
606:
596:
573:
390:
1136:. The developer responsible for the bug, such as an artist, programmer or
2043:
Article: The Basics of Test
Automation for Apps, Games And the Mobile Web
1335:
1182:
1026:
1014:
computer science degree and significant experience with test automation.
998:
640:
551:
365:
316:
2048:
Article: Architecture and
Infrastructure Aspects of Mobile Game Testing
1403:
800:
628:
405:
375:
356:
1474:
1449:
1233:
1229:
1216:
901:
Most companies rank bugs according to an estimate of their severity:
808:
661:
117:
1351:
1296:
1271:
1224:
1109:
A typical bug report progression of testing process is seen below:
1006:
889:
623:
412:
395:
1376:
tests the limits of a system, such as the number of players on an
1319:
1292:
1116:. Incorrect program behavior is analyzed and identified as a bug.
985:
SDET (Software
Development Engineer in Test) or Technical Testers
1274:
to allow time for issue resolution, and late in beta or during
1178:
1029:
positions need to demonstrate technical skills in these areas.
1052:
deal primarily with the United States and do not represent a
1237:
potentially costing the publisher even larger sums of money.
1854:
Fleming, Jeffrey (April 2008). "7th Annual Salary Survey".
1248:
Compliance may also refer to regulatory bodies such as the
1208:
232:
Software testing process for quality control of video games
1582:
1894:
Proceedings of the 9th conference on
Computing Frontiers
1096:
Game testing personnel are usually paid hourly (around
91:
by adding general information and discuss at the
1154:, or even lead testers, according to company policy.
1891:Yannakakis, Geogios N (2012). "Game AI revisited".
820:In the early days of computer and video games, the
142:. Unsourced material may be challenged and removed.
2054:
1711:
1122:. The bug is reported to the developers using a
1949:Andrew Rollings and Ernest Adams on game design
1714:"Stories of crunch, neglect for QA at Treyarch"
1884:
1735:
1733:
857:feedback for new code. As the game approaches
1050:The examples and perspective in this section
753:
1532:
1530:
362:Specialized / alternative-paradigmatic types
1970:(2nd ed.). Thomson Course Technology.
1730:
1695:
1693:
1691:
1689:
1676:
1674:
1672:
1670:
1668:
1666:
1664:
1651:
1649:
1647:
1645:
1561:
1559:
1557:
61:Learn how and when to remove these messages
1985:Moore, Michael E.; Novak, Jeannie (2010).
1890:
1632:
1630:
1628:
1626:
1624:
1622:
1597:
1595:
1593:
1591:
1068:, or create a new section, as appropriate.
760:
746:
1763:
1527:
1517:
1515:
1513:
1511:
1126:system. The circumstances of the bug and
1084:Learn how and when to remove this message
220:Learn how and when to remove this message
202:Learn how and when to remove this message
1947:Adams, Ernest; Rollings, Andrew (2003).
1823:
1686:
1661:
1642:
1554:
1853:
1757:
1619:
1588:
1384:active on the screen, or the number of
14:
2055:
1508:
83:one specialized aspect of the subject
1036:
140:adding citations to reliable sources
111:
67:
26:
1933:from the original on 8 August 2014.
1410:
883:If a video game development enters
24:
2073:Video game industry labor disputes
1578:"The Tough Life of a Games Tester"
722:List of video game industry people
25:
2084:
2036:
1201:issues, and game asset integrity.
1181:will be different from testing a
42:This article has multiple issues.
1213:Technical Requirements Checklist
1041:
515:Intellectual property protection
238:
116:
72:
31:
1872:
1847:
1835:
1811:
1799:
1787:
1745:
1712:Brendan Sinclair (2019-06-26).
1705:
1032:
127:needs additional citations for
50:or discuss these issues on the
1607:
1571:
1542:
1496:
1158:
924:
13:
1:
1940:
992:
717:List of video game publishers
705:List of video game developers
81:This article focuses only on
1989:. Delmar: Cengage Learning.
1772:. Didi Games. Archived from
732:List of video game magazines
7:
2023:
2003:
1636:
1601:
1565:
1536:
1485:Software release life cycle
1463:
1064:, discuss the issue on the
847:
727:List of video game websites
10:
2089:
1987:Game Industry Career Guide
1984:
1965:
1946:
1878:
1841:
1829:
1817:
1805:
1793:
1751:
1739:
1699:
1680:
1655:
1613:
1548:
1521:
1502:
1400:Player-experience modeling
1331:
1162:
1104:
892:during the development of
815:
651:Advertising in video games
1951:. New Riders Publishing.
1436:and grey-market imports.
1266:is normally required for
1185:). Many methods, such as
895:Call of Duty: Black Ops 4
520:Digital rights management
1490:
932:
1906:10.1145/2212908.2212954
1770:Research on Video Games
247:Part of a series on the
2063:Video game development
2004:Oxland, Kevin (2004).
1380:server, the number of
1366:has been fixed by the
1866:United Business Media
1452:for aid in debugging.
1263:Compatibility testing
1194:Functionality testing
1171:video game developers
831:" is necessary. Most
1900:. pp. 285–292.
1879:Adams, Rollings 2003
1362:is performed once a
1318:act as in-game text
1315:Localization testing
1062:improve this section
584:Downloadable content
136:improve this article
89:improve this article
2006:Gameplay and design
1966:Bates, Bob (2004).
1393:Multiplayer testing
1306:system requirements
878:concurrency control
789:video game industry
567:Episodic video game
253:Video game industry
2008:. Addison Wesley.
1359:Regression testing
1205:Compliance testing
1128:steps to reproduce
592:Games as a service
1996:978-1-4283-7647-2
1844:, pp. 84, 237-238
1842:Moore, Novak 2010
1818:Moore, Novak 2010
1806:Moore, Novak 2010
1752:Moore, Novak 2010
1522:Moore, Novak 2010
1276:release candidate
1221:Xbox Requirements
1094:
1093:
1086:
829:Quality Assurance
777:quality assurance
770:
769:
612:Microtransactions
381:Interactive movie
230:
229:
222:
212:
211:
204:
186:
110:
109:
65:
16:(Redirected from
2080:
2068:Software testing
2019:
2000:
1981:
1962:
1935:
1934:
1932:
1899:
1888:
1882:
1876:
1870:
1869:
1851:
1845:
1839:
1833:
1827:
1821:
1815:
1809:
1803:
1797:
1791:
1785:
1784:
1782:
1781:
1761:
1755:
1749:
1743:
1737:
1728:
1727:
1725:
1724:
1718:gameindustry.biz
1709:
1703:
1697:
1684:
1678:
1659:
1653:
1640:
1634:
1617:
1611:
1605:
1599:
1586:
1575:
1569:
1563:
1552:
1546:
1540:
1534:
1525:
1519:
1506:
1500:
1480:Game development
1470:Software testing
1411:Console hardware
1165:Software testing
1089:
1082:
1078:
1075:
1069:
1045:
1044:
1037:
805:software defects
793:software testing
762:
755:
748:
617:In-game currency
242:
235:
234:
225:
218:
207:
200:
196:
193:
187:
185:
144:
120:
112:
105:
102:
96:
76:
75:
68:
57:
35:
34:
27:
21:
2088:
2087:
2083:
2082:
2081:
2079:
2078:
2077:
2053:
2052:
2039:
2026:
2016:
1997:
1978:
1959:
1943:
1938:
1930:
1916:
1897:
1889:
1885:
1877:
1873:
1852:
1848:
1840:
1836:
1828:
1824:
1816:
1812:
1804:
1800:
1792:
1788:
1779:
1777:
1764:Bob Johnstone.
1762:
1758:
1750:
1746:
1738:
1731:
1722:
1720:
1710:
1706:
1698:
1687:
1679:
1662:
1654:
1643:
1635:
1620:
1612:
1608:
1600:
1589:
1576:
1572:
1564:
1555:
1547:
1543:
1535:
1528:
1520:
1509:
1501:
1497:
1493:
1466:
1434:software piracy
1413:
1350:is done during
1340:rounding errors
1167:
1161:
1124:defect tracking
1107:
1090:
1079:
1073:
1070:
1059:
1046:
1042:
1035:
1003:temporary staff
995:
935:
927:
850:
818:
797:quality control
766:
737:
736:
700:
692:
691:
687:Game journalism
677:
669:
668:
653:
547:
533:
532:
525:Copy protection
450:
440:
439:
352:
344:
343:
276:
264:
233:
226:
215:
214:
213:
208:
197:
191:
188:
145:
143:
133:
121:
106:
100:
97:
86:
77:
73:
36:
32:
23:
22:
15:
12:
11:
5:
2086:
2076:
2075:
2070:
2065:
2051:
2050:
2045:
2038:
2037:External links
2035:
2034:
2033:
2025:
2022:
2021:
2020:
2014:
2001:
1995:
1982:
1976:
1963:
1957:
1942:
1939:
1937:
1936:
1914:
1883:
1871:
1857:Game Developer
1846:
1834:
1822:
1810:
1798:
1786:
1756:
1744:
1729:
1704:
1685:
1660:
1641:
1618:
1606:
1587:
1570:
1553:
1551:, pp. 178, 180
1541:
1526:
1507:
1494:
1492:
1489:
1488:
1487:
1482:
1477:
1472:
1465:
1462:
1461:
1460:
1453:
1427:kits, and the
1412:
1409:
1408:
1407:
1397:
1390:
1371:
1355:
1343:
1323:
1310:
1309:
1301:
1300:
1280:
1279:
1258:
1257:
1245:
1244:
1239:
1238:
1202:
1163:Main article:
1160:
1157:
1156:
1155:
1152:game designers
1141:
1131:
1117:
1114:Identification
1106:
1103:
1092:
1091:
1056:of the subject
1054:worldwide view
1049:
1047:
1040:
1034:
1031:
994:
991:
990:
989:
982:
975:
952:
943:Game producers
934:
931:
926:
923:
922:
921:
915:
909:
849:
846:
817:
814:
775:, also called
768:
767:
765:
764:
757:
750:
742:
739:
738:
735:
734:
729:
724:
719:
714:
713:
712:
701:
698:
697:
694:
693:
690:
689:
684:
678:
675:
674:
671:
670:
667:
666:
665:
664:
659:
647:
646:
645:
644:
643:
633:
632:
631:
621:
620:
619:
609:
603:
602:
601:
600:
599:
588:
587:
586:
581:
576:
571:
570:
569:
564:
562:Expansion pack
559:
548:
539:
538:
535:
534:
531:
530:
529:
528:
527:
522:
512:
507:
501:
500:
499:
498:
497:
495:Content rating
487:
481:
480:
479:
478:
477:
472:
467:
462:
451:
446:
445:
442:
441:
438:
437:
436:
435:
425:
423:Arcade cabinet
419:
418:
417:
416:
415:
410:
409:
408:
403:
398:
388:
383:
378:
373:
368:
353:
350:
349:
346:
345:
342:
341:
336:
331:
326:
325:
324:
319:
309:
308:
307:
296:
295:
294:
293:
292:
287:
282:
271:
265:
260:
259:
256:
255:
249:
248:
244:
243:
231:
228:
227:
210:
209:
151:"Game testing"
124:
122:
115:
108:
107:
80:
78:
71:
66:
40:
39:
37:
30:
9:
6:
4:
3:
2:
2085:
2074:
2071:
2069:
2066:
2064:
2061:
2060:
2058:
2049:
2046:
2044:
2041:
2040:
2032:
2028:
2027:
2017:
2015:0-321-20467-0
2011:
2007:
2002:
1998:
1992:
1988:
1983:
1979:
1977:1-59200-493-8
1973:
1969:
1964:
1960:
1958:1-59273-001-9
1954:
1950:
1945:
1944:
1929:
1925:
1921:
1917:
1915:9781450312158
1911:
1907:
1903:
1896:
1895:
1887:
1880:
1875:
1867:
1863:
1859:
1858:
1850:
1843:
1838:
1831:
1826:
1819:
1814:
1807:
1802:
1795:
1790:
1776:on 2014-10-06
1775:
1771:
1767:
1760:
1753:
1748:
1742:, pp. 178-179
1741:
1736:
1734:
1719:
1715:
1708:
1701:
1696:
1694:
1692:
1690:
1682:
1677:
1675:
1673:
1671:
1669:
1667:
1665:
1657:
1652:
1650:
1648:
1646:
1638:
1633:
1631:
1629:
1627:
1625:
1623:
1615:
1610:
1603:
1598:
1596:
1594:
1592:
1585:
1584:
1579:
1574:
1567:
1562:
1560:
1558:
1550:
1545:
1538:
1533:
1531:
1523:
1518:
1516:
1514:
1512:
1505:, pp. 176-180
1504:
1499:
1495:
1486:
1483:
1481:
1478:
1476:
1473:
1471:
1468:
1467:
1457:
1454:
1451:
1446:
1442:
1439:
1438:
1437:
1435:
1430:
1426:
1422:
1418:
1417:consumer unit
1405:
1401:
1398:
1394:
1391:
1387:
1383:
1379:
1375:
1372:
1369:
1365:
1361:
1360:
1356:
1353:
1349:
1348:
1344:
1341:
1337:
1333:
1329:
1328:
1324:
1321:
1317:
1316:
1312:
1311:
1307:
1303:
1302:
1298:
1294:
1290:
1286:
1282:
1281:
1277:
1273:
1269:
1265:
1264:
1260:
1259:
1255:
1251:
1247:
1246:
1241:
1240:
1235:
1231:
1226:
1222:
1218:
1214:
1210:
1206:
1203:
1200:
1199:game mechanic
1195:
1192:
1191:
1190:
1188:
1184:
1180:
1176:
1172:
1166:
1153:
1149:
1145:
1142:
1139:
1138:game designer
1135:
1132:
1129:
1125:
1121:
1118:
1115:
1112:
1111:
1110:
1102:
1099:
1088:
1085:
1077:
1067:
1063:
1057:
1055:
1048:
1039:
1038:
1030:
1028:
1024:
1020:
1015:
1011:
1008:
1004:
1000:
986:
983:
979:
976:
973:
969:
964:
960:
956:
953:
950:
945:
944:
940:
939:
938:
930:
919:
916:
913:
910:
907:
904:
903:
902:
899:
897:
896:
891:
886:
881:
879:
874:
868:
865:
860:
854:
845:
841:
837:
834:
830:
825:
823:
813:
810:
806:
802:
798:
794:
790:
786:
782:
778:
774:
763:
758:
756:
751:
749:
744:
743:
741:
740:
733:
730:
728:
725:
723:
720:
718:
715:
711:
708:
707:
706:
703:
702:
696:
695:
688:
685:
683:
680:
679:
673:
672:
663:
660:
658:
655:
654:
652:
649:
648:
642:
639:
638:
637:
634:
630:
627:
626:
625:
622:
618:
615:
614:
613:
610:
608:
605:
604:
598:
595:
594:
593:
590:
589:
585:
582:
580:
577:
575:
572:
568:
565:
563:
560:
558:
555:
554:
553:
550:
549:
546:
542:
537:
536:
526:
523:
521:
518:
517:
516:
513:
511:
508:
506:
503:
502:
496:
493:
492:
491:
488:
486:
483:
482:
476:
473:
471:
468:
466:
463:
461:
458:
457:
456:
453:
452:
449:
444:
443:
434:
431:
430:
429:
426:
424:
421:
420:
414:
411:
407:
404:
402:
399:
397:
394:
393:
392:
389:
387:
384:
382:
379:
377:
374:
372:
369:
367:
363:
360:
359:
358:
355:
354:
348:
347:
340:
337:
335:
332:
330:
327:
323:
320:
318:
315:
314:
313:
310:
306:
303:
302:
301:
298:
297:
291:
288:
286:
283:
281:
278:
277:
275:
272:
270:
267:
266:
263:
258:
257:
254:
251:
250:
246:
245:
241:
237:
236:
224:
221:
206:
203:
195:
184:
181:
177:
174:
170:
167:
163:
160:
156:
153: –
152:
148:
147:Find sources:
141:
137:
131:
130:
125:This article
123:
119:
114:
113:
104:
94:
90:
84:
79:
70:
69:
64:
62:
55:
54:
49:
48:
43:
38:
29:
28:
19:
2005:
1986:
1967:
1948:
1893:
1886:
1874:
1861:
1855:
1849:
1837:
1825:
1813:
1801:
1789:
1778:. Retrieved
1774:the original
1769:
1766:"Didi Games"
1759:
1747:
1721:. Retrieved
1717:
1707:
1609:
1581:
1573:
1544:
1539:, p. 301-302
1498:
1455:
1450:memory dumps
1440:
1428:
1424:
1420:
1416:
1414:
1399:
1392:
1374:Load testing
1373:
1357:
1347:Beta testing
1345:
1336:memory leaks
1332:lead testers
1327:Soak testing
1325:
1313:
1261:
1220:
1212:
1211:publishes a
1204:
1193:
1187:unit testing
1168:
1144:Verification
1143:
1133:
1119:
1113:
1108:
1095:
1080:
1071:
1051:
1033:Compensation
1016:
1012:
996:
984:
977:
962:
958:
954:
941:
936:
928:
917:
911:
905:
900:
893:
882:
869:
863:
858:
855:
851:
842:
838:
826:
819:
795:process for
784:
780:
776:
773:Game testing
772:
771:
682:Game studies
607:Free-to-play
597:Cloud gaming
579:Crowdfunding
574:Early access
545:monetization
541:Distribution
485:Localization
361:
338:
305:Level design
216:
198:
189:
179:
172:
165:
158:
146:
134:Please help
129:verification
126:
101:January 2017
98:
87:Please help
82:
58:
51:
45:
44:Please help
41:
1968:Game Design
1637:Bethke 2003
1602:Bethke 2003
1566:Oxland 2004
1537:Oxland 2004
1368:programmers
1234:copyrighted
1230:trademarked
1183:casual game
1159:Methodology
1019:programming
999:high school
955:Lead tester
925:Game tester
885:crunch time
801:video games
787:within the
641:Battle pass
636:Season pass
552:Buy-to-play
475:South Korea
312:Programming
262:Development
18:Game tester
2057:Categories
1941:References
1830:Bates 2004
1794:Bates 2004
1780:2009-04-01
1740:Bates 2004
1723:2022-06-09
1700:Bates 2004
1681:Bates 2004
1656:Bates 2004
1614:Bates 2004
1549:Bates 2004
1503:Bates 2004
1404:video game
1223:(XR), and
1219:publishes
1175:publishers
1074:March 2010
1005:, such as
993:Employment
833:publishers
490:Censorship
448:Publishing
386:Nonviolent
357:Video game
290:Programmer
192:March 2010
162:newspapers
47:improve it
1475:Test plan
1441:Test kits
1396:parallel.
1297:joysticks
1217:Microsoft
1148:producers
1120:Reporting
1066:talk page
959:test lead
951:" status.
822:developer
809:computing
662:Advergame
433:Accessory
274:Developer
93:talk page
53:talk page
2024:Research
1928:Archived
1832:, p. 261
1796:, p. 180
1702:, p. 179
1683:, p. 178
1658:, p. 177
1616:, p. 176
1568:, p. 301
1464:See also
1456:Dev kits
1293:gamepads
1289:software
1285:hardware
1225:Nintendo
1134:Analysis
1060:You may
890:Treyarch
848:Overview
791:, is a
624:Loot box
557:AAA game
413:Non-game
406:Exergame
396:Art game
351:Products
329:Graphics
280:Designer
269:Producer
1924:4335529
1881:, p. 17
1808:, p. 25
1754:, p. 72
1639:, p. 53
1604:, p. 52
1524:, p. 95
1386:threads
1382:sprites
1320:editors
1243:tester.
1215:(TRC),
1105:Process
978:Testers
963:QA lead
816:History
785:testing
676:Related
657:in-game
455:Markets
428:Console
401:Edugame
391:Serious
339:Testing
176:scholar
2031:Thesis
2012:
1993:
1974:
1955:
1922:
1912:
1820:, p. 2
1179:MMORPG
1027:design
918:C bugs
912:B bugs
906:A bugs
505:Piracy
371:Erotic
366:Casual
317:Engine
300:Design
285:Artist
178:
171:
164:
157:
149:
1931:(PDF)
1920:S2CID
1898:(PDF)
1864:(4).
1580:from
1491:Notes
1445:ports
1425:debug
1389:load.
1025:, or
933:Roles
873:level
859:alpha
710:Indie
699:Lists
629:gacha
510:Clone
470:Japan
460:China
376:Indie
334:Music
183:JSTOR
169:books
2010:ISBN
1991:ISBN
1972:ISBN
1953:ISBN
1910:ISBN
1868:: 8.
1421:test
1352:beta
1295:and
1287:and
1272:beta
1254:PEGI
1252:and
1250:ESRB
1232:and
1209:Sony
1173:and
1098:US$
1007:beta
972:PEGI
970:and
968:ESRB
949:gold
864:beta
543:and
465:U.S.
155:news
1902:doi
1583:IGN
1429:dev
1423:or
1378:MMO
1364:bug
1338:or
1023:art
961:or
799:of
138:by
2059::
1926:.
1918:.
1908:.
1862:15
1860:.
1768:.
1732:^
1716:.
1688:^
1663:^
1644:^
1621:^
1590:^
1556:^
1529:^
1510:^
1406:.
1268:PC
1150:,
1021:,
957:,
898:.
783:)
781:QA
364::
322:AI
56:.
2018:.
1999:.
1980:.
1961:.
1904::
1783:.
1726:.
1299:.
1087:)
1081:(
1076:)
1072:(
1058:.
974:.
947:"
779:(
761:e
754:t
747:v
223:)
217:(
205:)
199:(
194:)
190:(
180:·
173:·
166:·
159:·
132:.
103:)
99:(
95:.
85:.
63:)
59:(
20:)
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.
