469:
English Test was used in the 2002 World Cup Korea/Japan to measure the
English skills of over 15,000 volunteers and assign the appropriate workers to the most English-intensive tasks. The Versant Spanish Test was used in a study by Blake, et al. (2008) to evaluate whether distance-learning courses are as valid a way to start learning a foreign language as traditional face-to-face classes that meet five times a week with respect to oral proficiency.
187:
73:
32:
460:
words in correct sequences as well as the pace, fluency, and pronunciation of those words in phrases and sentences. Base measures are then derived from the segments, syllables and words based on statistical models of native and non-native speakers. Much documentation has been produced regarding the accuracy of
Versant's automated scoring system.
353:
Versant tests measure "facility in a spoken language", defined as the ability to understand spoken language on everyday topics and to respond appropriately at a native-like conversational pace. While keeping up with the conversational pace, a person has to track what is being said, extract meaning as
713:
One of the common criticisms of the
Versant tests is that a machine cannot evaluate speaking skills as well as a human can. Knowledge Technologies, the company that produces and administers the test, claim that the Versant English Test's machine-generated scores are virtually indistinguishable from
442:
Test takers are given a Test
Identification Number and listen to a recorded examiner's voice for instructions which are also printed verbatim on the test paper or computer screen. Throughout the test, test takers listen to recorded item prompts read by a variety of native speakers. Because the test
340:
Additionally, several domain-specific tests have been created using the
Versant framework in collaboration with other organizations. These tests include the Versant Aviation English Test (for aviation personnel), the Versant Junior English Test (for learners of English, ages 5 to 12), and the Dutch
311:
Versant tests are typically fifteen-minute tests of speaking and listening skills for adult language learners. (Test length varies slightly depending on the test). The test is delivered over the telephone or on a computer and is scored by computer using pre-determined data-driven algorithms. During
281:) to assess the spoken language skills of non-native speakers. The Versant language suite includes tests of English, Spanish, Dutch, French, and Arabic. Versant technology has also been applied to the assessment of Aviation English, children's oral reading assessment, and adult literacy assessment.
824:
Balogh, J. & Bernstein, J. (2006). Workable models of standard performance in
English and Spanish. In Y. Matsumoto, D.Y. Oshima, O.R. Robinson, & P. Sells (Eds.), Diversity in language: Perspective and implications (pp. 20-41). Stanford, CA: Center for the Study of Language and Information
455:
The automated scoring technology is optimized using a large number of speech samples from both native and non-native speakers. Extensive data collection is typically carried out to collect a sufficient amount of such speech samples. These spoken responses are then transcribed to train an automatic
302:
technology. In 2002, the name PhonePass was changed to PhonePass SET-10 (Spoken
English Test) or simply SET-10. In 2003 Ordinate was acquired by Harcourt Assessment and later in 2005 the name of the test changed to its current name, Versant. In January 2008, Harcourt Assessment (including Ordinate
717:
Another criticism is that the
Versant tests do not measure communicative abilities because there are no interaction exchanges between live participants. Versant, in Downey et al. (2008) claim that the psycholinguistic competencies that are assessed in their tests underlie a larger spoken language
459:
Each incoming response is then processed automatically by the speech recognizer that has been optimized for non-native speech. The words, pauses, syllables and phones are located in the recorded signal. The content of the response is scored according to the presence or absence of expected correct
468:
Versant tests are currently used by academic institutions, corporations, and government agencies around the world. Versant tests provide information that can be used to determine if employees or students have the necessary spoken language skills to interact effectively. For example, the
Versant
451:
Versant test scores are posted on-line within minutes of the completed test. Test administrators and test takers can view and print out their test results by entering their Test
Identification Number on the Versant website. The Versant score report is composed of an Overall score (a weighted
422:
Test takers listen to a question asking for an opinion and provide an answer with an explanation. The questions deal either with family life or with the test taker's preferences and choices. This task is used to collect a spontaneous speech sample. The test taker's responses are not scored
857:
Bernstein, J. & De Jong, J. H.A.L. (2001). An experiment in predicting proficiency within the Common Europe Framework Level Descriptors. In Y.N. Leung et al. (Eds.), Selected Papers from the Tenth International Symposium on English Teaching (pp. 8-14). Taipei, ROC: The Crane
814:
Bernstein, J. & Cheng, J. (2007). Logic and validation of fully automatic spoken English test. In M. Holland & F.P. Fisher (Eds.), The path of speech technologies in computer assisted language learning: From research toward practice (pp. 174-194). Florence, KY:
867:
Bernstein, J. De Jong, J. Pisoni, D. & Townshend, B. (2000). Two Experiments on Automatic Scoring of Spoken Language Proficiency. In P. Delcloque (Ed.) Proceedings of InSTIL2000: Integrating Speech Technology in Learning (pp. 57-61). University of Abertay Dundee,
396:
Test takers listen to questions and answer each of these questions with a single word or short phrase. Each question asks for basic information, or requires simple inferences based on time, sequence, number, lexical content, or logic.
413:
Test takers listen to a story and are then asked to describe what happened in their own words. Test takers are encouraged to tell as much of the story as they can, including the situation, characters, actions and ending.
297:
and test theory to provide an automatically delivered and automatically scored spoken language test. The first English test was called PhonePass. It was the first fully computerized test of spoken language using
354:
speech continues, and formulate and produce a relevant and intelligible response. The Versant tests are designed to measure these real-time psycholinguistic aspects of spoken performance in a second language.
303:
Corporation) was acquired by Pearson and Ordinate Corporation became part of the Knowledge Technologies group of Pearson. In June 2010, Versant Pro Speaking Test and Versant Pro Writing Test, were launched.
452:
combination of the subscores) and four diagnostic subscores: Sentence Mastery (i.e., grammar), Vocabulary, Fluency, and Pronunciation. The Overall score and subscores are reported on a scale from 20 to 80.
379:
Test takers read printed, numbered sentences. The sentences are relatively simple in structure and vocabulary, so they can be read easily and in a fluent manner by literate speakers of the target language.
696:
A series of validation studies has found that the Versant English Test correlates reasonably with other measures of spoken English skills. For example, the correlation between the Versant English Test and
1039:
Downey, R., Farhady, H., Present-Thomas, R., Suzuki, M., & Van Moere, A. (2008). Evaluation of the usefulness of the Versant for English test: A response. Language Assessment Quarterly, 5, 160-167.
848:
Blake, R., Wilson, N.L., Pardo-Ballestar, C., & Cetto, M. (2008). Measuring oral proficiency in distance, face-to-face, and blended classrooms. Language Learning and Technology, 12(3), pp.114-127.
439:
Versant tests can be administered over the telephone or on a computer. Test takers can access and complete the tests from any location where there is a landline telephone or an internet connection.
805:
Balogh, J., Barbier, I., Bernstein, J., Suzuki, M., & Harada, Y. (2005). A Common Framework for Developing Automated Spoken Language Tests in Multiple Languages. JART Journal, 1(1), 67-79.
312:
the test, the system presents a series of recorded prompts at a conversational pace and elicits oral responses from the test-taker. The Versant tests are available as several products:
1048:
Christian W. Chun (2008): Comments on ""Evaluation of the Usefulness of the Versant for English Test: A Response"": The Author Responds, Language Assessment Quarterly, 5:2, 168-172
718:
performance. This claim is supported by the concurrent validity data that Versant test scores correlate highly with other well-known oral proficiency interview tests such as
341:
immigration test (exclusively available through Dutch Embassies). The Versant scoring system also provides automated scoring of the spoken portion of the four-skills test,
83:
388:
Test takers repeat sentences verbatim. Sentences are presented in order of increasing difficulty. The audio item prompts are delivered at a natural conversational pace.
342:
197:
405:
Test takers are presented with three short phrases. The phrases are presented in random order and the test taker is asked to rearrange them into a sentence.
507:
495:
491:
487:
483:
1008:
976:
97:
of the topic and provide significant coverage of it beyond a mere trivial mention. If notability cannot be shown, the article is likely to be
212:
362:
Versant tests typically have six tasks: Reading, Repeats, Short Answer Questions, Sentence Builds, Story Retelling, and Open Questions.
929:
835:
944:
897:
320:
149:
252:
234:
168:
59:
121:
1080:
216:
128:
1015:
983:
94:
289:
In 1996, Jared Bernstein and Brent Townsend founded Ordinate Corporation to develop a system that would use
135:
945:"Research Reports: Mapping English Language Proficiency Test Scores onto the Common European Framework"
90:
106:
117:
45:
20:
767:
879:
836:"Korean Organizing Committee For the 2002 FIFA World Cup-Korea/Japan Has Chosen Ordinate's..."
423:
automatically, but these responses are available for human review by authorized listeners.
8:
273:. Versant tests were the first fully automated tests of spoken language to use advanced
772:
757:
482:
Versant test scores have been aligned with the Common European Framework of Reference (
299:
278:
102:
951:
923:
787:
762:
290:
274:
142:
98:
904:
443:
is automated, large numbers of tests can be administered and scored very rapidly.
204:
208:
1074:
895:
Relating IELTS scores to the Council of Europe's Common European Framework.:
486:). Below are the mappings of Versant scores and other tests' scores to the
51:
725:
The usefulness of Versant products has been challenged by a third party.
294:
270:
714:
scores given by repeated independent human raters at the Overall level.
269:
suite of tests are computerized tests of spoken language available from
701:
is r=0.75 and the correlation between the Versant English Test and
1009:"Mapping TOEFL iBT on the Common European Framework of Reference"
977:"Mapping TOEFL iBT on the Common European Framework of Reference"
89:
Please help to demonstrate the notability of the topic by citing
1060:
782:
777:
752:
719:
702:
698:
527:
522:
517:
512:
498:
scale of Oral Interaction Skills with reasonable accuracy.
747:
490:. Versant English overall scores can be used to predict
880:"Common European Framework of Reference for Languages"
1065:
215:, and by adding encyclopedic content written from a
942:Tannenbaum, Richard and Caroline E. Wylie (2005).
877:
1072:
446:
84:notability guidelines for products and services
950:. Educational Testing Services. Archived from
477:
708:
434:
60:Learn how and when to remove these messages
348:
253:Learn how and when to remove this message
235:Learn how and when to remove this message
169:Learn how and when to remove this message
357:
737:Ryan Down, Director, Product Management
1073:
928:: CS1 maint: archived copy as title (
306:
196:contains content that is written like
429:
180:
66:
25:
13:
14:
1092:
1054:
319:Versant English - Placement Test
41:This article has multiple issues.
185:
71:
30:
1042:
1033:
1001:
969:
936:
49:or discuss these issues on the
889:
871:
861:
851:
842:
828:
818:
808:
799:
324:Versant English - Writing Test
1:
885:. Cambridge University Press.
793:
734:Alistair Van Moere, President
728:
472:
838:AllBusiness.com. 2 Nov 2008.
463:
447:Automated scoring technology
7:
741:
478:Relationship to other tests
456:speech recognition system.
16:Suite of computerized tests
10:
1097:
1061:http://www.versanttest.com
878:Council of Europe (2001).
393:C. Short Answer Questions
345:, available in late 2009.
284:
91:reliable secondary sources
80:The topic of this article
18:
709:Machine-human correlation
82:may not meet Knowledge's
435:Automated administration
336:Versant Aviation English
21:Versant (disambiguation)
343:Pearson Test of English
1081:English language tests
1014:. 2007. Archived from
982:. 2007. Archived from
768:Pearson Language Tests
349:Versant test construct
277:technology (including
358:Test format and tasks
217:neutral point of view
957:on November 21, 2008
327:Versant Spanish Test
316:Versant English Test
19:For other uses, see
1021:on February 6, 2009
989:on February 6, 2009
910:on February 3, 2007
410:E. Story Retelling
402:D. Sentence Builds
333:Versant French Test
330:Versant Arabic Test
307:Product description
209:promotional content
1066:http://pearson.com
773:Speech Recognition
758:Language education
722:OPIs or ILR OPIs.
699:TOEFL iBT Speaking
523:TOEFL iBT Speaking
430:Versant technology
419:F. Open Questions
300:speech recognition
279:speech recognition
211:and inappropriate
86:
763:Pearson Education
694:
693:
427:
426:
291:speech processing
275:speech processing
263:
262:
255:
245:
244:
237:
179:
178:
171:
153:
81:
64:
1088:
1049:
1046:
1040:
1037:
1031:
1030:
1028:
1026:
1020:
1013:
1005:
999:
998:
996:
994:
988:
981:
973:
967:
966:
964:
962:
956:
949:
940:
934:
933:
927:
919:
917:
915:
909:
903:. Archived from
902:
893:
887:
886:
884:
875:
869:
865:
859:
855:
849:
846:
840:
839:
832:
826:
822:
816:
812:
806:
803:
501:
500:
365:
364:
258:
251:
240:
233:
229:
226:
220:
198:an advertisement
189:
188:
181:
174:
167:
163:
160:
154:
152:
111:
75:
74:
67:
56:
34:
33:
26:
1096:
1095:
1091:
1090:
1089:
1087:
1086:
1085:
1071:
1070:
1057:
1052:
1047:
1043:
1038:
1034:
1024:
1022:
1018:
1011:
1007:
1006:
1002:
992:
990:
986:
979:
975:
974:
970:
960:
958:
954:
947:
943:
941:
937:
921:
920:
913:
911:
907:
900:
898:"Archived copy"
896:
894:
890:
882:
876:
872:
866:
862:
856:
852:
847:
843:
834:
833:
829:
823:
819:
813:
809:
804:
800:
796:
744:
731:
711:
480:
475:
466:
449:
437:
432:
360:
351:
309:
293:technology and
287:
259:
248:
247:
246:
241:
230:
224:
221:
202:
190:
186:
175:
164:
158:
155:
112:
110:
88:
76:
72:
35:
31:
24:
17:
12:
11:
5:
1094:
1084:
1083:
1069:
1068:
1063:
1056:
1055:External links
1053:
1051:
1050:
1041:
1032:
1000:
968:
935:
888:
870:
860:
850:
841:
827:
817:
807:
797:
795:
792:
791:
790:
785:
780:
775:
770:
765:
760:
755:
750:
743:
740:
739:
738:
735:
730:
727:
710:
707:
703:IELTS Speaking
692:
691:
689:
687:
685:
682:
679:
675:
674:
671:
668:
665:
662:
659:
655:
654:
651:
648:
646:
643:
640:
636:
635:
632:
629:
626:
623:
620:
616:
615:
613:
610:
608:
605:
602:
598:
597:
595:
592:
590:
587:
584:
580:
579:
577:
575:
573:
570:
567:
563:
562:
557:
552:
547:
542:
537:
531:
530:
525:
520:
515:
510:
505:
494:levels on the
479:
476:
474:
471:
465:
462:
448:
445:
436:
433:
431:
428:
425:
424:
420:
416:
415:
411:
407:
406:
403:
399:
398:
394:
390:
389:
386:
382:
381:
377:
373:
372:
369:
359:
356:
350:
347:
338:
337:
334:
331:
328:
325:
322:
317:
308:
305:
286:
283:
261:
260:
243:
242:
213:external links
193:
191:
184:
177:
176:
79:
77:
70:
65:
39:
38:
36:
29:
15:
9:
6:
4:
3:
2:
1093:
1082:
1079:
1078:
1076:
1067:
1064:
1062:
1059:
1058:
1045:
1036:
1017:
1010:
1004:
985:
978:
972:
953:
946:
939:
931:
925:
906:
899:
892:
881:
874:
864:
854:
845:
837:
831:
825:Publications.
821:
811:
802:
798:
789:
786:
784:
781:
779:
776:
774:
771:
769:
766:
764:
761:
759:
756:
754:
751:
749:
746:
745:
736:
733:
732:
726:
723:
721:
715:
706:
704:
700:
690:
688:
686:
683:
680:
677:
676:
672:
669:
666:
663:
660:
657:
656:
652:
649:
647:
644:
641:
638:
637:
633:
630:
627:
624:
621:
618:
617:
614:
611:
609:
606:
603:
600:
599:
596:
593:
591:
588:
585:
582:
581:
578:
576:
574:
571:
568:
565:
564:
561:
558:
556:
553:
551:
548:
546:
543:
541:
538:
536:
533:
532:
529:
526:
524:
521:
519:
516:
514:
511:
509:
506:
503:
502:
499:
497:
493:
489:
485:
470:
461:
457:
453:
444:
440:
421:
418:
417:
412:
409:
408:
404:
401:
400:
395:
392:
391:
387:
384:
383:
378:
375:
374:
370:
367:
366:
363:
355:
346:
344:
335:
332:
329:
326:
323:
321:
318:
315:
314:
313:
304:
301:
296:
292:
282:
280:
276:
272:
268:
257:
254:
239:
236:
228:
218:
214:
210:
206:
200:
199:
194:This article
192:
183:
182:
173:
170:
162:
151:
148:
144:
141:
137:
134:
130:
127:
123:
120: –
119:
115:
114:Find sources:
108:
104:
100:
96:
92:
85:
78:
69:
68:
63:
61:
54:
53:
48:
47:
42:
37:
28:
27:
22:
1044:
1035:
1023:. Retrieved
1016:the original
1003:
991:. Retrieved
984:the original
971:
959:. Retrieved
952:the original
938:
912:. Retrieved
905:the original
891:
873:
863:
853:
844:
830:
820:
810:
801:
724:
716:
712:
695:
559:
554:
549:
544:
539:
534:
481:
467:
458:
454:
450:
441:
438:
371:Description
361:
352:
339:
310:
288:
266:
264:
249:
231:
222:
207:by removing
203:Please help
195:
165:
159:January 2015
156:
146:
139:
132:
125:
113:
57:
50:
44:
43:Please help
40:
1025:January 20,
993:January 20,
961:January 20,
914:January 20,
858:Publishing.
705:is r=0.77.
385:B. Repeats
376:A. Reading
271:Pearson PLC
95:independent
815:Routledge.
794:References
729:Management
473:Validation
295:linguistic
205:improve it
129:newspapers
103:redirected
46:improve it
868:Scotland.
528:TOEFL iBT
464:Score use
118:"Versant"
93:that are
52:talk page
1075:Category
924:cite web
742:See also
673:110-120
625:3.5-4.5
504:Versant
225:May 2013
653:87-109
569:<A1
285:History
267:Versant
143:scholar
107:deleted
678:79-80
664:6.5-7
658:69-78
650:23-28
639:58-68
634:57-86
631:19-23
619:47-57
612:13-19
601:36-46
583:26-35
566:20-25
550:10-990
145:
138:
131:
124:
116:
99:merged
1019:(PDF)
1012:(PDF)
987:(PDF)
980:(PDF)
955:(PDF)
948:(PDF)
908:(PDF)
901:(PDF)
883:(PDF)
783:TOEIC
778:TOEFL
753:IELTS
720:ACTFL
684:7.5+
667:880+
628:550+
594:8-13
560:0-120
540:A1-C2
535:20-80
518:TOEIC
513:IELTS
368:Task
150:JSTOR
136:books
105:, or
1027:2009
995:2009
963:2009
930:link
916:2009
670:28+
645:5-6
589:1-2
555:0-30
508:CEFR
496:CEFR
492:CEFR
488:CEFR
484:CEFR
265:The
122:news
788:TSE
748:ESL
681:C2
661:C1
642:B2
622:B1
604:A2
586:A1
545:0-9
1077::
926:}}
922:{{
607:3
572:0
101:,
55:.
1029:.
997:.
965:.
932:)
918:.
256:)
250:(
238:)
232:(
227:)
223:(
219:.
201:.
172:)
166:(
161:)
157:(
147:·
140:·
133:·
126:·
109:.
87:.
62:)
58:(
23:.
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.