[صفحه اصلی ]   [Archive] [ English ]  
:: صفحه اصلي :: درباره نشريه :: آخرين شماره :: تمام شماره‌ها :: جستجو :: ثبت نام :: ارسال مقاله :: تماس با ما ::
:: دوره 20، شماره 1 - ( 1-1396 ) ::
جلد 20 شماره 1 صفحات 113-150 برگشت به فهرست نسخه ها
Investigating the Effect of the Training Program on Raters’ Oral Performance Assessment: A Mixed-Methods Study on Raters’ Think-Aloud Verbal Protocols
چکیده:   (998 مشاهده)
Although the use of verbal protocols is growing in oral assessment, research on the use of raters’ verbal protocols is rather rare. Moreover, those few studies did not use a mixed-methods design. Therefore, this study investigated the possible impacts of rater training on novice and experienced raters’ application of a specified set of standards in rating. To meet this objective, the study made use of verbal protocols produced by 20 raters who scored 300 test takers’ oral performances and analyzed the data both qualitatively and quantitatively. The outcomes demonstrated that through applying the training program, the raters were able to concentrate more on linguistic, discourse, and phonological features; therefore, the extent of their agreement increased specifically among the inexperienced raters. The analysis of verbal protocols also revealed that training how to apply a well-defined rating scale can foster its use for raters both validly and reliably. Various groups of raters approach the task of rating in different ways, which cannot be explored through pure statistical analysis. Thus, think-aloud verbal protocols can shed light on the vague sides of the issue and add to the validity of oral language assessment. Moreover, since the results of this study showed that inexperienced raters can produce protocols of higher quality and quantity in the use of macro and micro strategies to evaluate test takers’ performances, there is no evidence based on which decision makers should exclude inexperienced raters solely because of their lack of adequate experience.
متن کامل [PDF 1064 kb]   (407 دریافت)    
نوع مطالعه: پژوهشي | موضوع مقاله: تخصصي
دریافت: ۱۳۹۵/۸/۲۲ | پذیرش: ۱۳۹۵/۱۱/۲۷ | انتشار: ۱۳۹۵/۱۲/۳
ارسال نظر درباره این مقاله
نام کاربری یا پست الکترونیک شما:

CAPTCHA code



XML   English Abstract   Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Bijani H, Khabiri M. Investigating the Effect of the Training Program on Raters’ Oral Performance Assessment: A Mixed-Methods Study on Raters’ Think-Aloud Verbal Protocols. IJAL. 2017; 20 (1) :113-150
URL: http://ijal.khu.ac.ir/article-1-2766-fa.html

Investigating the Effect of the Training Program on Raters’ Oral Performance Assessment: A Mixed-Methods Study on Raters’ Think-Aloud Verbal Protocols. زبانشناسی کاربردی. 1396; 20 (1) :113-150

URL: http://ijal.khu.ac.ir/article-1-2766-fa.html



دوره 20، شماره 1 - ( 1-1396 ) برگشت به فهرست نسخه ها
Iranian Journal of Applied Linguistics
Persian site map - English site map - Created in 0.15 seconds with 31 queries by YEKTAWEB 3741