Writing portfolio assessment and inter-rater reliability at Yıldız Technical University school of foreign languages basic English department

Abstract

ÖZET<,/',=7(.1ø.h1ø9(56ø7(6ø<$%$1&,'ø//(5<h.6(.2.8/87(0(/ø1*ø/ø=&(%g/h0h1'(<$=,03257)g<h'(ö(5/(1'ø50(6ø67(0ø9(2.8<8&8/$5$5$6,*h9(1ø5/ø.Türkkorur, Asuman<ÂNVHN/LVDQV<DEDQFÃ'LO2ODUDNøQJLOL]FHg÷UHWLPL%OÂPÂTez Yöneticisi: Dr Theodore S. RodgersOrtak Tez Yöneticisi: Dr Susan JohnstonTemmuz, 2005%XoDOÃúPD/D]ÃPSRUWI/OHULQLQNXOODQÃPÃQÃYHRQODUÃQRNX/XFXODUWDUDIÃQGDQGH÷HUOHQGLULOPHVLQLDUDúWÃUPÃúWÃUdDOÃúPD]HOOLNOH<ÃOGÃ]7HNQLNhQLYHUVLWHVL<DEDQFÃ'LOOHUYüksek ONXOX7HPHOøQJLOL]FH%OÂP¶QGHJÂQFHORODUDNNXOODQÃODQSRUWI/GH÷HUOHQGLUPHNULWHULLOHoDOÃúPDGDQHULOHQ/HQLSRUWI/GH÷HUOHQGLUPHNULWHULQLQRNX/XFXODUDUDVÃJÂYHQLUOL÷LQLNDUúÃODúWÃUPÃúWÃU.DWÃOÃPFÃODUÃQSRUWI/GH÷HUOHQGLUPHVLVWHPLLOHNULWHUOerÂ]HULQHJUÂúOHULGHDQDOL]HGLOPLúWLUdDOÃúPDEDKDU/DUÃ/ÃOÃQGD<ÃOGÃ]7HNQLNhQLYHUVLWHVL<DEDQFÃ'LOOHU<ÂNVHN2NXOX7HPHOøQJLOL]FH%OÂP¶QGH/ÂUÂWÂOPÂúWÂU9HULOHUSRUWI/GH÷HUOHQGLUPHRWXUXPODUÃRGDNJUXSWDUWÃúPDODUÃYHELUH/VHOJUÂúmelerDUDFÃOÃ÷Ã/ODWRSODQPÃúWÃU$UDúWÃUPD/D<ÃOGÃ]7HNQLNhQLYHUVLWHVL<DEDQFÃ'LOOHU<ÂNVHN2NXOX7HPHOøQJLOL]FH%OÂPÂQGHoDOÃúPDNWDRODQYH/D]ÃPGHUVOHULYHUHQ/HGL÷UHWLPoturumunda, hemJUHYOLVLNDWÃOPÃúWÃUg÷UHWLPJUHYOLOHULLNLIDUNOÃSRUWI/GH÷HUOHQGLUPHNXUXPGDNXOODQÃOPDNWDRODQNULWHULKHPGH/HQLDQDOLWLNNULWHULNXOODQDUDNRQLNL÷UHQFLSRUWI/ÂGH÷HUOHQGLUPLúOHUGLU'H÷HUOHQGLUPHRWXUXPODUÃQÃQQFHVLQGHYHVRQUDVÃQGDRGDNsonunda ise bireyselJUXSWDUWÃúPDODUÃJHUoHNOHúPLúWLU'H÷HUOHQGLUPHRWXUXPODUÃQÃnJUÂúPHOHU/HUDOPÃúWÃU'H÷HUOHQGLUPHRWXUXPODUÃRGDNJUXSWDUWÃúPDODUÃYHJUÂúPHOHUWH/EHND/GHGLOPLúYH/D]Ã/DGNÂOPÂúWÂU+HULNLNULWHUWÂUÂQHDLWRNX/XFXODUDUDVÃJÂYHQLUOLNLNLGH÷HUOHQGLUPHRWXUXPXQGDQelde edilen notlar NXOODQÃODUDNKHVDSODQPÃúWÃUøVWDWLVWLNLDQDOL]VRQXoODUÃLNLGH÷HUOHQGLUPHRWXPXQXQRNX/XFXODUDUDVÃJÂYHQLUOLNVRQXoODUÃQGDKHUKDQJLELUIDUNROPDGÃ÷ÃQÃJVWHUPLúWLU$QFDNRGDNJUXSWDUWÃúPDODUÃYHJUÂúPHOHULQFHOHQGL÷LQGH÷UHWLPJUHYOLHULQLQSRUWIöyGH÷HUOHQGLUPHVLQGHELUoHúLWVWDQGDUWDQDOLWLNYHJÂYHQLOLUNULWHUHVÃFDNEDNWÃNODUÃJUÂOPÂúWÂU$QDKWDUNHOLPHOHU<D]ÃPSRUWI/ÂGH÷HUOHQGLUPHVLRNX/XFXODUDUDVÃJÂYHQLUOLNDOWHUQDWLIGH÷HUOHQGLUPH.

ABSTRACTWRITING PORTFOLIO ASSESSMENT AND INTER-RATER RELIABILITY ATYILDIZ TECHNICAL UNIVERSITY SCHOOL OF FOREIGN LANGUAGES BASICENGLISH DEPARTMENTTürkkorur, AsumanMA Department of Teaching English as a Foreign LanguageSupervisor: Dr. Theodore S. RodgersCo-supervisor: Dr. Susan JohnstonThis research study investigated the use of writing portfolios and their assessment by raters.In particular it compared the inter-rater reliability of the portfolio assessment criteria currentlyin use and the newSRUWIROLRDVVHVVPHQWFULWHULDSURSRVHGIRU<ÃOGÃ]7HFKQLFDO8QLYHUVLW/School of Foreign Languages, Basic English Department. The perspectives of the participantson the portfolio assessment scheme and the criteria were also analyzed. This study wascondXFWHGDW<ÃOGÃ]7HFKQLFDO8QLYHUVLW/6FKRRORI)RUHLJQ/DQJXDJHV%DVLF(QJOLVKDepartment in the spring semester of 2005.Data were collected through portfolio grading sessions, focus group discussions andindividual interviews. The participants in the study were seven English writing instructorsFXUUHQWO/ZRUNLQJDW<ÃOGÃ]7HFKQLFDO8QLYHUVLW/6FKRRORI)RUHLJQ/DQJXDJHV%DVLFEnglish Department. The instructors scored twelve student portfolios on two differentsessions using the criteria customarily used in the institution and the new analytic criteria.Focus group discussions were held before and after the grading sessions. At the end of the1grading sessions, instructors were interviewed individually. Grading sessions, focus groupdiscussions and interviews were audiotaped and transcribed.The inter-rater reliability for both of the criteria types was calculated and found to bemarginal. The results of the statistical analysis revealed that there was no difference in resultsof inter-rater reliability between the groups in both of the grading sessions. However, analysisof the focus group discussion and interviews indicated that instructors would appreciate someform of more standardized, analytic and reliable criteria for portfolio grading.Key words: Writing portfolio assessment, inter-rater reliability, alternative assessment.2