English  |  正體中文  |  简体中文  |  Post-Print筆數 : 27 |  Items with full text/Total items : 116001/147038 (79%)
Visitors : 57976051      Online Users : 298
RC Version 6.0 © Powered By DSPACE, MIT. Enhanced by NTU Library IR team.
Scope Tips:
  • please add "double quotation mark" for query phrases to get precise results
  • please goto advance search for comprehansive author search
    •  Adv. Search
    Home ‧ Login ‧ Upload ‧ Help ‧ About ‧ Administer Goto mobile version


    Please use this identifier to cite or link to this item: https://nccur.lib.nccu.edu.tw/handle/140.119/157034


    Title: 校務評鑑情境中的評分者效果之影響及控制
    The Impact and Control of the Rater Effects in the Context of School Evaluation
    Authors: 林奕宏
    Lin, Yi-Hung
    Contributors: 教育與心理研究
    Keywords: 多層面Rasch模式;校務評鑑;評分者效果;試題反應理論
    many-facet Rasch model;school evaluation;rater effects;item respons theory
    Date: 2025-03
    Issue Date: 2025-05-23 09:49:43 (UTC+8)
    Abstract: 校務評鑑透過學校內部評鑑及專家校務參訪，對學校表現提出改進建議，評鑑結果多用以判斷學校辦學績效，各級學校無不重視。專家以多點量表評定學校表現，涉及人為主觀判斷，難免受到評分者效果影響。為探討此影響的規模，本研究應用試題反應理論之多層面Rasch模式分析12位專家對46校的創造力課程以5點量表評分25項指標的資料，此情境類似校務評鑑，皆由多位專家以多點量表評分學校表現，以此作為校務評鑑中評分者效果影響的範例。結果發現：一、考量「評分者效果及相關的交互作用項」之競爭模式五最適配，Wright Map亦顯示評分者嚴苛度、評分者與學校之交互作用、評分者與指標之交互作用等項存在個別差異，表示評分者效果具有顯著影響；二、從適配度指標來看，多數評分者的嚴苛度符合模式預期，但多數評鑑指標的難度偏離模式預期，推測與評分者對指標難度的掌握不一致有關；三、學校的期望總分和實際總分、期望名次和實際名次皆有高相關，但有26%學校之總分差大於1，50%學校存在名次差，這些現象皆影響評比公平性。本研究提出建議如下：一、選擇適當的資料分析模式；二、減少評分者對學校知覺的月暈效應；三、提升評分者對評鑑目標的共識；四、應用調整後的得分及排名提升評鑑公平性。
    Background: School evaluation provides schools with improvement suggestions through school internal assessment and external experts’ visits. Schools pay much attention to school evaluation because the results of school evaluation are sometimes used to judge school performance. Experts’ rating behaviors involve human subjective judgment and are prone to the impact of rater effects. In order to investigate the magnitude of rater effects, the current study applies the many-facet Rasch model (MFRM) to analyze an empirical dataset which consists of 12 experts’ ratings for 46 schools’ creativity curriculum plan with a 5-point rating scale on 25 items. This situation is similar to school evaluation and is used as an example to demonstrate the impact of rater effects on school evaluation.
    Relation: 教育與心理研究, 48(1), 1-36
    Data Type: article
    DOI 連結: https://doi.org/10.53106/102498852025034801001
    DOI: 10.53106/102498852025034801001
    Appears in Collections:[教育與心理研究 TSSCI] 期刊論文

    Files in This Item:

    File Description SizeFormat
    48-1-1.pdf10736KbAdobe PDF11View/Open


    All items in 政大典藏 are protected by copyright, with all rights reserved.


    社群 sharing

    著作權政策宣告 Copyright Announcement
    1.本網站之數位內容為國立政治大學所收錄之機構典藏，無償提供學術研究與公眾教育等公益性使用，惟仍請適度，合理使用本網站之內容，以尊重著作權人之權益。商業上之利用，則請先取得著作權人之授權。
    The digital content of this website is part of National Chengchi University Institutional Repository. It provides free access to academic research and public education for non-commercial use. Please utilize it in a proper and reasonable manner and respect the rights of copyright owners. For commercial use, please obtain authorization from the copyright owner in advance.

    2.本網站之製作，已盡力防止侵害著作權人之權益，如仍發現本網站之數位內容有侵害著作權人權益情事者，請權利人通知本網站維護人員(nccur@nccu.edu.tw)，維護人員將立即採取移除該數位著作等補救措施。
    NCCU Institutional Repository is made to protect the interests of copyright owners. If you believe that any material on the website infringes copyright, please contact our staff(nccur@nccu.edu.tw). We will remove the work from the repository and investigate your claim.
    DSpace Software Copyright © 2002-2004  MIT &  Hewlett-Packard  /   Enhanced by   NTU Library IR team Copyright ©   - Feedback