大型資料庫國小四年級自然科學習成就評量標準設定結果之效度評估 Validation of the Standard Setting Procedure for a Large Scale 4th Grade Science

Abstract

學習成就評量資料庫建置目的之一，在於描述學生於各學科的學習成就表現概況；而學習成就表現的描述，即牽涉到標準設定議題。隨著臺灣學生學習成就評量資料庫對於國小四年級自然科之評量架構調整，致使沿用的表現標準已多不符合實務運用，而興起重新修訂之舉。本研究主要目的在於評估2009 年自然科學習成就評量國小四年級標準設定結果之效度，以Kane（1994, 2001）的效度評估證據為依據，藉由效度的過程證據、內部證據以及外部證據，作為標準設定結果之效度證據來源。結果發現，從各項效度證據來看，國小四年級自然科標準設定可由標準設定成員的組成及其回應、設定結果的一致性，以及外推論於數學成就的效度外部證據得到支持。本研究最後提出數項建議，供未來標準設定研究者參考。 One of the main purposes for constructing an academic achievement database is to understand the students’ academic performance for each content area. Standard setting is the main issue in the academic achievement. Due to the adjustment of the test blueprint for Taiwan Assessment of Student Achievement 4th grade science, the previous performance level description is outmoded for practice. Therefore, modifying the standards is necessary. The purpose of this study is to validate a science standard setting procedure designed for 2009 4th grade science students. Based on Kane’s (1994, 2001) framework for validation, this study collected procedural evidence, internal evidence, as well as external evidence using mathematics academic performance. Several suggestions are provided in the conclusion for further studies.

Keywords

• 效度評估
• 書籤標定法
• 標準設定
• validation
• Bookmark method
• standard setting