Loading...
|
Please use this identifier to cite or link to this item:
https://nccur.lib.nccu.edu.tw/handle/140.119/33021
|
| Title: | Fuzzy Partial Credit Scaling: Applying Fuzzy Set Theory to Scoring Rating Scales |
| Authors: | 游森期
Yu, Sen-Chi |
| Contributors: | 余民寧
Yu, Min-Ning
游森期
Yu, Sen-Chi |
| Keywords: | 模糊部份計分法
模糊集合論
羅許模式
結構方程式模式
憂鬱
fuzzy partial credit scaling
fuzzy set theory
Rasch model
structure equation modeling
depression |
| Date: | 2004 |
| Issue Date: | 2009-09-17 15:06:42 (UTC+8) |
| Abstract: | 本研究的目的在於結合部份計分模式(partial credit model, PCM)與模糊集合論(fuzzy set theory)，提出評定量表的不同計分方式：模糊部份計分法(fuzzy partial credit scaling, FPCS)。FPCS是根據 PCM 所估計出的梯度參數(step parameters)來建構三角形模糊數，三角形模糊數代表選擇某個特定選項的受試者的能力分配情形。接著，利用中心法(center of gravity method) 將三角形模糊數解模糊化為純量。最後，利用隸屬度當作權重，計算個別受試者的模糊觀察分數，並且用模糊觀察分數當作量表的總分。
本研究採用貝克憂鬱量表(Beck Depression Inventory-II, BDI)中文版為研究工具。本研究的樣本分為憂鬱症病患與非憂鬱症的一般大學生兩大類。240位憂鬱症病患樣本是由台北市立和平醫院精神科門診募集而來；321位大學生則以便利抽樣的方式募集而來。
為了驗証FPCS的有效性，本研究進行三個子研究，來比較FPCS與傳統計分法在信度、效度、集群分析的分類正確性。
子研究一探討FPCS的信度。本研究以Cronbach alpha係數來衡量量表的內部一致性，並且以結構方程式模式(structure equation modeling)進行驗證性因素分析所估計的各試題的變異數被潛在構念解釋的比例當作信度的指標。由研究結果顯示，以量表整體而言，FPCS計分的結果得到較高的內部一致性；以各題而言，量表各試題的變異數被潛在構念解釋的百分比高於傳統的原始分數。此結果顯示FPCS的計分方式可以降低測量誤差，提升信度。
子研究二探討FPCS的效度，本研究以精神科醫師的診斷當作效標，分別以FPCS與原始分數兩種不同的計分法當作自變項，以預測效度當作效度的指標。首先，將是否罹患憂鬱症編碼為二元變數，不同計分法所得到的量表分數當作自變數，進行Logistic迴歸分析。研究結果顯示，相較於原始分數，FPCS預測罹患憂鬱症的正確率由 74.8% 提升到 77.2%。接下來，依照所有樣本的憂鬱程度，區分為一般樣本、憂鬱症且緩解、憂鬱症無緩解三類，進行區別分析。研究結果顯示，相較於原始分數，FPCS分類正確率由 71.2% 提升到 80.7%。上述的研究結果顯示，FPCS具有較高的效度，可以降低誤判憂鬱症的機率。
子研究三比較模糊集群分析(fuzzy c-means, FCM)與傳統明確邏輯的集群分析。首先利用分群效度(clustering validity)指標，決定群數為三群。並以此結果，指定模糊集群、Wald法、k-means法之群數。為了比較分類的效果，將模糊集群之樣本，指定給獲得最大隸屬度之集群。並且以醫師的診斷的憂鬱程度當作評估分類結果之標準。研究結果顯示，相較於傳統明確邏輯的集群分析(Wald法、k-means法)，模糊集群分析得到分群結果，與醫師的診斷的結果有最高的相關。結果顯示模糊集群分析更能夠忠實的反映資料結構。
整體而言，相較於原始分數，FPCS有較高的信度、效度、分類正確性。此實証性研究結果支持了模糊集合論應用於心理學研究的可行性；多值的模糊邏輯比二值明確邏輯更能夠正確反映出人類的思維。
The aim of this study was to propose and validate the new scaling method, fuzzy partial credit scaling (FPCS), which combines fuzzy set theory with the partial credit model (PCM) to score rating scales. To achieve this goal, the Chinese version of BDI (Beck Depression Inventory-II) was administrated to a depressed sample of patients and a non-depressed sample. The depressed sample consisted of 240 outpatients who were diagnosed as depressed by a psychiatric doctor, while 321 undergraduate students were recruited for the nondepressed sample.
In FPCS, triangular fuzzy numbers were generated by step parameters to characterize distributions of each alternative value. Next, the center of gravity (COG) method was applied to “de-fuzzify” the fuzzy number into a scalar. Then, the “observed fuzzy scores” defined in FPCS were calculated as the sums of fuzzy number values weighted by membership degrees for the following analysis.
Three studies were performed to compare the differences in reliability, validity and clustering precision between the raw score and FPCS.
In Study One, the reliability issue of FPCS was discussed. The results of confirmatory factor analysis demonstrate that the BDI reliability was higher in FCPS than in raw scoring. That is, compared with raw scoring, scoring via FPCS produced fewer measurement errors, meaning that more variances in an item of BDI were explained by depression.
In Study Two, the predictive validity issue of FPCS was investigated. First, logistic regression analysis was used to predict the odds of suffering depression based on FPCS and the raw scores. The analytical results showed that, via FPCS, the probability of correct classification of depressed and non-depressed was raised from 74.8% to 77.2%. Next, discrimination analysis was performed to classify the subjects according to the severity of depression into three categories: non-depression, depression with remission and depression without remission. The analytical results exhibited that, via FPCS, the probability of correct classification of severity of depression was raised from 71.2% to 80.7%. These two statistical analyses consistently show that FPCS exhibited higher predictive validity than did the raw score. That is, BDI scoring via FPCS makes more accuracy predictions for depression than raw score.
In Study Three, fuzzy c-means (FCM) clustering was applied to partition the sample according to severity of depression. To examine explore whether fuzzy-based clustering methods uncover the information inherent in the latent structure more accurately than crisp clustering, FCM, Wald’s method, and k-means method were performed. The analytical results reveal that the association between the original and classified membership generated by FCM was stronger than that of the Wald and k-means methods. Hence, FCM revealed the data structure most accurately.
Overall, FPCS has been consistently shown to be superior to raw scoring in terms of reliability, validity, and clustering accuracy. This study has empirically shown that fuzzy set theory is applicable to psychological research. |
| Reference: | Agresti, A.(1996). An introduction to categorical data analysis. New York: John Wiley and Sons.
American Psychiatric Association (1994). Diagnostic and statistical manual of mental disorders (fourth edition). Washington DC: American Psychiatric Association.
Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561-573.
Andrich, D. (1988). Rasch model for measurement. New York: Sage.
Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory–II. San Antonio, TX: Psychological Corporation.
Beckham, E. E., Leber, W. R., & Youll, L. K. (1995). The diagnostic and classification of depression. In E. E. Beckham, & W. R, Leber (Eds.), Handbook of depression (2nd edition). New York: The Guildford Press.
Benter, P. M.(1988). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
Bezdek, J. C. (1981). Pattern recognition with fuzzy objective function algorithms. New York: Plenum Press.
Bilgic, T., & Turksen, B. (2000). Measurement of membership function: Theoretical and empirical work. In D.Dubios & H. Prade(Eds). Fundamentals of fuzzy sets (pp.195-232). Boston: Kluwer.
Bollen, K. A. (1989). Structural equations with latent variables. New York: John Wiley & Sons.
Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Lawrence Erlbaum Associates.
Breithaupt, K., & Zumbo, B.D. (2002). Sample invariance of the structural equation model and the item response model: A case study. Structural Equation Modeling, 9(3), 390–412.
Brown, M. W. & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J.S. Long (Eds.), Testing structural equation models (pp.136-162). New York: Sage.
Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum Associates.
Byrne, B. M., & Baron, P. (1994). Measuring adolescent depression: Test of equivalent factorial structure for English and French versions of the Beck Depression Inventory. Applied Psychology: An International Review, 43, 33-47.
Carpenter, J. S., Andrykowski, M. A., Wilson, J., Hall, L. A., Rayens, M. K., Sachs, B., & Cunningham, L. C. (1998). Psychometrics for two forms of the Center for Epidemiologic Studies Depression Scale. Issues in Mental Health Nursing, 19, 481-494.
Chen, S. Y. (2000). Manual for the Chinese edition Beck Depression Inventory–II. Taipei: Chinese Behavior Science Corporation.
Cheng, S. J., & Hwang, C. L (1992). Fuzzy multiple attribute decision making: Methods and applications. Berlin: Springer-Verlag.
Delgado, M., Herrera, F., Herrera-Viedma, E., & Martinez, L. (1998). Combining numerical and linguistic information in group decision making. Journal of Information Science, 107, 177-194.
Dubios, D., Ostasiewicz, W., & Prade, H.(2000). Fuzzy sets: History and basic notions. In D. Dubios & H. Prade (Eds.), Fundamentals of fuzzy sets (pp.21-124). Boston: Kluwer.
Embretson, S. E. & Reise, S. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.
Guilford, J. P. (1954). Psychometric methods (2nd ed.). New York: McGraw-Hall.
Hair J, F., Tatham, R. L., Anderson, R. E., & Black, W. (1998). Multivariate data analysis (fifth Edition). New York: Prentice Hall.
Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston, MA: Kluwer.
Hattie, J. (1985). Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement, 9, 139-164.
Hisdal, E. (1988). Are grades of membership probabilities? Fuzzy Sets and Systems, 25, 325–348.
Hopkins, K. D., Stanley, J. C. & Hopkins, B. R. (1990). Education and psychological measurement and evaluation (7th ed.). Englewood Cliffs, NJ: Prentice Hall.
Hoppner, F., Klawonn, F., Kruse, R, & Runkler T.. (1999). Fuzzy clustering analysis. New York: John Wiley & Sons.
Hung, W. L., & Yang, M. S. (2005). Fuzzy clustering on LR-type fuzzy numbers with an application in Taiwanese tea evaluation. Fuzzy Set and Systems,150, 561-577.
Irwin, M., Artin, K H., & Oxman, M. N.(1999). Screening for depression in the older adult: Criterion validity of the 10-item CES-D. Archives of Internal Medicine, 159, 1701-1704.
Jöreskong, K.G. & Sörborm, D. (1993). LISERAL 8: Structural equation modeling with the SIMPLIS command language. Mooresville, IN: Scientific Software Inc.
Klir, G., & Yuan, B. (1995). Fuzzy sets and fuzzy logic: Theory and applications. Englewood Cliffs, NJ: Prentice Hall.
Kohurt, F. J., Beckman, L. F., Evans, D.A., & Coroni-Huntley, J. (1993). Two short forms of the CES-D depression symptoms index. Journal of Aging and Health, 5, 179-193.
Kosko, B. (1993). Fuzzy thinking: The new science of fuzzy logic. New York: Hyperion.
Krefetz, D. G., Steer, R. A., Gulab, N. A., & Beck, A. T.(2002). Convergent validity of the Beck Depression Inventory–II with the Reynolds Adolescent Depression Scale in psychiatric inpatients. Journal of Personality Assessments, 78(3), 451–460.
Law, C. K. (1996). Using fuzzy numbers in educational grading system. Fuzzy Sets and Systems, 83, 311-323.
Lee, E. S., & Li, R. L. (1988). Comparison of fuzzy numbers based on the probability measure of fuzzy events. Computer and Mathematics with Applications, 15, 887-896.
Lin, C. T., & Lee, C. S. (1999). Neural fuzzy systems: A neuro-fuzzy synergism to intelligent systems. Upper Saddle River, NJ : Prentice Hall
Lin, Y. H. (2001). The simulation study of reliability of fuzzy linguistic scales. Journal of Test and Statistics, 9, 193-219.
Lin, Y. H. (2003a). The comparison of different algorithms and scoring. The Journal of Taichuang Teacher College, 17(2), 279-304.
Lin, Y. H. (2003b). F-cut: Fuzzy partition program.
Lin, Y. H. (2004). The data simulation and empirical study of fuzzy linguistic scoring. (NSC92-2413-H-142-004).
Linacre, J. M. (2005). A User`s guide to WINSTEPS Rasch-model computer programs. Chicago: Winsteps.
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
Masters, G. N., & Wright, B. D. (1984). The essential process in a family of measurement models. Psychometrika, (49), 529-544.
Masters, G. N.,& Wright, B. D. (1997). The partial credit model. In W. J. van der Linden & R. K. Hambleton(Eds.), Handbook of modern item response theory (pp.101-122). New York: Springer-Verlag.
Messick, S. (1989). Validity. In. R.. L. Linn. (Ed.), Educational measurement (3rd ed.)(pp.13-103). New York: Macmillan.
Mueller, R. O.（1996）.Basic principles of structural equation modeling: An introduction to LISREL and EQS. New York: Springer Verlag.
Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159-176.
Nguyen, H., Wu, B.L. (2000). Fuzzy mathematics and statistical analysis. Taipei: Junjie.
Nunnally, J. C., & Berstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hall.
O’Neill, T. R. (2002). Explaining rating scale usage: The semantic threshold for induced categories. Unpublished doctoral dissertation, University of Illinois at Chicago, Illinois.
PsychNet-UK(2005). Major depressive episode. [On-line]. Available: http://www.psychnet-uk.com/dsm_iv/major_depression.htm
Radloff, L. S.（1977）.The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement,1, 385-401.
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. [Danish Institute of Educational Research 1960, University of Chicago Press 1980, MESA Press 1993] Chicago: MESA Press.
Ross, T. J., Sellers, K. M., & Booker, J. M. (2002). Considerations for Using fuzzy set theory and probability theory. In T. J. Ross., J. M. Booker, & W. J. Parkinson (Eds.), Fuzzy logic and probability applications. Philadelphia: SIAM.
Samejima, F. (1969). Estimation of latent ability using response pattern of graded scores. Psychometric Monograph, 34 (17), Part 2.
Schumacker R. E., & Linacre J. M. (1996). Factor analysis and Rasch analysis. Rasch Measurement Transactions, 10, p. 470.
Stout, W. (1990). A new item response theory modeling approach with applications to unidimensional assessment and ability estimation. Psychometrika, 55, 293-326.
Tabachnick, B. G. & Fidell, L. (2001). Using multivariate statistics (4th Ed.). Boston: Allyn & Bacon.
Thurstone, L. L. (1931). Measurement of social attitudes. Journal of Abcdrmal and Social Psychology, 26, 249-269.
Tversky, A. (1977). Features of similarity. Psychological Review 84(4), 327–352.
Wang, W. C. (1996). Some controversial issues about the Rasch measurement model. Journal Education and Psychology Research, 19, 1-26.
Wang, W. C. (2004). Rasch measurement theory and application in education and psychology. Journal Education and Psychology Research, 27, (4), 637-694.
Wright, B. D. (1994).Rasch factor analysis. Rasch Measurement Transactions, 8,(1), 348-349.
Wright, B. D. (1999). Fundamental measurement for psychology. In S.E. Embretson & S.L. Hershberger (Eds.), The new rules of measurement: What every educator and psychologist should know (pp.235-255). Hillsdale, NJ: Lawrence Erlbaum.
Wright, B. D., & Linacre, J. M. (1989). Observations are always ordinal: measures, however, must be interval. Archives of Physical Medicine and Rehabilitation, 70, 857-860.
Wright, B. D., & Masters, G. N. (1982). Rating scale analysis: Rasch measurement. Chicago: MESA Press.
Wu, B. L. (1995). Fuzzy statistics analyzing: A new approach to survey research. Newsletter of the National Chengchi University, 2, 65-80.
Wu, B. L., & Hsu, Y. Y. (2004). The use of kernel set and sample memberships in the identification of nonlinear time series. Soft Computing, 8, 207-216.
Wu, B. L., & Lin, Y. H. (2002a). Fuzzy mode and its applications in educational and psychological assessment analysis. Paper Presented on the Second International Conference on Information. China: Beijing.
Wu, B. L., & Lin, Y. H. (2002b): The Introduction of Fuzzy Mode and Its Applications. Journal of Test Statistics, 47, 23-27.
Wu, B. L., & Sun, C. (1996). Fuzzy statistics and computation on the lexical semantics. Language, Information and Computation (PACLIC 11), 337-346. Seoul, Korea.
Wu, B. L., & Tseng, N. (2002). A new approach to fuzzy regression models with application to business cycle analysis. Fuzzy Sets and System. 130, 33-42.
Wu, B. L., & Yang, W. (1998). Fuzzy statistics and its applications in the social science research. In W. Yang (Ed.), Developing and applications of quantity methods in social sciences (pp. 289-316). Institute of Social Science, Academic Sinica.
Yang, M. S., Hwang, P. Y., & Chen, D. H. (2004). Fuzzy clustering algorithms for mixed feature variables. Fuzzy Set and Systems, 141, 301-317.
Zadeh, L. A. (1965). Fuzzy sets. Information and Control, 8, 338-352.
Zimmermann, H, J. (1996). Fuzzy set theory and its applications. Boston: Kluwer. |
| Description: | 博士
國立政治大學
教育研究所
90152513
93 |
| Source URI: | http://thesis.lib.nccu.edu.tw/record/#G0901525133 |
| Data Type: | thesis |
| Appears in Collections: | [教育學系] 學位論文
|
All items in 政大典藏 are protected by copyright, with all rights reserved.
|
