The server is under maintenance between 08:00 to 12:00 (GMT+08:00), and please visit later.
We apologize for any inconvenience caused
Login  | Sign Up  |  Oriprobe Inc. Feed
China/Asia On Demand
Journal Articles
Laws/Policies/Regulations
Companies/Products
Bookmark and Share
The development of the indexes to identify the rationality of test Q matrices based on DINA model
Author(s): 
Pages: 1239-1247
Year: Issue:  5
Journal: Psychological Science

Keyword:  cognitive diagnosistest Q matrixcorrect identification rateDINA model;
Abstract: The purpose of cognitive diagnosis(CD) is to detect the internal psychological rules and the human processing mechanism. Since a cognitive diagnosis assessment would report the features about individuals, such as his/her current cognitive status, the cognitive procedure, and the processing skills and knowledge structures etc., it would help teachers and students learn a lot about an individual, and choose a more effective way to teach or learn. In short, CD would play an important role on an individual’s development. More and more attention should be paid to the cognitive diagnosis assessment.With more and more applications of CD in practice, researchers and practitioners found out that the task to identify a test Q matrix was very hard. Even if a test Q matrix was established, it would also be difficult to evaluate its correctness. Virtually, there might be several possible test Q matrices provided by the experts at the same time. Practitioners are always confused about which might be the right. Corresponding to this phenomenon, they need to find a method to determine which one is the most appropriate one.This study attempted to propose some indexes which might be used for the selection of a test Q matrix. In order to verify the effectiveness of the indexes, a comparison study was done. It aimed to find out the advantages and disadvantages of each index, and to get an idea of which indexes might be used to choose Q matrices. All these kinds of information could be very useful for the applicants. In this study, some test Q matrices with different degrees of correctness were provided, and the DINA model was applied. Both the Monte Carlo simulation method and the real data analysis were used; all the results were indicated as follows: Firstly, according to these eight indexes, the average correct identification rate(ACIR) of the BIC and BIC2 was greater than 95 percent. The ACIRs of the other indexes were less than 90 percent; some indexes were even less than 50 percent.Secondly, the ACIRs varied according to different categories of incorrect Q matrices. Considered with the E error type, the ACIRs of these indexes were relatively low, most of them were less than 50 percent, except the BIC2 index. Thirdly, weighted by both the size of samples and the number of parameters, the performances of BIC and BIC2 were better than those of the rest. From the above results, it is showed that the BIC and BIC2 might be the best indexes for the selection of test Q matrix when multiple test Q matrices were proposed.
Related Articles
No related articles found