The Validity and Reliability of Generic Skills Instrument for Lecturer Evaluation of Pre-University Students using the Measurement Model in Confirmatory Factor Analysis (CPA).

Abstract

The purpose of this study is to measure the validity of the Generic Skills Instrument for Lecturer Assessment (IKGPP). The research instrument contains 77 items and was administered by two lecturers on 98 pre-university students at a Ministry of Education Matriculation College. The instrument was designed to measure nine skill constructs, i.e. Communication; Leadership; Teamwork; Lifelong Learning and Information Management; Critical Thinking and Problem Solving; Ethics and Moral Professionalism; Entrepreneurship; Management and Social Responsibility. Data analyses were done using the Rasch Model, of which Winstep 3.64.2 was used. 16 items were eliminated and the remaining 61 items were analyzed for
validity using the measurement model in Confirmatory Factor Analysis (CFA) with the AMOS 5.0. The index values for Comparative Fit Index (CFI ≥ 0.9), Tucker Lewis Index (TLI ≥ 0.9), and RMSEA (≤ 0.08) were used to verify the items retained. Final results showed that all nine IKGPP constructs fit the empirical data based on the Comparative of Fit Index (CFI) and Tucker Lewis Index (TLI) in the 0.058 to 1.018 range and value in the > 0.9 range. The RMSEA value is in the acceptable range of < 0.08. All 61 items were retained by correlating the items in the constructs. The current IKGPP instrument could be used to assess the pre-university students in matriculation college.