Validity and Reliability Test of the Rasch Model Instrument for Critical Thinking Skills in the Implementation of Basic Chemistry Practicum Based on Maritime Culture Assisted by AI (Artificial Intelligence)

Abstract

This study aims to analyze the validity and reliability of the instrument using the Rasch Model approach. The validity test was conducted by considering the indicators of infit and outfit mean square (MNSQ), Z-standard (ZSTD), and Point Measure Correlation (PTMEA CORR.). The analysis results indicate that most items fit the model, with three items (1, 2, 3) classified as valid, two items (4 and 6) identified as misfit, and one item (5) categorized as overfit, thus requiring further review. Meanwhile, the reliability test produced a Person Reliability value of 0.70 (real) and 0.78 (model), a Separation Index of 1.51 (real) and 1.87 (model), as well as a Cronbach’s Alpha value of 0.64. These findings suggest that the instrument demonstrates adequate internal consistency and discriminative power, although revisions or additional items are still needed to improve the quality of measurement.