TIA- A smart psychometric analysis app for Albanian high school exams framework

Abstract

In support of experts working on high school examinations in Albania, there have been prior studies and research highlighting the importance of psychometric analysis in standard setting for these exams. The State Matura process, initiated in 2006, has undergone several modifications, and since 2016, these results play a crucial role in determining university entry for students in Albania. TIA (Test Item Analysis) Shiny App is an inovative application designed to facilitate psychometric analysis in the development of Albanian high school final exams. The application improves professional decision-making by providing quick insights into item and exam performance empowering psychometricians and subject experts to make data-driven decisions. By integrating item statistics like difficulty and discrimination with flexible cut-score setting, it enhances the efficiency of exam scoring and evaluation processes. In addition, the application uses advanced classification techniques to identify similarities between items. The framework i, s versatile, supporting exams composed of only MCQs, only SAQs, or a combination of bothmaking it a valuable tool for various assessment scenarios. In addition it also offeres detailed item disctractor reports for MCQ items for promoting continuous improvement of exam quality. With comprehensive numeric reports and dynamic visual insights, the TIA-Smart Solution empowers psychometricians and educators to make informed, data-driven decisions effectively.