Investigation of Usage Frequency and Department on Usability Issues with the Online Examination System (OSSI)

Usability is an important term for systems related to learning and teaching because usability
issues can negatively affect student achievement. The aim of this study is to investigate the usability of a
specific online examination system, OSSI, which is used by a public university for midterm and final
exams. Researchers examined mean differences between System Usability Scale (SUS) scores of students
from different departments with different usage frequencies. Usability issues were investigated by
gathering students’ ideas. Both quantitative and qualitative data procedures were employed. Quantitative
data were analyzed through analysis of variance, while content analysis was applied to qualitative data.
Scores showed no statistical mean difference between usage frequencies but did show a statistically
significant mean difference between CEIT and other two departments. Qualitative analysis revealed the
importance of screen size, placement of buttons, question formatting, and other screen elements. The
results of this study contribute to the design and development of OSSI and other online examination
systems.