The Possibilities and Effects of Usability Testing in an Organizational Information System Renewal
Hirsimäki, Hanna (2007)
Kuvaus
Kokotekstiversiota ei ole saatavissa.
Tiivistelmä
The main reason for starting this research was the increasing need to update the old database system at JAKK (Jalasjärvi Adult Education Centre) that had become very troublesome to use and did not meet the organisation’s growing requirements any more. This project is also a part of JAKK’s quality development program, which is based on the Excellence Model of the European Foundation for Quality Management (EFQM). The study connects usability testing with continuing quality development by giving a basic framework in evaluating the efficiency level of an organisation’s information system change from the personnel’s point of view. Only by concentrating on current information and real needs an organisation can create permanent changes in its operation. Also, usability affects both the motivation and the efficiency of the personnel, thus it is an important part of the systems in mandatory use.
The actual case, a usability test, is conducted empirically by evaluating two information systems with 18 real end-users in their working environment. The two systems are an older information management system and a newer one designed to be used as a replacement. The goals of the test are to give detailed information about the efficiency levels of the two systems and to chart possible problems both in the system itself and in the motivation level of the personnel. The test is done by using both scenario based techniques and the “Think Aloud” –method. The test participants are given small tasks to do with the systems and their success is monitored by recording the audio of the test situation and measuring the time spent doing each task. The results of the two systems are then analysed and compared with each other.
According to the results, the new system indeed seems to be more efficient than the old one, based on the time results gained in the tests. The increased motivation to use a more efficient system can be seen both in the motivation evaluation and in more positive user comments. Also the test itself and its feedback revealed the users’ true interest in the decisions made in the organisation and their will to participate, even in the smallest stages of development.
The actual case, a usability test, is conducted empirically by evaluating two information systems with 18 real end-users in their working environment. The two systems are an older information management system and a newer one designed to be used as a replacement. The goals of the test are to give detailed information about the efficiency levels of the two systems and to chart possible problems both in the system itself and in the motivation level of the personnel. The test is done by using both scenario based techniques and the “Think Aloud” –method. The test participants are given small tasks to do with the systems and their success is monitored by recording the audio of the test situation and measuring the time spent doing each task. The results of the two systems are then analysed and compared with each other.
According to the results, the new system indeed seems to be more efficient than the old one, based on the time results gained in the tests. The increased motivation to use a more efficient system can be seen both in the motivation evaluation and in more positive user comments. Also the test itself and its feedback revealed the users’ true interest in the decisions made in the organisation and their will to participate, even in the smallest stages of development.