Learnability Test for Individualized Instruction
Sean McCarty
smccarty@ucsd.edu
5-05-09
Ed Tec 671 – Mon 4:00pm

Learnability Test

Feedback was solicited from one Subject Matter Expert and one student worker with little knowledge of the software. The SME helps administer the Parcel Manager and trains student workers. The student worker has only occasionally utlilized the Parcel Manager.

Feedback from SME:

  1. The information about the data and program files was confusing. Recommendation was to simplify the Mental Model strategy in the first section of the tutorial.
  2. The "hot spot" question was confusing. Include better instructions on the question to "highlight hot spot, then click Submit button."
  3. The "order the steps in delivery process" question was also confusing. Include better instructions that the steps can be moved and need to be put in the correct order.
  4. The text below the pictures was too small to read. Make the pictures and text larger.
  5. The software demonstrations were good, but in the second section, it should start with "Parcel Information" and not "Student Information."
  6. The SME believed overall the software demonstrations would be the most useful part of the tutorial because it could be used as a refresher for student workers at any time, as well as be an effective training tool for the new employees.

Feeback from student worker:

  1. The student also did not understand the data and program files breakdown. She did not understand why she needed to know that and the tutorial was not effective in teaching her the importance.
  2. The student also felt the text needed to be bigger on many of the slides in the first section.
  3. Some of the basic information was too basic and she quickly clicked past much of the first section. This seems to support the design decision to allow users to click ahead if they do not wish to view a slide in its entirety.
  4. The student stated the quiz made her think about the answers and reinforce the information in the tutorial.
  5. The student agreed with the SME that the software simulation could come in handy, since she does not use the Parcel Manager enough to complete each process from memory.