Reliability Activity

1. Critique the following statement: The reliability of the office procedures proficiency exam is very high. Therefore, you can assume that the test is an excellent measure of proficiency at office procedures.

   How would you approach the following situations, and what type of reliability estimate would you use to help you through the following situations:
   
   

   
   
   

2. You've been asked to measure achievement of trainees undergoing a new type of 1-day training program. To measure their knowledge you have designed a 20 problem multiple choice test. You've been asked to do a pretest and posttest on their knowledge gains.
   
   
   
   
3. You plan on studying the changes in attitudes of workers after a newperformance evaluation system is initiated. Your office worker creates a new test to be used to measure the changes. How might you establish the test's reliability before it is given to the workers?
   
   
   
   
4. Your principal has asked you to serve on the Language Arts State Framework Board of Directors. The directors decide that language arts is more than knowing spelling and parts of speech, and want to create a test to measure how well children write persuasive articles. As a member of the board, you question how this test will be graded. What would be your major concern?
   
   
   
   
5. At the completion of a week-long training program, you have your students complete a 100 question test. You are concerned that some of the questionsmay not have been covered in your instruction, and are therefore curious as to the reliability of the instrument.
   
   
   
   
6. Explain how can a test be reliable but not valid?