MEASUREMENT THEORY
PH 1130
|
Summer,
2001 |
|
Louise
C. Mâsse, Ph.D. |
|
Tuesday (Lectures): |
12:30 to 3:00 |
Office: UCT 2520 |
|
Thursday (Computer
Lab): |
4:00 to 6:00 |
Phone: 500-9660 |
Course Overview
This course will introduce the
student to some aspects of psychometric theory focusing on the development of
valid and reliable questionnaires. Classical test theory, generalizability
theory, and Item Response Theory (IRT) will be presented in this course.
Computer applications are included. The course format will be a combination of
lectures, class discussions, computer labs, and assignments. PREREQUISITE:
PH 1725 and PH 1726 and PH 1120 or PH 1115.
Readings
Copies of the textbooks for the
course (listed below) may be purchased at the University of Texas Health
Science Center Bookstore. Three copies of the texts and suggested references
will also be on reserve in the School of Public Health Library.
Hambleton, R.K., Swaminathan,
H., & Rogers, H.J. (1991). Fundamentals of Item Response Theory.
Newbury Park, CA: Sage Publications, Inc.
Nunnally, J.C., &
Bernstein, I.H. (1994). Psychometric Theory. New York: McGraw-Hill.
Shavelson, R.J., & Webb,
N.M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage
Publications, Inc.
Traub, R.E., (1994). Reliability
for the Social Sciences. Thousand Oaks, CA: Sage Publications Inc.
Office hours
Dr. Mâsse e-mail is LMASSE@UTSPH.SPH.UTH.TMC.EDU.
Drop-in office hours are Thursday 3:00 to 4:00pm. Outside these hours call or
use the e-mail to make an appointment.
Evaluation
|
|
1.
Assignments given at regular intervals. |
50% |
Students will need to complete five assignments as part of the
class. The assignments will generally involve data analysis and interpretation
of the results. The student will need to become familiar with several software
to complete these assignments. Information regarding these assignments will be
provided during the semester. Topics to be covered in the assignments:
Reliability, generalizability, item analysis using the classical procedure,
item response theory, and validity.
|
|
2.
Short quiz |
20% |
Throughout the semester, short quiz will be given to provide
feedback on your ability to comprehend the material.
|
|
3.
Final exam |
30% |
The exam will cover the material presented in the course, including
computer applications and any suggested additional readings.
4. Attendance to the class and computer laboratories is
mandatory.
ALL ASSIGNMENTS, QUIZ, AND FINAL PAPER MUST BE COMPLETED
SUCCESSFULLY TO OBTAIN A PASSING GRADE. "REDOS" ARE ENCOURAGED FOR
LEARNING PURPOSES BUT THEY WILL NOT RESULT IN A GRADE CHANGE. LATE ASSIGNMENTS
WILL NOT BE ACCEPTED.
Course Objectives
The objectives of this course are to:
1.
become
familiar with the concepts underlying measurement theory.
2.
be
able to conduct an item analysis using classical test theory.
3.
become
familiar with newer procedures in the area of psychometrics (generalizability
theory and item response theory).
4.
Apply
item response theory to conduct an item analysis.
5.
learn
to critically evaluate an instrument/questionnaire that has been published.
6.
understand
the relative advantages/disadvantages of classical test theory,
generalizability theory, and item response theory.
Other Relevant Textbooks
|
Allen, M.J., & Yen, W.M. (1979). Introduction to
measurement theory. Monterey, CA: Brooks/Cole. |
|
|
Crocker, L., & Algina, J. (1986). Introduction to Classical
& Modern Test Theory. New-York: Holt, |
|
|
|
Rinehart, & Winson. |
|
Devellis, R.F. (1991). Scale development: Theory and
Applications. Newbury Park, CA: Sage. |
|
|
Ghiselli, E.E., Campbell, J.P., & Zedeck, S. (1981). Measurement
theory for the behavioral sciences. |
|
|
|
New-York: Freeman. |
|
Gronlund, N.E., & Linn, R.L. (1990). Measurement and
evaluation in teaching, 6th edition. New-York: |
|
|
|
MacMillan Publishing Company. |
|
Hulin, C.L., Drasgow, F., & Parsons, C.K. (1983). Item
response theory: Applications to psychological |
|
|
|
measurement. Homewood, IL: Dow-Jones-Irwin. |
|
Linn, R.L. (1993). Educational measurement, 3rd
edition. Phoenix, AZ: Oryx Press. |
|
|
Lord, F.N. (1980). Applications of item response theory to
practical testing problems. Hillsdale, NJ: |
|
|
|
Lawrence Erlbaum. |
|
Lord, F.N., & Novick, M.R. (1967). Statistical theories of
mental test scores. Addison-Wesley |
|
|
McDonald, R.P. (1985). Factor analysis and related methods.
Hillsdale, NJ: Lawrence Erlbaum. |
|
|
Murphy, K.R., & Davidshofer, C.O. (1994). Psychological
testing: Principles and applications. |
|
|
|
Englewood Cliffs, NJ: Prentice Hall |
|
Silva, F. (1993). Psychometrics foundations and behavioral
assessment. Newbury Park, CA: Sage. |
|
|
Shye, S., Elizur, D., & Hoffman, M. (1994). Introduction
to Facet Theory: Content Design and Intrinsic |
|
|
|
Data Analysis in Behavioral Research.
Thousand Oaks, CA: Sage Publications Inc. |
|
Suen, H.K. (1990). Principles of test theories. Hillsdale,
NJ: Erlbaum. |
|
|
Wainer, H., & Braun, H.I. (1988). Test validity.
Hillsdale, NJ: Erlbaum. |
|
It is also understood that the student will seek additional
information in the numerous measurement journals. These include:
Psychometrika
Psychological Bulletin
Applied Measurement in Education
Applied Psychological Measurement
British Journal of Mathematical and Statistical Psychology
Educational and Psychological Measurement
Journal of Educational Measurement
Journal of Educational Statistics
|
Section |
Nunnally |
Traub |
Articles |
Date |
|
I.
Introduction Basic
statistical concepts Measurement
Overview |
1,2,3,4 |
Traub 1,
2 |
1,2 |
May 23 |
|
Theory Internal
consistency Test
construction process |
6,7,8 |
Traub
3-8 |
3,4 |
June 6
— June 22 |
|
Criterion-referenced
validity |
7 |
Shavelson
& Webb |
5-6 |
June 27
— July 11 |
|
Theory
(IRT / scaling) Item
analysis Test
construction process |
10 |
Hambleton
et al. |
7,8,9 |
July 13
— July 27 |
|
V.
Validity |
3 |
|
10,11,12 1,2 |
August 1 |