Psychological Testing and Assessment

The right to the least stigmatizing labelClose-up: The Controversial Henry Herbert Goddard Everyday Psychometrics: Life-or-Death Psychological AssessmentMeet A Test User: Meet Dr. Diana D. JefferySelf-AssessmentPART II The Science of Psychological MeasurementChapter 3A Statistics RefresherSCALES OF MEASUREMENTNominal ScalesOrdinal ScalesInterval ScalesRatio ScalesMeasurement Scales in PsychologyDESCRIBING DATAFrequency DistributionsMeasures of Central Tendency The arithmetic mean The median The modeMeasures of Variability The range The interquartile and the semi-interquartile ranges The average deviation The standard deviationSkewnessKurtosisTHE NORMAL CURVEThe Area Under the Normal CurveSTANDARD SCORESz ScoresT ScoresOther Standard Scores Normalized standard scoresClose-up: The Normal Curve and Psychological TestsEveryday Psychometrics: Consumer (of Graphed Data), Beware!Meet a Test User: Meet Dr. Jeff LaurentSelf-AssessmentChapter 4OF TESTS AND TESTINGSOME ASSUMPTIONS ABOUT PSYCHOLOGICAL TESTING AND ASSESSMENTAssumption 1: Psychological Traits and States ExistAssumption 2: Psychological Traits and States Can Be Quantified and MeasuredAssumption 3: Test-Related Behavior Predicts Non-Test-Related BehaviorAssumption 4: Tests and Other Measurement Techniques Have Strengths and WeaknessesAssumption 5: Various Sources of Error Are Part of the Assessment ProcessAssumption 6: Testing and Assessment Can Be Conducted in a Fair and Unbiased MannerAssumption 7: Testing and Assessment Benefit SocietyWHAT'S A "GOOD TEST"? Reliability Validity Other ConsiderationsNORMS Sampling to Develop Norms Developing norms for a standardized test Types of Norms Percentiles Age norms Grade norms National norms National anchor norms Subgroup norms Local norms Fixed Reference Group Scoring Systems Norm-Referenced versus Criterion-Referenced EvaluationCORRELATION AND INFERENCE The Concept of Correlation The Pearson r The Spearman Rho Graphic Representations of Correlation Regression Multiple regressionINFERENCE FROM MEASUREMENT Meta-Analysis Culture and InferenceClose-up: How "Standard" is Standard in Measurement?Everyday Psychometrics: Putting Tests to the TestMeet a Team of Test Users: Meet Dr. Howard Atlas and Dr. Steve JuliusSelf-AssessmentChapter 5RELIABILITYTHE CONCEPT OF RELIABILITY Sources of Error Variance Test construction Test administration Test scoring and interpretation Other sources of errorRELIABILITY ESTIMATES Test-Retest Reliability Estimates Parallel-Forms and Alternate-Forms Reliability Estimates Split-Half Reliability Estimates The Spearman-Brown formula Other Methods of Estimating Internal Consistency The Kuder-Richardson formulas Coefficient alpha Measures of Inter-Scorer ReliabilityUSING AND INTERPRETING A COEFFICIENT OF RELIABILITYThe Purpose of the ReliabilityCoefficientThe Nature of the Test Homogeneity versus heterogeneity of test items Dynamic versus static characteristics Restriction or inflation of range Speed tests versus power tests Criterion-referenced tests Alternatives to the True Score Model Generalizability theory Item response theoryRELIABILITY AND INDIVIDUAL SCORESThe Standard Error of MeasurementThe Standard Error of the Difference Between Two ScoresClose-up: Item Response TheoryEveryday Psychometrics: The Reliability Defense and the Breathalyzer TestMeet a Test User: Meet Dr. Bryce B. ReeveSelf-AssessmentChapter 6VALIDITYTHE CONCEPT OF VALIDITYFace ValidityContent ValidityThe Quantification of Content ValidityCulture and the Relativity of Content ValidityCRITERION-RELATED VALIDITYWhat Is a Criterion? Characteristics of a criterionConcurrent ValidityPredictive Validity The validity coefficient Incremental validity Expectancy data Decision theory and test utilityCONSTRUCT VALIDITY Evidence of Construct Validity Evidence of homogeneity Evidence of changes with age Evidence of pretest/posttest changes Evidence from distinct groups Convergent evidence Discriminate evidence Factor analysisVALIDITY, BIAS, AND FAIRNESS Test Bias Rating error Test Fairness Close-up: Base Rates and Predictive Validity Everyday Psychometrics: Adjustment of Test Scores by Group Membership: Fairness in Testing or Foul Play?Meet a Test User: Meet Dr. Adam ShoemakerSelf-AssessmentChapter 7UTILITYWHAT IS UTILITY?Factors that Affect Test Utility Psychometric soundness Costs BenefitsUTILITY ANALYSISWhat is a Utility Analysis?How is a Utility Analysis Conducted? Expectancy data The Brogden-Cronbach-Gleser FormulaSome Practical Considerations The pool of job applicants The complexity of the job The cut score in use METHODS FOR SETTINGS CUT SCORESThe Angoff MethodThe Known Groups Method IRT-based methodsOther Methods Close-up: Utility Analysis: An Illustration Everyday Psychometrics: Re-thinking the Costs of Testing-and Not TestingMeet a Test User: Meet Dr. Erik ViirreSelf-AssessmentChapter 8Test DevelopmentTEST CONCEPTUALIZATIONSome Preliminary Questions Norm-referenced versus criterion-referenced tests: Item development issuesPilot WorkTEST CONSTRUCTIONScaling Types of scales Scaling methodsWriting Items Item format Writing items for computer administrationScoring ItemsTEST TRYOUTWhat Is a Good Item?ITEM ANALYSISItem-Difficulty IndexItem-Reliability Index Factor analysis and inter-item consistencyItem-Validity IndexItem-Discrimination Index Analysis of item alternatives Item-Characteristic Curves Item response theory Other Considerations in Item Analysis Guessing Item fairness Speed tests Qualitative Item Analysis "Think aloud" test administration Expert panelsTEST REVISIONTest Revision as a Stage in New Test DevelopmentTest Revision in the Life Cycle of an Existing Test Cross-validation and co-validation Quality assurance during test revisionThe Use of IRT in Building and Revising Tests Evaluating the properties of existing tests and guiding test revision. Determining measurement equivalence across research populations. Developing item banks.Close-up: Designing an Item BankEveryday Psychometrics: Psychometrics in the ClassroomMeet a Test User: Meet Dr. Scott BirkelandSelf-AssessmentPART III The Assessment of IntelligenceChapter 9Intelligence and Its MeasurementWHAT IS INTELLIGENCE? Intelligence Defined: Views of the Lay Public Intelligence Defined: Views of Scholars and Test Professionals Francis Galton Alfred Binet David Wechsler Jean Piaget Factor-Analytic Theories of Intelligence The CHC model The Information-Processing ViewMEASURING INTELLIGENCE Types of Tasks Used in Intelligence Tests Theory in Intelligence Test Development and InterpretationINTELLIGENCE: SOME ISSUES Nature Versus Nurture Inheritance and interactionism The Stability of Intelligence Other Issues Personality Gender Family environment Culture A Perspective Close-up: Culture Fair/Culture Loaded Everyday Psychometrics: Being Gifted Meet A Test User: Meet John Garruto, M.S. Self-AssessmentChapter 10Tests of IntelligenceTHE STANFORD-BINET INTELLIGENCE SCALES The Stanford-Binet Intelligence Scales: Fifth Edition Standardization Psychometric soundness Test administration Scoring and interpretationTHE WECHSLER TESTS The Wechsler Adult Intelligence Scale (WAIS-III) Standardization and norms Psychometric issues The Wechsler Intelligence Scale for Children- Fourth Edition (WISC-IV) Background The test today The WISC-IV Compared to the SB5 The Wechsler Preschool and Primary Scale of Intelligence- Third Edition (WPPSI-III) Wechsler, Binet, and the Short Form The Wechsler Abbreviated Scale of Intelligence The Wechsler Tests in PerspectiveOTHER MEASURES OF INTELLIGENCE Tests Designed for Individual Administration Tests Designed for Group Administration Group tests in the military Group tests in the schools Measures of Specific Intellectual Abilities Close-up: Factor Analysis Everyday Psychometrics: The Armed Services Vocational Aptitude Battery (ASVAB): A Test You Can Take Meet a Test User: Meet Dr. Rivka Olley Self-AssessmentChapter 11Preschool and Educational AssessmentPRESCHOOL ASSESSMENT Tools of Preschool Assessment Checklists and rating scales Psychological tests Other measuresACHIEVEMENT TESTS Measures of General Achievement Measures of Achievement in Specific Subject AreasAPTITUDE TESTS The Elementary School Level The Metropolitan Readiness Tests (MRT) The Secondary School Level The Scholastic Achievement Test (SAT) The ACT Assessment (ACT) The College Level and Beyond The Graduate Record Examinations (GRE) The Miller Analogies Test (MAT) Other aptitude testsDynamic AssessmentDIAGNOSTIC TESTSReading Tests The Woodcock Reading Mastery Tests- Revised (WRMT-R)Math TestsOther Diagnostic TestsPSYCHOEDUCATIONAL TEST BATTERIESThe Kaufman Assessment Battery for Children (K-ABC), and the Kaufman Assessment Battery for Children, Second Edition (KABC-II)The Woodcock-Johnson III (WJ III)OTHER TOOLS OF ASSESSMENT IN EDUCATIONAL SETTINGS Performance, Portfolio, and Authentic Assessment Peer Appraisal Techniques Measuring Study Habits, Interests, and AttitudesClose-up: Tests of Minimum Competency Everyday Psychometrics: First Impressions Meet A Test User: Meet Dr. Rebecca Anderson Self-AssessmentPART IV: THE ASSESSMENT OF PERSONALITYChapter 12Personality Assessment: An OverviewPERSONALITY AND PERSONALITY ASSESSMENT DEFINED Personality Personality Assessment Traits, Types, and States Personality traits Personality types Personality statesPERSONALITY ASSESSMENT: SOME BASIC QUESTIONS Who? The self as the primary referent Another person as the referent The cultural background of assessees What? Primary content area sampled Testtaker response styles Where? How? Scope and theory Procedures and item formats Frame of reference Scoring and interpretation Issues in personality test development and useDEVELOPING INSTRUMENTS TO ASSESS PERSONALITY Logic and Reason Theory Data Reduction Methods The Big Five Criterion Groups The MMPI The MMPI-2 The MMPI-2-RF The MMPI-A The MMPI and its revisions in perspectivePERSONALITY ASSESSMENT AND CULTURE Acculturation and Related Considerations Close-up: Assessing Acculturation and Related Variables Everyday Psychometrics: Some Common Item Formats Meet a Test User: Meet Dr. Eric A. Zillmer Self-AssessmentChapter 13PERSONALITY ASSESSMENT METHODSOBJECTIVE METHODSPROJECTIVE METHODS Inkblots as Projective Stimuli The Rorschach Pictures as Projective Stimuli The Thematic Apperception Test (TAT) Other tests using pictures as projective stimuli Words as Projective Stimuli Word association tests Sentence completion tests Sounds as Projective Stimuli The Production of Figure Drawings Figure-drawing tests Projective Methods in Perspective Assumptions Psychometric considerations Behavioral Assessment Methods: The Who, What, When, Where, Why, and How of It Who? What? When? Where? Why? How? Approaches to Behavioral Assessment Behavioral observation and rating scales Self-monitoring Analogue studies Situational performance measures Role play Psychophysiological methods Unobtrusive measures Issues in Behavioral Assessment A PERSPECTIVEClose-up: Personality, Life Outcomes, and College Yearbook PhotosEveryday Psychometrics: Confessions of a Behavior RaterMeet a Test User: Meet Dr. Tonia CaselmanSelf-AssessmentPART V Testing and Assessment in ActionChapter 14Clinical and Counseling AssessmentAN OVERVIEW The Diagnosis of Mental Disorders Biopsychosocial assessment The Interview in Clinical Assessment Types of interviews Psychometric aspects of the interview Case History Data Psychological Tests The psychological test battery CULTURALLY INFORMED PSYCHOLOGICAL ASSESSMENT Cultural Aspects of the Interview Cultural Considerations and Managed Care SPECIAL APPLICATIONS OF CLINICAL MEASURES The Assessment of Addiction and Substance Abuse Forensic Psychological Assessment Dangerousness to oneself or others Competency to stand trial Criminal responsibility Readiness for parole or probation Diagnosis and evaluation of emotional injury Profiling Custody Evaluations Evaluation of the parent Evaluation of the child Child Abuse and Neglect Physical signs of abuse and neglect Emotional and behavioral signs of abuse and neglect Issues in reporting child abuse and neglect Risk assessmentTHE PSYCHOLOGICAL REPORT The Barnum Effect Clinical Versus Mechanical Prediction Close-up: Assessment of Dangerousness and the Secret Service Everyday Psychometrics: Elements of a Typical Report of Psychological Assessment Meet a Test User: Meet Dr. Alan Raphael Self-AssessmentChapter 15Neuropsychological AssessmentTHE NERVOUS SYSTEM AND BEHAVIOR Neurological Damage and the Concept of OrganicityTHE NEUROPSYCHOLOGICAL EXAMINATION History Taking, the Case History, and Case Studies The Interview The neuropsychological mental status examination The Physical Examination Neuropsychological Tests Tests of general intellectual ability Tests to measure the ability to abstract Tests of executive function Tests of perceptual, motor, and perceptual-motor function Tests of verbal functioning Tests of memoryNEUROPSYCHOLOGICAL TEST BATTERIES OTHER TOOLS OF NEUROPSYCHOLOGICAL ASSESSMENT Close-up: Fixed Versus Flexible Neuropsychological Test Batteries and the Law Everyday Psychometrics: Medical Diagnostic Aids and Neuropsychological Assessment Meet a Test User: Meet Dr. Kathleen Salomone Self-AssessmentChapter 16Assessment, Careers, and BusinessCAREER CHOICE AND CAREER TRANSITION Measures of Interest The Strong Interest Inventory Other interest inventories Measures of Ability and Aptitude The General Aptitude Test Battery Measures of Personality Measuring personality traits Measuring personality types Other MeasuresSCREENING, SELECTION, CLASSIFICATION, AND PLACEMENT The Resume and the Letter of Application The Application Form Letters of Recommendation Interviews Portfolio Assessment Performance Tests The assessment center Physical Tests Drug testingPRODUCTIVITY, MOTIVATION, ATTITUDE, AND ORGANIZATIONAL CULTURE Measures of Cognitive Ability Personnel selection and diversity issues Productivity Motivation Burnout and its measurement Attitude Job satisfaction Organizational commitment Organizational CultureOTHER APPLICATIONS OF TOOLS OF ASSESSMENT Consumer Psychology The Measurement of Attitudes Measuring implicit attitudes Surveys Motivation Research Methods Behavioral observation Other methods Close-up: Validity Generalization and the GATB Everyday Psychometrics: Assessment of Corporate and Organizational Culture Meet a Test User: Meet Rob Kaiser, M.S. Self-AssessmentReferences R-1Credits C-1Name Index N-1Glossary/Index I-1