CRITERION- REFERENCED TEST DEVELOPMENT
|
|
- Tabitha Harris
- 6 years ago
- Views:
Transcription
1 t>feiffer~ CRITERION- REFERENCED TEST DEVELOPMENT TECHNICAL AND LEGAL GUIDELINES FOR CORPORATE TRAINING 3rd Edition Sharon A. Shrock William C. Coscarelli BICBNTBNNIAL Bl C NTBN NI A L
2 List of Figures, Tables, and Sidebars xxiii Introduction: A Little Knowledge Is Dangerous 1 Why Test? 1 Why Read This Book? 2 A Confusing State of Affairs 3 Misleading Familiarity 3 Inaccessible Technology 4 Procedural Confusion 4 Testing and Kirkpatrick's Levels of Evaluation 5 Certification in the Corporate World 7 Corporate Testing Enters the New Millennium 10 What Is to Come PART I: BACKGROUND: THE FUNDAMENTALS' 13 1 Test Theory 15 What Is Testing? 15 What Does a Test Score Mean? 17 Reliability and Validity: A Primer 18 Reliability 18 Equivalence Reliability 19 Test-Retest Reliability 19 Inter-Rater Reliability 19 Validity 20 Face Validity 23 Context Validity 23 Concurrent Validity 23 Predictive Validity 24 Concluding Comment 24 IX
3 X 2 Types of Tests Criterion-Referenced Versus Norm-Referenced Tests Frequency Distributions Criterion-Referenced Test Interpretation Six Purposes for Tests in Training Settings Three Methods of Test Construction (One of Which You Should Never Use) Topic-Based Test Construction Statistically Based Test Construction Objectives-Based Test Construction PART II: OVERVIEW: THE CRTD MODEL AND PROCESS 3 The CRTD Model and Process Relationship to the Instructional Design Process The CRTD Process Plan Documentation Analyze Job Content Establish Content Validity of Objectives Create Items Create Cognitive Items Create Rating Instruments Establish Content Validity of Items and Instruments Conduct Initial Test Pilot Perform Item Analysis Difficulty Index Distractor Pattern Point-Biserial Create Parallel Forms or Item Banks Establish Cut-Off Scores Informed Judgment Angoff
4 Contrasting Groups Determine Reliability Determine Reliability of Cognitive Tests Equivalence Reliability Test-Retest Reliability Determine Reliability of Performance Tests Report Scores Summary XI I: THE CRTD PROCESS: PLANNING AND CREATING THE TEST Plan Documentation Why Document? What to Document The Documentation Analyze Job Content Job Analysis Job Analysis Models Summary of the Job Analysis Process DACUM Hierarchies Hierarchical Analysis of Tasks Matching the Hierarchy to the Type of Test Prerequisite Test Entry Test Diagnostic Test Posttest Equivalency Test Certification Test Using Learning Task Analysis to Validate a Hierarchy Bloom's Original Taxonomy Knowledge Level
5 xii Comprehension Level 93 Application Level 93 Analysis Level 93 Synthesis Level 93 Evaluation Level 94 Using Bloom's Original Taxonomy to Validate 94 a Hierarchy Bloom's Revised Taxonomy 95 Gagne's Learned Capabilities 96 Intellectual Skills 96 Cognitive Strategies 97 Verbal Information 97 Motor Skill 97 Attitudes 97 Using Gagne's Intellectual Skills to Validate 97 a Hierarchy Merrill's Component Design Theory 98 The Task Dimension 99 Types of Learning 99 Using Merrill's Component Design Theory 99 to Validate a Hierarchy Data-Based Methods for Hierarchy 100 Validation Who Killed Cock Robin? 102 Content Validity of Objectives 105 Overview of the Process 105 The Role of Objectives in Item Writing 106 Characteristics of Good Objectives 107 Behavior Component 107 Conditions Component 108 Standards Component 108 A Word from the Legal Department 109 About Objectives The Certification Suite 109
6 Certification Levels in the Suite Level A Realworld Level B High-Fidelity Simulation Level C Scenarious Quasi-Certification Level D Memorization Level E Attendance Level F Affiliation How to Use the Certification Suite Finding a Common Understanding Making a Professional Decision The correct level to match the job The operationally correct level The consequences of lower fidelity Convertingjob-Task Statements to Objectives In Conclusion Create Cognitive Items What Are Cognitive Items? Classification Schemes for Objectives Bloom's Cognitive Classifications Types of Test Items Newer Computer-Based Item Types The Six Most Common Item Types True/False Items Matching Items Multiple-Choice Items Fill-Iri Items Short Answer Items Essay Items The Key to Writing Items That Match Jobs The Single Most Useful Improvement You Can Make in Test Development Intensional Versus Extensional Items Show Versus Tell Xlll
7 XiV The Certification Suite 155 Guidelines for Writing Test Items 158 Guidelines for Writing the Most Common 159 Item Types How Many Items Should Be on a Test? 166 Test Reliability and Test Length 166 Criticality of Decisions and Test Length 167 Resources and Test Length 168 Domain Size of Objectives and Test Length 168 Homogeneity of Objectives and Test Length 169 Research on Test Length 170 Summary of Determinants of Test Length 170 A Cookbook for the SME 172 Deciding Among Scoring Systems 174 Hand Scoring 175 Optical Scanning 175 Computer-Based Testing 176 Computerized Adaptive Testing 180 Create Rating Instruments 183 What Are Performance Tests? 183 Product Versus Process in Performance Testing Four Types of Rating Scales for Use in 187 Performance Tests (Two of Which You Should Never Use) Numerical Scales Descriptive Scales Behaviorally Anchored Rating Scales Checklists Open Skill Testing Establish Content Validity of Items and Instruments The Process
8 XV 10 Establishing Content Validity The Single Most Important Step Face Validity Content Validity Two Other Types of Validity Concurrent Validity Predictive Validity Summary Comment About Validity Initial Test Pilot Why Pilot a Test? Six Steps in the Pilot Process Determine the Sample Orient the Participants Give the Test Analyze the Test Interview the Test-Takers Synthesize the Results Preparing to Collect Pilot Test Data Before You Administer the Test Sequencing Test Items Test Directions Test Readability Levels Lexile Measure Formatting the Test Setting Time Limits Power, Speed, and Organizational Culture When You Administer the Test Physical Factors Psychological Factors Giving and Monitoring the Test Special Considerations for Performance Honesty and Integrity in Testing Security During the Training-Testing Sequence Tests
9 XVI Organization-Wide Policies Regarding Test Security Statistical Pilot Standard Deviation and Test Distributions The Meaning of Standard Deviation The Five Most Common Test Distributions Problems with Standard Deviations and Mastery Distributions Item Statistics and Item Analysis Item Statistics Difficulty Index P-Value Distractor Pattern Point-Biserial Correlation Item Analysis for Criterion-Referenced Tests The Upper-Lower Index Phi Choosing Item Statistics and Item Analysis Techniques Garbage In-Garbage Out Parallel Forms Paper-and-Pencil Tests Computerized Item Banks Reusable Learning Objects Cut-Off Scores Determining the Standard for Mastery The Outcomes of a Criterion-Referenced Test The Necessity of Human Judgment in Setting a Cut-Off Score Consequences of Misclassification Stakeholders Reusability Performance Data
10 XV11 Three Procedures for Setting the Cut-Off Score 269 The Issue of Substitutability 269 Informed Judgment 270 A Conjectural Approach, the Angoff Method 272 Contrasting Groups Method 278 Borderline Decisions 282 The Meaning of Standard Error of 282 Measurement Reducing Misclassification Errors at the 284 Borderline Problems with Correction-for-Guessing The Problem of the Saltatory Cut-Off Score Reliability of Cognitive Tests The Concepts of Reliability, Validity, and Correlation Correlation Types of Reliability Single-Test-Administration Reliability Techniques Internal Consistency Squared-Error Loss Threshold-Loss Calculating Reliability for Single-Test Administration Techniques Livingston's Coefficient kappa (K 2 ) The Index S Outcomes of Using the Single-Test- Administration Reliability Techniques Two-Test-Administration Reliability Techniques Equivalence Reliability Test-Retest Reliability Calculating Reliability for Two-Test Administration Techniques
11 XV111 The Phi Coefficient 302 Description of Phi 302 Calculating Phi 302 How High Should Phi Be? 304 The Agreement Coefficient 306 Description of the Agreement Coefficient 306 Calculating the Agreement Coefficient 307 How High Should the Agreement 308 Coefficient Be? The Kappa Coefficient 308 Description of Kappa 308 Calculating the Kappa Coefficient 309 How High Should the Kappa 311 Coefficient Be? Comparison of 0, p 0, and K 313 The Logistics of Establishing Test Reliability 314 Choosing Items 314 Sample Test-Takers 315 Testing Conditions 316 Recommendations for Choosing a 316 Reliability Technique Summary Comments Reliability of Performance Tests 319 Reliability and Validity of Performance Tests 319 Types of Rating Errors 320 Error of Standards 320 Halo Error 321 Logic Error 321 Similarity Error 321 Central Tendency Error 321 Leniency Error 322 Inter-Rater Reliability 322 Calculating and Interpreting Kappa (K) 323 Calculating and Interpreting Phi (cf>) 335
12 Xix Repeated Performance and Consecutive 344 Success Procedures for Training Raters 347 What If a Rater Passes Everyone Regardless 349 of Performance? What Should You Do? 352 What If You Get a High Percentage of Agreement 353 Among Raters But a Negative Phi Coefficient? 16 Report Scores 357 CRT Versus NRT Reporting 358 Summing Subscores 358 What Should You Report to a Manager? 361 Is There a Legal Reason to Archive the Tests? 362 A Final Thought About Testing and Teaching 362 PART IV: LEGAL ISSUES IN CRITERION-REFERENCED TESTING Criterion-Referenced Testing and Employment 367 Selection Laws What Do We Mean by Employment 368 Selection Laws? Who May Bring a Claim? 368 A Short History of the Uniform Guidelines on 370 Employee Selection Procedures Purpose and Scope 371 Legal Challenges to Testing and the 373 Uniform Guidelines Reasonable Reconsideration 376 In Conclusion 376 Balancing CRTs with Employment 376 Discrimination Laws Watch Out for Blanket Exclusions in the Name 378 of Business Necessity Adverse Impact, the Bottom Line, and 380 Affirmative Action
13 XX Adverse Impact 380 The Bottom Line 383 Affirmative Action 385 Record-Keeping of Adverse Impact and 387 Job-Relatedness of Tests Accommodating Test-Takers with Special Needs 387 Testing, Assessment, and Evaluation for 390 Disabled Candidates Test Validation Criteria: General Guidelines 394 Test Validation: A Step-by-Step Guide Obtain Professional Guidance Select a Legally Acceptable Validation 397 Strategy for Your Particular Test 3. Understand and Employ Standards for 398 Content-Valid Tests 4. Evaluate the Overall Test Circumstances to 399 Assure Equality of Opportunity Keys to Maintaining Effective and Legally 400 Defensible Documentation Why Document? 400 What Is Documentation? 401 Why Is Documentation an Ally in Defending 401 Against Claims? How Is Documentation Used? 402 Compliance Documentation 402 Documentation to Avoid Regulatory 404 Penalties or Lawsuits Use of Documentation in Court 404 Documentation to Refresh Memory 404 Documentation to Attack Credibility 404 Disclosure and Production of Documentation 405 Pay Attention to Document Retention Policies 407 and Protocols Use Effective Word Management in Your 409
14 XXI Documentation Use Objective Terms to Describe Events and 412 Compliance Avoid Inflammatory and Off-the-Cuff 412 Commentary Develop and Enforce Effective Document 413 Retention Policies Make Sure Your Documentation Is Complete 414 Make Sure Your Documentation Is Capable of 415 "Authentication" In Conclusion 415 Is Your Criterion-Referenced Testing Legally 416 Defensible? A Checklist A Final Thought 419 Epilogue: CRTD as Organizational Transformation 421 References 425 Index 433 About the Authors 453
Audit - The process of conducting an evaluation of an entity's compliance with published standards. This is also referred to as a program audit.
Glossary 1 Accreditation - Accreditation is a voluntary process that an entity, such as a certification program, may elect to undergo. In accreditation a non-governmental agency grants recognition to the
More informationA Practical Guide for Creating Performance Metrics and Valid Tests
The 2011 Working Dog Conference Defining, Developing and Documenting Success in Working Dogs. A Practical Guide for Creating Performance Metrics and Valid Tests William E. Lewandowski 1353 Sterling Place
More information+ Purpose of assessment and use in candidate monitoring or decisions are consequential
CAEP EVALUATION TOOL FOR EPP-CREATED ASSESSMENTS USED IN ACCREDITATION For use with: assessments created by EPPs including observations, projects/ assignments and surveys For use by: EPPs, CAEP assessment
More informationGlossary of Standardized Testing Terms https://www.ets.org/understanding_testing/glossary/
Glossary of Standardized Testing Terms https://www.ets.org/understanding_testing/glossary/ a parameter In item response theory (IRT), the a parameter is a number that indicates the discrimination of a
More information2016 Technical Assistance Conference
2016 Technical Assistance Conference Validity and Reliability of EPP Assessments April 19, 2016 Nate Thomas and Beverly Mitchell Topics 1. Approval Standard expectations 2. Expectations of Instrument Validity
More informationWhat are the Steps in the Development of an Exam Program? 1
What are the Steps in the Development of an Exam Program? 1 1. Establish the test purpose A good first step in the development of an exam program is to establish the test purpose. How will the test scores
More informationWhat to Consider When Setting the Pass Point on Hiring Examinations. Presented by Dr. Jim Higgins Executive Director, BCGi
What to Consider When Setting the Pass Point on Hiring Examinations Presented by Dr. Jim Higgins Executive Director, BCGi Visit BCGi Online If you enjoy this webinar, Don t forget to check out our other
More informationAssessment Solutions TEST VALIDATION SERVICES. Ramsay Corporation custom develops tests and uses a content validation model to document the process.
2016 Assessment Solutions TEST VALIDATION SERVICES Ramsay Corporation custom develops tests and uses a content validation model to document the process. Table of Contents Test Validation Service... 1 Why
More informationSTAAR-Like Quality Starts with Reliability
STAAR-Like Quality Starts with Reliability Quality Educational Research Our mission is to provide a comprehensive independent researchbased resource of easily accessible and interpretable data for policy
More informationUNIVERSIlY OF SWAZILAND. FACULlY OF EDUCATION DEPARTMENT OF EDUCATIONAL FOUNDATIONS AND MANAGEMENT SUPPLEMENTARY EXAMINATION PAPER 2012/2013
UNIVERSIlY OF SWAZILAND FACULlY OF EDUCATION DEPARTMENT OF EDUCATIONAL FOUNDATIONS AND MANAGEMENT SUPPLEMENTARY EXAMINATION PAPER 2012/2013 TITLE OF PAPER: COURSE NUMBER: MEASUREMENT AND TESTING EDF321PGCE
More informationTest Development: Ten Steps to a Valid and Reliable Certification Exam Linda A. Althouse, Ph.D., SAS, Cary, NC
Test Development: Ten Steps to a Valid and Reliable Certification Exam Linda A. Althouse, Ph.D., SAS, Cary, NC ABSTRACT The intent of a certification program is to evaluate the knowledge and skills of
More informationEssential Elements of a Job Analysis
Essential Elements of a Job Analysis Best Practice Tips to Enhance Defensibility Geoff If your Burcaw, computer MS, does SPHR, not have SHRM-SCP speakers, Senior Consultant, please dial CPS in HR at: Consulting
More informationALTE Quality Assurance Checklists. Unit 1. Test Construction
ALTE Quality Assurance Checklists Unit 1 Test Construction Name(s) of people completing this checklist: Which examination are the checklists being completed for? At which ALTE Level is the examination
More informationALTE Quality Assurance Checklists. Unit 4. Test analysis and Post-examination Review
s Unit 4 Test analysis and Post-examination Review Name(s) of people completing this checklist: Which examination are the checklists being completed for? At which ALTE Level is the examination at? Date
More informationGlossary of Terms Ability Accommodation Adjusted validity/reliability coefficient Alternate forms Analysis of work Assessment Band Battery
1 1 1 0 1 0 1 0 1 Glossary of Terms Ability A defined domain of cognitive, perceptual, psychomotor, or physical functioning. Accommodation A change in the content, format, and/or administration of a selection
More informationSetting Standards. John Norcini, Ph.D.
Setting Standards John Norcini, Ph.D. jnorcini@faimer.org Overview Scores and standards Definitions and types Characteristics of a credible standard Who sets the standards, what are the characteristics
More informationALTE Quality Assurance Checklists. Unit 1. Test Construction
s Unit 1 Test Construction Name(s) of people completing this checklist: Which examination are the checklists being completed for? At which ALTE Level is the examination at? Date of completion: Instructions
More informationPASSPOINT SETTING FOR MULTIPLE CHOICE EXAMINATIONS
WHITE WHITE PAPER PASSPOINT SETTING FOR MULTIPLE CHOICE EXAMINATIONS CPS HR Consulting 241 Lathrop Way Sacramento, CA 95815 t: 916.263.3600 f: 916.263.3520 www.cpshr.us INTRODUCTION An examination is a
More informationConducting Interviews: What Can Go Wrong and What Can Go Right. Presented by Dr. Jim Higgins Executive Director, BCGi
Conducting Interviews: What Can Go Wrong and What Can Go Right Presented by Dr. Jim Higgins Executive Director, BCGi Visit BCGi Online If you enjoy this webinar, Don t forget to check out our other training
More informationTitle VII Case Study: Plaintiff v. U.S. City
Title VII Case Study: Plaintiff v. U.S. City Defending Interviews Against a Title VII Adverse Impact Claim February 16, 2011 Visit BCGi Online If you enjoy this webinar, Don t forget to check out our other
More informationHiring is Testing. (Even If You re Not Calling It a Test ) Geoff Burcaw. Hilary Ricardo. Senior Consultant. Senior Consultant
Hiring is Testing (Even If You re Not Calling It a Test ) Geoff Burcaw Senior Consultant Hilary Ricardo Senior Consultant Hi! Introductions Geoff Burcaw Senior Consultant Hilary Ricardo Senior Consultant
More informationDEVELOPMENT OF AN ESSAY-WRITING TEST FOR A LAW ENFORCEMENT JOB. John D. Kraft June 2000
DEVELOPMENT OF AN ESSAY-WRITING TEST FOR A LAW ENFORCEMENT JOB John D. Kraft June 2000 Objective Establish a job-related, valid, and legally defensible writing sample essay test for initial selection as
More informationMore than 70 percent of the students are likely to respond correctly. Easy
COGNITIVE COMPLEXITY OF FCAT 2.0 SCIENCE TEST ITEMS Educational standards and assessments can be aligned based on the category of content covered and also on the complexity of knowledge required. The FCAT
More informationDocument Control Information
Document Control Information Document Details Document Name Purpose of Document Document Version Number 5.3 Document Status Document Owner Prepared By The ITIL Intermediate Qualification Service Offerings
More informationUW Flexible Option Competency-Based Learning Model
UW Flexible Option Competency-Based Learning Model Darci L. Lammers, PhD, Senior Instructional Designer Continuing Education, Outreach, and e-learning, UW-Extension Presented at the Ohio Department of
More informationSetting Fair, Defensible Cut Scores More Than One Method to Use
Setting Fair, Defensible Cut Scores More Than One Method to Use James R. Parry, M.Ed. CPT Owner/Chief Executive Manager Compass Consultants, LLC Acknowledgments Photos and some illustrations used fall
More informationDocument Control Information
Document Control Information Document Details Document Name Purpose of Document Document Version Number 5.1 Document Status Document Owner Prepared By The ITIL Intermediate Qualification: Service Offerings
More informationDocument Control Information
Document Control Information Document Details Document Name Purpose of Document Document Version Number 5.3 Document Status Document Owner Prepared By The ITIL Intermediate Qualification Service Transition
More informationOverview. Approaches to Addressing Adverse Impact: Opportunities, Facades, and Pitfalls. What is Adverse Impact? The d-statistic
Approaches to Addressing Adverse Impact: Opportunities, Facades, and Pitfalls John M. Ford Michael D. Blair Overview What is Adverse Impact? Importance Considerations Regarding Adverse Impact Practical
More informationApplying the Principles of Item and Test Analysis
Applying the Principles of Item and Test Analysis 2012 Users Conference New Orleans March 20-23 Session objectives Define various Classical Test Theory item and test statistics Identify poorly performing
More informationCONTENT VALIDITY REPORT FOR THE TEST PREPARATION MANUAL (TPM) 8 TH Ed. READING ABILITY TEST FOR ENTRY-LEVEL FIREFIGHTERS
CONTENT VALIDITY REPORT FOR THE TEST PREPARATION MANUAL (TPM) 8 TH Ed. READING ABILITY TEST FOR ENTRY-LEVEL FIREFIGHTERS KSAPCs Measured: Ability to read, retain, recall, and comprehend written material
More informationTIPS ON BUILDING AND USING COMPETENCY ASSESSMENTS
TIPS ON BUILDING AND USING COMPETENCY ASSESSMENTS 5 SEP 2018 CHICAGO LABELMASTER DANGEROUS GOODS SYMPOSIUM SLIDE 3 OF 39 ˑ 2018 TOURISM HR CANADA ALL RIGHTS RESERVED 1 Written Examinations Types of Assessment
More informationOperational Guidelines for the Recognition of Prior Learning (RPL) Under NTVQF
Bangladesh Technical Education Board Agargaon, Sher-E-Bangla Nagor Dhaka-1207 Operational Guidelines for the Recognition of Prior Learning (RPL) Under NTVQF Background The National Technical & Vocational
More informationAdvanced Human Resource Management Topics Exam Summary: Undergraduate, Masters, and Doctoral Levels
Advanced Human Resource Management Topics Exam Summary: Undergraduate, Masters, and Doctoral Levels Peregrine Academic Services (PAS) provides assessment services for performing direct assessment of learning
More informationINTERMEDIATE QUALIFICATION
PROFESSIONAL QUALIFICATION SCHEME INTERMEDIATE QUALIFICATION SERVICE CAPABILITY OPERATIONAL SUPPORT AND ANALYSIS CERTIFICATE SYLLABUS The Swirl logo is a trade mark of the Cabinet Office ITIL is a registered
More informationINTERMEDIATE QUALIFICATION
PROFESSIONAL QUALIFICATION SCHEME INTERMEDIATE QUALIFICATION SERVICE LIFECYCLE SERVICE TRANSITION CERTIFICATE SYLLABUS The Swirl logo is a trade mark of the Cabinet Office ITIL is a registered trade mark
More informationINTERMEDIATE QUALIFICATION
PROFESSIONAL QUALIFICATION SCHEME INTERMEDIATE QUALIFICATION SERVICE LIFECYCLE SERVICE TRANSITION CERTIFICATE SYLLABUS The Swirl logo is a Trade Mark of the Office of Government Commerce ITIL is a Registered
More informationDocument Control Information
Document Control Information Document Details Document Name Purpose of Document Document Version Number 5.5 Document Status Document Owner Prepared By The ITIL Intermediate Qualification Planning Protection
More informationReliability & Validity
Request for Proposal Reliability & Validity Nathan A. Thompson Ph.D. Whitepaper-September, 2013 6053 Hudson Road, Suite 345 St. Paul, MN 55125 USA P a g e 1 To begin a discussion of reliability and validity,
More informationUsing a Performance Test Development & Validation Framework
Using a Performance Test Development & Validation Framework James B. Olsen Russell W. Smith Cristina Goodwin Alpine Testing Solutions Presentation Overview Present a useful performance test development
More informationDocument Control Information
Document Control Information Document Details Document Name Purpose of Document Document Version Number 5.5 Document Status Document Owner Prepared By The ITIL Intermediate Qualification Planning Protection
More informationKeyMath Revised: A Diagnostic Inventory of Essential Mathematics (Connolly, 1998) is
KeyMath Revised Normative Update KeyMath Revised: A Diagnostic Inventory of Essential Mathematics (Connolly, 1998) is an individually administered, norm-referenced test. The 1998 edition is a normative
More informationThe 1995 Stanford Diagnostic Reading Test (Karlsen & Gardner, 1996) is the fourth
Stanford Diagnostic Reading Test 4 The 1995 Stanford Diagnostic Reading Test (Karlsen & Gardner, 1996) is the fourth edition of a test originally published in 1966. The SDRT4 is a group-administered diagnostic
More informationSetting the Standard in Examinations: How to Determine Who Should Pass. Mark Westwood
Setting the Standard in Examinations: How to Determine Who Should Pass Mark Westwood Introduction Setting standards What is it we are trying to achieve How to do it (methods) Angoff Hoftsee Cohen Others
More informationSelection. Copyright 2016 Pearson Education, Inc. 6-1
Chapter 6 Selection 6-1 Selection Process of choosing the individual best suited for particular position and organization from a group of applicants Goal is to properly match people with jobs and organization
More informationDocument Control Information
Document Control Information Document Details Document Name Purpose of Document Document Version Number 5.5 Document Status Document Owner Prepared By The ITIL Intermediate Qualification Continual Service
More informationDocument Control Information
Document Control Information Document Details Document Name Purpose of Document Document Version Number 5.5 Document Status Document Owner Prepared By The ITIL Intermediate Qualification Continual Service
More informationROBERT L. MATHIS JOHN H. JACKSON. Presented by: Prof. Dr. Deden Mulyana, SE.,M,Si. Chapter 8. SECTION 2 Staffing the Organization
ROBERT L. MATHIS JOHN H. JACKSON Chapter 8 Selecting Human Resources Presented by: Prof. Dr. Deden Mulyana, SE.,M,Si. SECTION 2 Staffing the Organization http:/www.deden08m.wordpress.com Learning Objectives
More informationContents List of figures xxv List of tables xxvii List of exhibits xxix Preface xxxiii Part I The practice of human resource management 1 01 The essence of human resource management (HRM) 3 Introduction
More information"Charting the Course... MOC B Designing a Microsoft SharePoint 2010 Infrastructure. Course Summary
Course Summary Description This 5 day ILT course teaches IT Professionals to design and deploy Microsoft SharePoint. Objectives At the end of this course, students will be able to: Describe the core methods
More informationInnovative Item Types Require Innovative Analysis
Innovative Item Types Require Innovative Analysis Nathan A. Thompson Assessment Systems Corporation Shungwon Ro, Larissa Smith Prometric Jo Santos American Health Information Management Association Paper
More informationTHE GENERAL ASSEMBLY OF PENNSYLVANIA SENATE BILL
PRINTER'S NO. 1 THE GENERAL ASSEMBLY OF PENNSYLVANIA SENATE BILL No. 10 Session of 01 INTRODUCED BY TEPLITZ, BLAKE, HUGHES, SCHWANK, COSTA, BOSCOLA, SMITH, FARNESE, TARTAGLIONE AND RAFFERTY, JANUARY 1,
More information29 CFR Ch. XIV ( Edition)
1607.12 the class of persons discriminated against during the period the user followed the discriminatory practices should be allowed the opportunity to qualify under less stringent selection procedures
More informationThe Mullen Scales of Early Learning (Mullen, 1992) is an individually administered,
Mullen Scales of Early Learning (MSEL) The Mullen Scales of Early Learning (Mullen, 1992) is an individually administered, norm-referenced test intended to assess modality performance and to identify learning
More informationINTERMEDIATE QUALIFICATION
PROFESSIONAL QUALIFICATION SCHEME INTERMEDIATE QUALIFICATION SERVICE LIFECYCLE CONTINUAL SERVICE IMPROVEMENT CERTIFICATE SYLLABUS The Swirl logo is a trade mark of the Cabinet Office ITIL is a registered
More informationThe Examination for Professional Practice in Psychology: The Enhanced EPPP Frequently Asked Questions
The Examination for Professional Practice in Psychology: The Enhanced EPPP Frequently Asked Questions What is the Enhanced EPPP? The Enhanced EPPP is the national psychology licensing examination that
More informationCONSTRUCTING A STANDARDIZED TEST
Proceedings of the 2 nd SULE IC 2016, FKIP, Unsri, Palembang October 7 th 9 th, 2016 CONSTRUCTING A STANDARDIZED TEST SOFENDI English Education Study Program Sriwijaya University Palembang, e-mail: sofendi@yahoo.com
More informationINDEPENDENT ELECTRICAL CONTRACTORS SAFETY PROGRAM AWARENESS & RETENTION KIT
INDEPENDENT ELECTRICAL CONTRACTORS SAFETY Deadline to complete is July 15, 2018 Contact Information Company Name: Address: City/State/Zip: Phone: Fax: E-mail: Chapter Name: Date Completed: Preparer s Name:
More informationAn Introduction to Psychometrics. Sharon E. Osborn Popp, Ph.D. AADB Mid-Year Meeting April 23, 2017
An Introduction to Psychometrics Sharon E. Osborn Popp, Ph.D. AADB Mid-Year Meeting April 23, 2017 Overview A Little Measurement Theory Assessing Item/Task/Test Quality Selected-response & Performance
More information7 Statistical characteristics of the test
7 Statistical characteristics of the test Two key qualities of an exam are validity and reliability. Validity relates to the usefulness of a test for a purpose: does it enable well-founded inferences about
More informationThe Standards for Educational and Psychological Testing: Zugzwang for the Practicing Professional?
The Standards for Educational and Psychological Testing: Zugzwang for the Practicing Professional? Prepared for: IPMAAC The International Personnel Management Association Assessment Council Newport Beach,
More informationLarge Muscle Development
Large Muscle Development Course Design 2000-2001 Course Information Organization: Division: Course Number: Title: Credits: 1 Developed by: Lecture/Lab Ratio: Transfer Status: Extended Registration Class:
More informationUniform Guidelines On Employee Selection Procedures (1978)
Uniform Guidelines On Employee Selection Procedures (1978) Comprehensive Table of Contents General Principles 60-3.1 Statement of purpose A. Need for uniformity, Issuing agencies B. Purpose of guidelines
More informationMc Graw Hill Education
STAFFING ORGANIZATION Eighth Edition Herbert G. Heneman III University of Wisconsin-Madison Timothy A. Judge University of Notre Dame John D. Kammeyer-Mueller University of Minnesota Pangloss Industries
More informationPROMOTION INDEX CODE: EFFECTIVE DATE:
PROMOTION INDEX CODE: 700.2 EFFECTIVE DATE: 11-21-17 Contents: I. Purpose II. Equal Employment Opportunity III. Legal Authority & Responsibilities IV. Anne Arundel County Charter & Code V. Promotion Manual
More informationExamination Report for Testing Year Board of Certification (BOC) Certification Examination for Athletic Trainers.
Examination Report for 2017-2018 Testing Year Board of Certification (BOC) Certification Examination for Athletic Trainers April 2018 INTRODUCTION The Board of Certification, Inc., (BOC) is a non-profit
More informationNational Council for Strength & Fitness
1 National Council for Strength & Fitness Certified Personal Trainer Examination Annual Exam Report January 1 to December 31, 2016 March 24 th 2017 Exam Statistical Report Copyright 2017 National Council
More informationChapter 9 External Selection: Testing
Chapter 9 External Selection: Testing Substantive Assessment Methods are used to make more precise decisions about the applicants & to separate finalists from candidates; they are used after the initial
More informationCOPYRIGHTED MATERIAL. Contents
Contents Preface xxiii Introduction xxv Part I Defining and Using Project Management Process Groups 1 Chapter 1 What Is a Project? 5 Defining a Project 6 Sequence of Activities 6 Unique Activities 6 Complex
More informationIREC Accredited Training Provider (FULL APPLICATION) IREC Standard 01023
IREC Accredited Training Provider (FULL APPLICATION) IREC Standard 01023 a) Legal name of the Training Provider (if different from the Company Name in your IREC Direct record). b) Name and title of the
More informationBERNARD O'MEARA University of Ballarat, Ballarat, Australia; Deakin University, Geelong, Victoria, Australia
THE HANDBOOK OF STRATEGIC RECRUITMENT AND SELECTION: A SYSTEMS APPROACH BY BERNARD O'MEARA University of Ballarat, Ballarat, Australia; Deakin University, Geelong, Victoria, Australia STANLEY PETZALL University
More informationThe Legal Defensibility of Assessments: What You Need to Know
Questionmark White Paper The Legal Defensibility of Assessments: What You Need to Know This paper explores legal defensibility in the area of assessment, describing how Questionmark Perception can be used
More informationHEALTH, SAFETY AND ENVIRONMENT MANAGEMENT SYSTEM MANUAL
Page 2 of 18 DISTRIBUTION CONTROL Distribution of this document is controlled by the Document Custodian (Senior Quality Assurance Engineer). REVISION RECORD REV REVISION DESCRIPTION DATE 00 QMS Scope Extension
More informationTesting Issues and Concerns: An Introductory Presentation to the State Directors of Career and Technical Education
Testing Issues and Concerns: An Introductory Presentation to the State Directors of Career and Technical Education Kurt F. Geisinger, Ph.D. Director, Buros Center for Testing University of Nebraska-Lincoln
More informationNote: This article is reprinted with the permission of The Journal for Civil Aviation (CAT). The photographs from the magazine have not been included.
Note: This article is reprinted with the permission of The Journal for Civil Aviation (CAT). The photographs from the magazine have not been included. CAT 2/08 Pilot Selection Diane Damos 2020 words Aiming
More informationPhysical Ability Testing
Physical Ability Testing Background A test of physical constructs assesses a candidate s ability to perform essential physical tasks of the job. Two major types of physical tests most often used by public
More informationAll required readings on the Moodle site for this course.
General Information HRM 601 Organizational Behavior M. Somers Home page: http://web.njit.edu/~somers E-mail: mark.somers@njit.edu Readings Required Reading: All required readings on the Moodle site for
More informationStefanie Moerbeek, Product Developer, EXIN Greg Pope, Questionmark, Analytics and Psychometrics Manager
Stefanie Moerbeek, Product Developer, EXIN Greg Pope, Questionmark, Analytics and Psychometrics Manager Stefanie Moerbeek introduction EXIN (Examination institute for Information Science), Senior Coordinator
More informationUniform Guidelines on Employee Selection Procedures
Page 1 of 24 Uniform Guidelines on Employee Selection Procedures Part 1607 UNIFORM GUIDELINES ON EMPLOYEE SELECTION PROCEDURES (1978) 41 C.F.R. 60-3 46 Fed. Reg. 63,268 Effective December 31, 1981 Table
More informationHEWLETT-PACKARD COMPANY CORPORATE GOVERNANCE GUIDELINES
HEWLETT-PACKARD COMPANY CORPORATE GOVERNANCE GUIDELINES These Corporate Governance Guidelines have been adopted by the Board of Directors (the Board ) of Hewlett-Packard Company ( HP ). The guidelines,
More informationAGENDA. Secrets of Competency Testing: Writing Items for Hospice and Palliative Certification Examinations
Secrets of Competency Testing: Writing Items for Hospice and Palliative Certification Examinations Presented by Lawrence J. Fabrey, PhD Senior Vice President, Psychometrics Applied Measurement Professionals,
More informationNEW YORK CITY COLLEGE OF TECHNOLOGY The City University of New York School of Arts & Sciences Department of Social Science Course Outline
NEW YORK CITY COLLEGE OF TECHNOLOGY The City University of New York School of Arts & Sciences Department of Social Science Course Outline Course code: PSY 2404 Course title: Personnel and Organizational
More informationNATIONAL CREDENTIALING BOARD OF HOME HEALTH AND HOSPICE TECHNICAL REPORT: JANUARY 2013 ADMINISTRATION. Leon J. Gross, Ph.D. Psychometric Consultant
NATIONAL CREDENTIALING BOARD OF HOME HEALTH AND HOSPICE TECHNICAL REPORT: JANUARY 2013 ADMINISTRATION Leon J. Gross, Ph.D. Psychometric Consultant ---------- BCHH-C Technical Report page 1 ---------- Background
More informationOverview. Considerations for Legal Defensibility in Standard Setting. Portland, Oregon September 16, 2016
Have you been involved in a standard setting for your industry? A. Yes B. No Test your iclicker and answer the question above. Considerations for legal defensibility in standard setting Overview Methods
More informationSUCCEED AT INSTRUCTION TABLE OF CONTENTS
SUCCEED AT INSTRUCTION TABLE OF CONTENTS INTASC (Interstate New Teacher Assessment and Support Consortium) Standards TPAI (Teacher Performance Appraisal Instrument- North Carolina Department of Public
More informationUnderstanding Your GACE Scores
Understanding Your GACE Scores September 2018 Georgia educator certification is governed by the Georgia Professional Standards Commission (GaPSC). The assessments required for educator certification are
More informationStandardized Measurement and Assessment
Standardized Measurement and Assessment Measurement Identify dimensions, quantity, capacity, or degree of something Assign a symbol or number according to rules (e.g., assign a number for height in inches
More informationTechnical Report Core Skills Entry-Level Assessment
Technical Report Core Skills Entry-Level Assessment February 1, 2017 Updated: June 12, 2017 1/26 Acknowledgments Innovate+Educate adheres to a process focused on rigorous research methodology and statistical
More informationK E N E X A P R O V E I T! V A L I D A T I O N S U M M A R Y Kenexa Prove It!
K E N E X A P R O V E I T! V A L I D A T I O N S U M M A R Y 2010 Kenexa Prove It! 800.935.6694 www.proveit.com TABLE OF CONTENTS INTRODUCTION... 3 TYPES OF VALIDATION... 4 CRITERION VALIDITY... 4 CONSTRUCT
More informationFrequently Asked Questions (FAQs)
I N T E G R A T E D WECHSLER INTELLIGENCE SCALE FOR CHILDREN FIFTH EDITION INTEGRATED Frequently Asked Questions (FAQs) Related sets of FAQs: For general WISC V CDN FAQs, please visit: https://www.pearsonclinical.ca/content/dam/school/global/clinical/canada/programs/wisc5/wisc-v-cdn-faqs.pdf
More informationPRINCIPLES AND APPLICATIONS OF SPECIAL EDUCATION ASSESSMENT
PRINCIPLES AND APPLICATIONS OF SPECIAL EDUCATION ASSESSMENT CLASS 3: DESCRIPTIVE STATISTICS & RELIABILITY AND VALIDITY FEBRUARY 2, 2015 OBJECTIVES Define basic terminology used in assessment, such as validity,
More informationpredictor of job performance a powerful INTRODUCTION
O V E R V I E W G U I D E INTRODUCTION Matrigma is a high quality psychometric tool that measures cognitive ability and is used to predict career success and job performance. Cognitive ability concerns,
More informationMCS Experience in Selection & Recruitment (Saudi Arabia)
MCS Experience in Selection & Recruitment (Saudi Arabia) Eid Al-Harby, Ph.D Director, Assessment and Selection Program for Civil Service Personnel (ASCSP), Ministry of Civil Service, The Kingdom of Saudi
More informationPSYC C performance appraisal 11/27/11 [Arthur] 1
PERFORMANCE APPRAISAL PSYC 353 11C performance appraisal 11/27/11 [Arthur] 1 Personnel Psychology subfield of I/O psychology focusing on the management of human resources Recruitment Selection Placement
More informationA Test Development Life Cycle Framework for Testing Program Planning
A Test Development Life Cycle Framework for Testing Program Planning Pamela Ing Stemmer, Ph.D. February 29, 2016 How can an organization (test sponsor) successfully execute a testing program? Successfully
More informationRecordkeeping for Good Governance Toolkit. GUIDELINE 13: Digital Recordkeeping Readiness Self-assessment Checklist for Organisations
Recordkeeping for Good Governance Toolkit GUIDELINE 1: Digital Recordkeeping Readiness Self-assessment Checklist for Organisations i The original version of this guideline was prepared by the Pacific Regional
More informationCustomer Care Ability Test. Administrator s Manual C.C.A.T. Developed by J. M. Llobet, Ph.D EDI #T0036DL
Customer Care Ability Test C.C.A.T. Developed by J. M. Llobet, Ph.D. Administrator s Manual 2009 EDI #T0036DL Table of Contents HR Assessments Products: An Investment in Your Company s Future... 4 Use
More informationCHAPTER 2 Understanding the Legal Context of Assessment- Employment Laws and Regulations with Implications for Assessment
CHAPTER 2 Understanding the Legal Context of Assessment- Employment Laws and Regulations with Implications for Assessment The number of laws and regulations governing the employment process has increased
More informationDeveloping, Validating, and Analyzing Training, Education & Experience (TEE) Requirements
Developing, Validating, and Analyzing Training, Education & Experience (TEE) Requirements October 24, 2013 Presented by Jim Kuthy, Ph.D. Heather Patchell, M.A. Visit BCGi Online If you enjoy this webinar,
More informationBusiness Administration of PTC Windchill 11.0
Business Administration of PTC Windchill 11.0 Overview Course Code Course Length TRN-4810-T 16 Hours In this course, you will gain an understanding of basic Windchill business administration tasks. You
More information