MEDICAL RECORDS/ HEALTH INFORMATION MANAGEMENT TECHNOLOGY Plan for Assessment of Student Academic Achievement 2001-2002 From the Mission of Hocking College To prepare individuals for careers as technicians or technologists who will work with skilled craftsmen and professionals. Mission of Academic Affairs Unit To promote learning and learner success. Mission of Medical Records/Health Information Management Technology To prepare individuals for entry-level careers as Health Information Management technicians in health care facilities and to provide graduates with opportunities for advancement and professional development. Central Objective Graduates of the Medical Records/Health Information Management Technology will be well prepared for entry-level employment. IP0102MedicalRecords/HIM-1
Success Skills (Institutional Core Competencies) The following general outcomes are life and work skills cultivated in all students seeking the Associate Degree. 1. Communicates effectively. 2. Demonstrates math skills. 3. Demonstrates learning and critical thinking skills. 4. Maintains professional skills and attitudes. 5. Practices human relations skills. 6. Demonstrates knowledge of science and the environment. 7. Demonstrates community, cultural, and global awareness. 8. Maintains a code of ethics. Program Exit Competencies The following outcomes express additional, particular skills, behaviors, and attitudes cultivated in students seeking the Associate Degree in Medical Records/Health Information Management. 1. Defines terminology and health information necessary for documentation. 2. Evaluates documentation to support diagnoses, tests, and treatments. 3. Collects, stores, and retains records. 4. Assigns diagnostic/procedure codes. 5. Maintains accuracy of data. 6. Analyzes data and computes statistics. 7. Manages the office environment. 8. Supervises staff. 9. Monitors changes in and compliance with accreditation standards and government regulations. 10. Responds appropriately to requests for release of information. 11. Communicates and behave in a professional manner. The Success Skills (Institutional Core Competencies) and Program Exit Competencies combine to form a single set of skills, behaviors, and attitudes determined desirable for entry-level practitioners in Medical Records/Health Information Management, for graduates transferring to four-year institutions, and for educated citizens. IP0102MedicalRecords/HIM-2
Criteria for Assessing Student Academic Achievement 1. The aggregate score for each Program Exit Competency evaluated by graduates of the Medical Records/HIM program on a survey will be 3.5 or higher (on a 5-point scale), indicating the graduates satisfaction with their Hocking College preparation for entry-level work. Data gathered for 2000-2001: * Number of graduate surveys returned: 3 Program Exit Competency** Aggregate Number of Respondents 1 4.33 3 2 3.67 3 3 4.50 2 4 3.50 2 5 4.67 3 6 3.33 3 7 3.00 2 8 3.00 2 9 3.50 2 10 3.00 2 11 4.33 3 Overall 3.78 **See page 2 of this report for a complete listing of the Program Exit Competencies Data provided by Hocking College Graduate Surveys, 2000-2001 The overall aggregate of 3.78 exceeded the 3.5 goal (on a 5-point scale). However four of the program exit competencies were rated below goal by the responding graduates. Those competencies falling below goal were as follows: #6 (Analyzes data and computes statistics), #7, (Manages the office environment), #8 (Supervises staff), and #10 (Responds appropriately to requests for release of information). Does this analysis support conclusions drawn from other assessment data analyzed for 2000-2001? Please elaborate. On the same survey, the graduates rated their overall satisfaction with their technology education at 4.00 (on a 5-point scale). * Graduate and employer survey results for 2000-2001 are reported with data for 2001-2002; survey results are not available until 15 months following June graduation. IP0102MedicalRecords/HIM-3
2. The aggregate score for each Success Skill (Institutional Core Competency) evaluated by graduates of the Medical Records/HIM program on a survey will be 3.5 or higher (on a 5-point scale), indicating the graduates satisfaction with their Hocking College preparation in life/job skills. Data gathered for 2000-2001: * Number of graduate surveys returned: 3 Success Skill ** Aggregate Number of Respondents 1 4.33 3 2 2.67 3 3 4.50 2 4 4.33 3 5 4.00 3 6 2.67 3 7 3.67 3 8 4.33 3 Overall 3.78 **See page 2 of this report for a complete listing of the Core Competencies Data provided by Hocking College Graduate Surveys, 2000-2001 The overall aggregate of 3.78 exceeded the 3.5 goal (on a 5-point scale). However, Success Skill #2 (Demonstrates math skills) and #6 (Demonstrates knowledge of science and the environment) were rated below goal. Does this analysis support conclusions drawn from other assessment data analyzed for 2000-2001? Please elaborate. On the same survey, the graduates rated their overall satisfaction with their Hocking College education at 3.67 (on a 5-point scale). * Graduate and employer survey results for 2000-2001 are reported with data for 2001-2002; survey results are not available until 15 months following June graduation. IP0102MedicalRecords/HIM-4
3. The aggregate score for each Program Exit Competency evaluated by employers of Medical Records/HIM graduates on a survey will be 3.5 or higher (on a 5-point scale), indicating betterthan-satisfactory to superior performance. Data gathered for 2000-2001*: Number of employer surveys mailed: 2 Number of employer surveys returned: 2 Program Exit Competencies Aggregate Number of Respondents 1. Defines terminology and health information 3.5 2 necessary for documentation 2. Evaluates documentation to support 4.0 2 diagnosis, tests, and treatments 3. Collects, stores, and retains records 4.0 1 4. Assigns diagnostic/procedure codes 4.0 2 5. Maintains accuracy of data 4.0 2 6. Analyzes data and computes statistics 4.0 2 7. Manages the office environment 3.0 1 8. Supervises staff NR 0 9. Monitors changes in and compliance with 3.0 1 accreditation l0. Responds appropriately to requests for 3.0 1 release of information 11. Communicates and behaves in a professional 3.5 2 manner Overall 3.7 Source of information: Hocking College Employer Survey, 2000-2001. (Completed by Career Services, June 2002) The overall aggregate of 3.7 exceeded the goal of 3.5 (on a 5-point scale). However, Program Exit Competencies #7 (Manages the office environment), #9(Monitors changes in and compliance with accreditation), and #10 (Responds appropriately to requests for release of information) fell below goal. Additionally, #8 (Supervises staff) was not evaluated by either respondent. Some strengths noted by employers were as followed: good coding knowledge and organizational skills. Some areas recommended for improvement were human resource involvement and physician office education. Does this analysis support conclusions drawn from other assessment data analyzed for 2000-2001? Please elaborate. On the same survey, the employers rated the graduate's knowledge of technical theory at 4.0 and the graduate's ability to apply theory to practice at 4.5 (on a 5-point scale). * Graduate and employer survey results for 2000-2001 are reported with data for 2001-2002; survey results are not available until 15 months following June graduation. IP0102MedicalRecords/HIM-5
4. The aggregate score for each Success Skill (Institutional Core Competency) evaluated by employers of Medical Records/HIM graduates on a survey will be 3.5 or higher (on a 5-point scale), indicating better-than-satisfactory to superior performance. Data gathered for 2000-2001*: Number of employer surveys mailed: 2 Number of employer surveys returned: 2 Success Skill ** Aggregate 1 3.5 2 3.5 3 4.0 4 3.5 5 3.5 6 4.0 7 4.0 8 4.0 Overall 3.8 Source of information: Hocking College Employer Survey, 2000-2001. (Completed by Career Services, June 2001) The overall aggregate of 3.8 exceeded the 3.5 goal (on a 5-point scale). Additionally, each Success Skill either met or exceeded the goal. Does this analysis support conclusions drawn from other assessment data analyzed for 2000-2001? Please elaborate. On the same survey the employers rated their overall satisfaction level with the preparedness of the Hocking Graduate at 4.0 (on a 5-point scale). * Graduate and employer survey results for 2000-2001 are reported with data for 2001-2002; survey results are not available until 15 months following June graduation. IP0102MedicalRecords/HIM-6
5. Fifty percent of Hocking College s Medical Records/HIM technology graduates responding to a graduate survey will report employment in the field within six months of graduation; within twelve months, that number will reach 80 percent. Data gathered for 2000-2001*: Total number of graduates: 9 Number of graduates available for employment: 7 Number of graduates employed related to technology: 5 Number of graduates furthering education: 1 Source of information: Hocking College Graduate Placement Report, 2000-2001. (Completed by Career Services, June 2002) The goal was exceeded since 71% (5 out of 7) of the responding graduates were either employed related to the technology or furthering education. Does this analysis support conclusions drawn from other assessment data analyzed for 2000-2001? Please elaborate. This criterion is the only one that addresses employment information. Graduate and employer survey results for 1998-99 are reported with data for 2000-2001; survey results are not available until 15 months following June graduation. IP0102MedicalRecords/HIM-7
6. Seventy-eight percent of Health Information Management (HIM) graduates who sit for the American Health Information Management Association (AHIMA) Registered Health Information Technologist (RHIT) within one year of graduation will pass on the first attempt, with a pass rate which meets or exceeds the national average pass rate. Data gathered for 2001-2002: Number who sat for RHIT certification exam: 7 Number who passed exam: 6 Score comparisons for students who passed or failed the exam exam with national averages: Eighty-six percent (86%. 6 out of 7 Hocking students) who sat for the AHIMA certification exam for Registered Health Information Technologists (RHITs) between the dates of 07/01/2001 and 6/30/2002 passed the exam. The national mean pass rate for first-time candidates was 71%. Hocking exceeded the national pass rate. Program change planned as a result of this analysis: The program will not be changed as a result of this analysis. This Criterion will be changed to read as follows in our 2002-2003 plan: This criterion will not be changed. IP0102MedicalRecords/HIM-8
7. The aggregate score for HIM graduates who sit for the AHIMA RHIT certification exam will meet or exceed the national average scores on each of the ten subtest areas. Data gathered for 2001-2002: Number of students taking exam: 7 Hocking students scores for each of the Domains and Subdomains are as follows: Subcategories (10) Scores 1 2 3 4 5 6 7 Hocking National Mean Mean Data structure, content and use 19 21 19 21 18 17 15 18.57 18.29 ICD-9-CM coding 8 11 5 9 11 10 8 8.86 8.29 CPT coding 10 9 6 9 10 8 6 8.29 7.86 Health Information Analysis 12 7 15 16 15 14 16 13.57 14.29 Healthcare delivery system 6 6 4 7 4 6 2 5.00 5.00 Legal issues 6 8 7 7 7 7 6 6.86 6.57 Healthcare Information requirements 7 6 6 8 5 6 3 5.86 5.43 Information Technology 4 4 7 4 6 5 6 5.14 5.29 Health Information systems 7 7 5 7 6 8 6 6.57 6.57 Organization and Supervision 9 11 9 9 8 7 6 8.43 8.14 87.14 85.71 Hocking College graduates scored at or above the national mean in all areas except Health Information Analysis and Information Technology. This is a dramatic improvement over previous years. Program change planned for 2002-2003 as a result of this analysis: More emphasis will be placed in all HIM courses on abstracting info for indices/databases and on quality management, utilization and risk management and patient care related studies as well as calculating and interpreting healthcare stats and presenting data in verbal and written forms. I will meet and work with computer faculty regarding student training in the use of spreadsheets, databases, word processing, graphics, and presentations. I will facilitate and develop computer projects for students to perform in HIT courses and develop a collaborative project approach between myself and the computer that involve spread sheets, databases and graphic related to subjects students learn in the HIT curriculum. This Criterion will be changed to read as follows in our 2002-2003 Plan: This criterion will not be changed. IP0102MedicalRecords/HIM-9
8. The aggregate score for each competency evaluated by on-site clinical supervisors for students in the First HIM Clinical will be 3.5 or higher, indicating better-than-adequate performance. Data gathered for 2001-2002: Number of students evaluated: 12 Competency Aggregate 1. Attendance 4.67 2. Punctuality 4.67 3. Communicates effectively 4.17 4. Demonstrates critical thinking 4.18 5. Demonstrates math skills 4.25 6. Demonstrates knowledge of science and environment 4.27 7. Demonstrates professional skills 4.25 8. Maintains code of ethics 4.58 9. Demonstrates community, cultural, and global awareness 4.17 10. Defines necessary information for documentation 4.20 11. Evaluates documentation to support diagnosis 4.20 12. Demonstrates knowledge to collect, store, and retain information 4.08 13. Demonstrates knowledge regarding outpatient coding 4.50 14. Demonstrates knowledge to maintain accuracy of data 4.17 The goal was exceeded in all competency areas. Program change planned for 2002-2003 as a result of this analysis: No changes are planned as a result of this analysis. This Criterion will be changed to read as follows in our 2002-2003 Plan: This criterion will not be changed. IP0102MedicalRecords/HIM-10
9. The aggregate score for each Competency evaluated by on-site clinical supervisors for students in the second HIM clinical will be 3.8 or higher, indicating better-than-adequate performance. Data gathered for 2001-2002: Number of students evaluated: 13 Competency Aggregate 1. Attendance 4.62 2. Punctuality 4.45 3. Communicates effectively 4.27 4. Demonstrates critical thinking 4.09 5. Demonstrates math skills 4.22 6. Demonstrates knowledge of science and environment 4.40 7. Demonstrates professional skills 4.36 8. Maintains code of ethics 4.45 9. Demonstrates community, cultural, and global awareness 4.20 10. Defines necessary information for documentation 4.50 11. Evaluates documentation to support diagnosis 4.22 12. Demonstrates knowledge to collect, store, and retain information 4.40 13. Demonstrates knowledge regarding outpatient coding 4.44 14. Demonstrates knowledge to maintain accuracy of data 4.40 The goal was exceeded in all categories. Program change planned for 2002-2003 as a result of this analysis: The program will not be changed. This Criterion will be changed to read as follows in our 2002-2003 Plan: This criterion will not be changed. IP0102MedicalRecords/HIM-11
10. The aggregate score for each competency evaluated by on-site clinical supervisors for students in the third HIM clinical will be 4.1 or higher, indicating excellent to superior performance. Data gathered for 2001-2002: Number of students evaluated: 17 Competency Aggregate 1. Attendance 4.71 2. Punctuality 4.71 3. Communicates effectively 4.65 4. Demonstrates critical thinking 4.53 5. Demonstrates math skills 4.55 6. Demonstrates knowledge of science and environment 4.69 7. Demonstrates professional skills 4.69 8. Maintains code of ethics 4.73 9. Demonstrates community, cultural, and global awareness 4.56 10. Defines necessary information for documentation 4.43 11. Evaluates documentation to support diagnosis 4.50 12. Demonstrates knowledge to collect, store, and retain information 4.56 13. Demonstrates knowledge regarding outpatient coding 4.38 14. Demonstrates knowledge to maintain accuracy of data 4.53 The goal was exceeded in all categories. Program change planned for 2002-2003 as a result of this analysis: The program will not be changed. This Criterion will be changed to read as follows in our 2002-2003 Plan: This criterion will not be changed. IP0102MedicalRecords/HIM-12