Public Disclosure of Student Learning

Transcription

1 Public Disclosure of Student Learning Institution National Louis University Academic Business Unit College of Professional Studies and Advancement Academic Year International Accreditation Council for Business Education

2 Report of Student Learning and Achievement National Louis University College of Professional Studies and Advancement (CPSA) For Academic Year: Student Learning Assessment for: B.S. in Health Care Leadership Program Intended Student Learning Outcomes (Program ISLOs) 1. Utilize written and oral communication skills to convey health care issues to colleagues, administration, patients, and the public. 2. Practice effective team work in health care situations. 3. Construct and deliver health care presentations locally and at the state level. 4. Analyze health care situations and solve problems within their professional practice areas from legal, ethical, cultural, clinical, and financial perspectives. 5. Analyze compliance with human resource guidelines and policies of the institution, and state and federal laws and regulations. 6. Formulate and implement a strategic plan on a departmental level. Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. Peregrine Health Care Assessment of Outbound Students Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5, 6 2. Team Development Project Assessment Program ISLOs Assessed by this Measure: 2 Objectives (Targets/Criteria) for Measures: Mean score of 50% or higher for individual Program ISLOs for all outbound exam results in the report year. The 17 relevant CPC outbound exam subdiscipline areas are mapped out to individual Program ISLOs and scores on subdiscipline areas are averaged to obtain the Program ISLO mean score. Mean rubric score of 4.0 or higher (on a 5.0 scale) for all team development projects assessed in the report year conducted in HCL316, Team Development in Health Care. 3. Presentation Skills Project Assessment Program ISLOs Assessed by this Measure: 1, 3 Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: Mean rubric score of 4.0 or higher (on a 5.0 scale) for all presentation skills projects assessed in the report year conducted in HCL311, Professional Writing and Presentation Skills in Health Care. Objectives (Targets/Criteria) for Measures: 1. End of Program (EoP) Survey Mean score of 5.0 or higher (on a 6.0 scale) for individual Program ISLOs for all EoP surveys completed in the report year. Multiple survey questions are mapped 1

3 Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5, 6 out to individual Program ISLOs and scores on questions are averaged to obtain the Program ISLO mean score. Learning Assessment Results: B.S. in Health Care Leadership Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: Peregrine Health Care Assessment of Outbound Students The results of the Peregrine Health Care Assessment of Outbound Students, based on 27 outbound students taking the exit assessment in , indicated that the Program met and exceeded its target of 50% for all six Program ISLOs as follows: 1. Utilize written and oral communication skills to convey health care issues to colleagues, administration, patients, and the public: 61.69% 2. Practice effective team work in health care situations: 57.98% 3. Construct and deliver health care presentations locally and at the state level: 63.38% 4. Analyze health care situations and solve problems within their professional practice areas from legal, ethical, cultural, clinical, and financial perspectives: 51.50% 5. Analyze compliance with human resource guidelines and policies of the institution, and state and federal laws and regulations: 57.46% 6. Formulate and implement a strategic plan on a departmental level: 57.76%. Some of the weaker sub-areas of student performance, which contributed to lowering scores in Program ISLOs 2, 4, 5, and 6 were the areas of Facilitation and Negotiation, Financial Management, Quality Improvement, the Community and the Enviroment, and the Legal Environment of Healthcare Administration. The faculty have taken this feedback into account in completing a program redesign (effective for students who started in Winter 2017), and which resulted in the following actions: Moving all courses from 5 weeks to 6 weeks to improve content coverage across the board; Implementing two new required courses, HCL350, Quality Analysis and Improvement in Health Care, and PJM300, Overview of Project Management, to assist students with quality assurance and project management skills. 2. Summary of Results for Measure 2: Team Development Project Assessment The outcome of this direct measure of students demonstrating their ability to practice effective team building skills an average score of 4.97 on a 5.0 scale was reported out of an N of 35, well exceeding the target score of 4.0 or above. 3. Summary of Results for Measure 3: Presentation Skills Project Assessment The outcome of this direct measure of students demonstrating their ability to construct and deliver health care presentations locally and at the state level and demonstrating their ability to utilize written and oral communication skills to convey health care issues to colleagues, administration, patients, and the public an average score of on a 5.0 scale was reported out for an N of 25, well exceeding the target score of 4.0 or above. Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: End of Program (EoP) Survey The EoP survey results indicate the following student evaluations of their experiences in the program, on a 6.0 scale: 2

4 1. Utilize written and oral communication skills to convey health care issues to colleagues, administration, patients, and the public: Practice effective team work in health care situations: Construct and deliver health care presentations locally and at the state level: Analyze health care situations and solve problems within their professional practice areas from legal, ethical, cultural, clinical, and financial perspectives: Analyze compliance with human resource guidelines and policies of the institution, and state and federal laws and regulations: Formulate and implement a strategic plan on a departmental level: 5.59 All of the ratings for aggregate Program ISLOs have exceeded the target of 5.0. Some of the sub-areas that contributed to lower scores on Program ISLOs 4 and 5 included lower self-evaluation scores on quality management/assurance, data collection, budget development, and HR tasks. As discussed in the Measures section, the actions taken by the program in are directly or indirectly addressing some of this feedback already for continuing program improvement. Summary of Achievement of Intended Student Learning Outcomes: Intended Student Learning Outcomes Learning Assessment Measures Program ISLOs Measure 1 Measure 2 Measure 3 Measure 4 Measure 1 Measure 2 Measure 3 Measure 4 1. Utilize written and oral communication skills to convey health care issues to colleagues, administration, patients, and the public. Met 2. Practice effective team work in health care situations. Met 3. Construct and deliver health care presentations locally and at the state level. Met 4. Analyze health care situations and solve problems within their professional practice areas from legal, ethical, cultural, clinical, and 3

5 financial perspectives. 5. Analyze compliance with human resource guidelines and policies of the institution, and state and federal laws and regulations. 6. Formulate and implement a strategic plan on a departmental level. Proposed Courses of Action for Improvement in Learning Outcomes for which Targets Were Not Met: 1. Not applicable. 4

6 Student Learning Assessment for: B.S. in Management Program Intended Student Learning Outcomes (Program ISLOs) 1. Apply management and leadership theories to complex organizational issues. 2. Identify, collect, and analyze financial, economic, and operational data, and present recommendations for managerial action. 3. Manage projects utilizing a variety of productivity tools. 4. Develop a marketing strategy for a product or service. 5. Analyze a strategy and predict its impact on an organization. Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. Peregrine Business Assessment of Outbound Students Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5 Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. End of Program (EoP) Survey Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5 Objectives (Targets/Criteria) for Measures: Mean score of 45% or higher for each of the five Program ISLOs for all outbound exam results in the report year. The 15 relevant CPC outbound exam subdiscipline areas are mapped out to individual Program ISLOs and scores on subdiscipline areas are averaged to obtain the Program ISLO mean score. Objectives (Targets/Criteria) for Measures: Mean score of 4.0 or higher (on a 5.0 scale) for individual Program ISLOs for all EoP surveys completed in the report year. When applicable, multiple survey questions are mapped out to individual Program ISLOs and scores on questions are averaged to obtain the Program ISLO mean score. Learning Assessment Results: B.S. in Management Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: Peregrine Business Assessment for Outbound Students The results of the Peregrine Business Assessment of Outbound Students, based on 60 outbound students taking the exit assessment in , indicated the following mean scores for Program ISLOs: 1. Apply management and leadership theories to complex organizational issues: 44.34% 2. Identify, collect, and analyze financial, economic, and operational data, and present recommendations for managerial action: 41.88% 3. Manage projects utilizing a variety of productivity tools: 45.00% 4. Develop a marketing strategy for a product or service: 43.42% 5. Analyze a strategy and predict its impact on an organization: 42.07%. 5

7 Four out of five results (Programs ISLOs 1, 2, 4, and 5) do not meet the program-established benchmark of 45%. One (Program ISLO 3) meets the program benchmark exactly. The individual disciplines where students performed the strongest were Organizational Behavior (51.79%), Information Management Systems (48.83%), and Business Integration and Strategic Management (46.83%). The disciplines where student performance was the weakest were Business Finance (33.67%), Quantitative Research Techniques and Statistics (37.17%), and Economics (37.83%). The response to these program assessment findings, which was already initiated in AY , is indicated in the Proposed Course of Action section. Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: End of Program Survey The EoP survey results indicate the following student evaluations of their experiences in the program, on a 5.0 scale and based on 62 respondents taking the exit survey in : 1. Apply management and leadership theories to complex organizational issues: Identify, collect, and analyze financial, economic, and operational data, and present recommendations for managerial action: Manage projects utilizing a variety of productivity tools: Develop a marketing strategy for a product or service: Analyze a strategy and predict its impact on an organization: 4.24 The aggregate student ratings for all five program outcomes exceeded the program criterion of 4.0. The students also rated their performance in the program in all areas that contributed to the five learning outcomes with scores consistetntly exceeding the 4.0 criterion, with the exception of a question that rated their understanding of the structure of the markets (capital, labor, technology, and services), at This area is in the discipline of economics and to the Program ISLO-2; and this rating is consistent with the findings of the direct measures assessment. Please see the Proposed Course of Action section for further discussion of plan to address this issue. Summary of Achievement of Intended Student Learning Outcomes: Intended Student Learning Outcomes Learning Assessment Measures Program ISLOs Measure 1 Measure 2 Measure 3 Measure 4 Measure 1 Measure 2 Measure 3 Measure 4 1. Apply management and leadership theories to complex organizational Not 6

8 issues. 2. Identify, collect, and analyze financial, economic, and operational data, and present recommendations for managerial action. 3. Manage projects utilizing a variety of productivity tools. 4. Develop a marketing strategy for a product or service. 5. Analyze a strategy and predict its impact on an organization. Not Not Not Proposed Courses of Action for Improvement in Learning Outcomes for which Targets Were Not Met: 1. Curriculum and Scheduling Revisions for B.S. in Management (Addresses Program ISLOs 1, 2, 4, 5) The data indicated here is reflective of the program curriculum being taught out through Fall Over , the College s Undergraduate Business Faculty team with assistance from the Program Advisory Board, guided by the assessment data and other research on the program effectiveness, has made a number of revisions to the curriculum of this program, which was approved in March 2016 and made effective for new student enrollment for September The curricular revisions included: Adding a new required quantitative analysis course, BUS450, Data Analysis for Managers (5QH), to program requirements. Incorporating the required general education statistics course in the program scheduling sequence to precede BUS450 for those students who did not take it previously or did not transfer it in to ensure depth of coverage and acquisition of statistical skills while in the program. Adding a new required economics course, ECO440, Economics for Managers (5QH), to program requirements. Revising prior finance course MGT444, Financial Decision Making (4QH) and increasing its length and credit value. The revised course is FIN444, Finance and Accounting Concepts for Managers (5QH). Splitting the coverage of ethics and legal issues into two 2 quarter-hour courses, to be taken over a 12-week period. Eliminating duplicative coverage in several courses (such as a second business communications course; and a critical thinking course that mirrored a required course offered in the general education program) Comprehensively revising most courses in the program and increasing credit values of multiple courses from 4QH to 5QH. Increasing the length of all courses from 5 weeks to 6 weeks. These changes increased the length of the program from 51 quarter hours to 54 quarter hours and increased the amount of instructional weeks in the program by approximately 20% by increasing the quarter length from 10 weeks to 12 weeks. The changes directly addressed student performance in most areas in which they did not perform well in the Peregrine assessments, especially in weakest disciplines of Business Finance 7

9 (33.67%), Quantitative Research Techniques and Statistics (37.17%), and Economics (37.83%). We expect to begin assessing the results of the first set of graduates from the revised program in the second half of AY Addition of Artifact-Based Assessments in BUS499, Strategic Management Capstone (Addresses Program ISLOs 1, 2, 4, 5) In addition to relying on the multiple-choice type assessment of Peregrine, the UG business team will pilot an artifact-based assessment of student performance in the capstone course of B.S. in Management program: BUS499, Strategic Management Capstone. In this course, students are expected to demonstrate acquisition of all program learning outcomes. Obtaining a second point of information will allow the program and its faculty to more accurately identify both successes and opportunities for improvement in student learning. 8

10 Student Learning Assessment for: B.S. in Management Information Systems Program Intended Student Learning Outcomes (Program ISLOs) 1. Identify, explain, analyze, and apply fundamental management information systems concepts such as hardware, networking, software, and data management. 2. Use software tools and techniques such as web development, database development, and data mining techniques. 3. Evaluate and suggest improvements to the security of information technology in an organization. 4. Explain the role of information technology in managing and leading diverse, globally-distributed work-teams and organizations 5. Devise and plan the delivery of strategic, innovative technological solutions for organizational challenges. 6. Use best practices and tools for own career advancement and in mentoring others. Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. Peregrine Business Assessment of Outbound Students Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5 2. Career Portfolio Assessment Program ISLOs Assessed by this Measure: 6 Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. End of Program (EoP) Survey Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5, 6 Objectives (Targets/Criteria) for Measures: Mean score of 45% or higher for each of the five Program ISLOs for all outbound exam results in the report year. The 15 relevant CPC outbound exam subdiscipline areas are mapped out to individual Program ISLOs and scores on subdiscipline areas are averaged to obtain the Program ISLO mean score. Mean rubric score of 4.0 or higher (on a 5.0 scale) for the comprehensive career portfolio compiled in MIS499, MIS Capstone, capstone course in the B.S. in Management Information Systems program. Objectives (Targets/Criteria) for Measures: Mean score of 4.0 or higher (on a 5.0 scale) for individual Program ISLOs for all EoP surveys completed in the report year. When applicable, multiple survey questions are mapped out to individual Program ISLOs and scores on questions are averaged to obtain the Program ISLO mean score. Learning Assessment Results: B.S. in Management Information Systems Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: Peregrine Business Assessment of Outbound Students The analysis of the areas of Peregrine Business Assessment of Outbound students mapped to Program ISLOs for this program identifies the following results, based on 8 students completing the assessment during assessment period: 9

11 1. Identify, explain, analyze, and apply fundamental management information systems concepts such as hardware, networking, softwarte, and data management: 51.88% 2. Use software tools and techniques such as web development, databases development, and data mining techniques: 51.88% 3. Evaluate and suggest improvements to the security of information technology in an organization: 46.38% 4. Explain the role of information technology in managing and leading diverse, globally-distributed work-teams and organizations: 40.88% 5. Devise and plan the delivery of strategic, innovative technological solutions for organiational challenges: 46.38% The data indicates that four of the five outcomes measured by the Peregrine assessment are met. The Program ISLO 4, in which students demonstrate the ability to connect the concepts of information technology to business leadership and global dimensions of business, was under the 45% benchmark due to the low performance on the global dimensions of business area at 33%. 2. Summary of Results for Measure 2: Career Portfolio Assessment This direct measure assesses students ability to manage their own careers and the careers of others. This is a new Program ISLO implemented as a result of program redesign communicated to the University community in January 2017 and effective for students entering the program as of Winter 2017 quarter. This assessment is incorporated in the revised capstone course, MIS499, MIS Capstone, which has not been offered yet, and is expected to be offered in early Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: End of Program (EoP) Survey EoP Surveys completed by program graduates during year and on a 5.0 scale, indicate the following self-assessments related to accomplishing program outcomes, based on 8 students completing the assessment: 1. Identify, explain, analyze, and apply fundamental management information systems concepts such as hardware, networking, softwarte, and data management: Use software tools and techniques such as web development, databases development, and data mining techniques: Evaluate and suggest improvements to the security of information technology in an organization: Explain the role of information technology in managing and leading diverse, globally-distributed work-teams and organizations: Devise and plan the delivery of strategic, innovative technological solutions for organiational challenges: Use best practices and tools for own career advancement and in mentoring others: 4.25 While based on a small number of students completing the survey, the results are consistent with the focused nature of the program and the faculty s assessment of student performance in individual courses. Summary of Achievement of Intended Student Learning Outcomes: Intended Student Learning Outcomes Learning Assessment Measures 10

12 Program ISLOs Measure 1 Measure 2 Measure 3 Measure 4 Measure 1 Measure 2 Measure 3 Measure 4 1. Identify, explain, analyze, and apply fundamental management information systems concepts such as hardware, networking, software, and data management. 2. Use software tools and techniques such as web development, database development, and data mining techniques. 3. Evaluate and suggest improvements to the security of information technology in an organization. 4. Explain the role of information technology in managing and leading diverse, globally-distributed workteams and organizations Not 5. Devise and plan the delivery of strategic, innovative technological solutions for organizational challenges. 6. Use best practices and tools for own career advancement and in mentoring others. Not Proposed Courses of Action for Improvement in Learning Outcomes for which Targets Were Not Met: 1. Curriculum and Scheduling Revisions for B.S. in Management Information Systems (Addresses Program ISLO 4) The data indicated here is largely reflective of the program curriculum being taught out through Summer Over , the College s Undergraduate Business Faculty team, guided by the assessment data and other research on the program effectiveness, has made a number of revisions to the curriculum of this program, which were approved in July 2016 and January 2017 respectively, and made effective for new student enrollment for Winter 2017 term. The curricular revisions included: 11

13 Comprehensively revising most courses in the program and increasing credit values of multiple courses from 4QH to 5QH. Increasing the length of all courses from 5 weeks to 6 weeks. Increasing the coverage of business topics in the program through sharing of the gateway courses (BUS430, Management and Leadership; and BUS421, Professional Communication for Managers). Comprehensively revised the capstone course as MIS499, MIS Capstone, with greater emphasis on career outcomes and strategies, as well as on connections between management information systems and business strategies. These changes increased the length of the program from 51 quarter hours to 54 quarter hours and increased the amount of instructional weeks in the program by approximately 20% by increasing the quarter length from 10 weeks to 12 weeks. The addition of BUS430 as a required course is also expected to contribute to higher competency in globalization and global issues-related knowledge. 2. Identification of alternative direct measures of student learning outcomes (Addresses Program ISLO 6) While the institution has historically relied on Peregrine assessments for direct measures of student learning outcomes, the Peregrine Business Assessment is limited in its coverage of management information systems topics. The faculty are researching alternative measures that will allow to create more robust opportunities for identifying opportunities for improvement in individual areas of student performance and consequently, areas of opportunity for continuing program improvement. 12

14 Student Learning Assessment for: M.S. in Human Resource Management and Development Program Intended Student Learning Outcomes (Program ISLOs) 1. Evaluate personal talents and opportunities for their expression in the human resource management profession. 2. Develop knowledge and competencies to practice HR functions focused on people. 3. Develop knowledge and competencies to practice HR functions focused on organization performance. 4. Develop knowledge and competencies to practice HR functions focused on workplace climate. 5. Develop knowledge and competencies to practice HR functions focused on business and HR strategy. Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. Capstone Project Assessment Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5 Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. End of Program (EoP) Survey Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5 Objectives (Targets/Criteria) for Measures: Mean rubric score of Proficient (3.0) or higher for individual Program ISLOs compiled for the report year. The Capstone Project is completed in HRM599, Integrating Business and HR Strategy (revised program); or MGT508, Current Practices in Human Resource Management (legacy program). Objectives (Targets/Criteria) for Measures: Proficiency in individual Program ISLO is rated as Intermediate or higher by 80% or more of students completing the survey in the reporting year. Learning Assessment Results: M.S. in Human Resource Management and Development Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: Capstone Project Assessment The HRMD program implemented a new assessment protocol for capstone projects in the program and changed the format of capstone projects from group project to individual projects in to enable thoughtful assessment and reflection of individual students performance. Two sections of HRM508 (capstone course that was succeeded by HRM599 in the revised program) with a total of 16 students were assessed with the following results: 1. Evaluate personal talents and opportunities for their expression in the human resource management profession: Mean = 3.3, σ = Develop knowledge and competencies to practice HR functions focused on people: Mean = 3.9, σ = Develop knowledge and competencies to practice HR functions focused on organization performance: Mean = 3.7, σ = Develop knowledge and competencies to practice HR functions focused on workplace climate: Mean = 3.8, σ =

15 5. Develop knowledge and competencies to practice HR functions focused on business and HR strategy: Mean = 3.5, σ = 0.89 The results of assessment indicated that the program met all of its targets for the five Program ISLOs. The highest scores were on knowledge and competencies related to people, which cover the areas of total rewards (compensation and benefits), talent acquisition and retention, and training and development; and knowledge and competencies related to workplace climate, which cover the areas of employment law and regulation, organizational culture, and diversity and inclusion. The lowest scores were in the category related to expression of personal talents in the HRM profession and connection of the HR functions to the overall strategy of the organization. This feedback confirms some of the observations expressed by the HRM faculty, and has been taken into account in the redesign of the gateway (HRM509) and capstone (HRM599) courses. Similarly, the variation of student performance on individual program learning outcomes is significant. The program will be working to both raise the mean and reduce the variation of scores in the upcoming year through both intentional design of the capstone experience, which will emphasize submission of individual capstone components as required assignments, review and feedback from faculty, and incorporation of feedback in the final deliverable; as well as aligning the content of other courses with the requirements of the capstone, especially through portfolio-type artifacts. Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: End of Program Survey The analysis of responses for graduates indicate the following levels of self-assessment of skills in HR competencies, based on 11 responses obtained in surveys: 1. Evaluate personal talents and opportunities for their expression in the human resource management profession: 91% indicated skills as intermediate or higher (36% intermediate, 36% proficient, 18% advanced expertise) 2. Develop knowledge and competencies to practice HR functions focused on people: 82% indicated skills as intermediate or higher (36% as intermediate, 36% as proficient, and 9% as advanced expertise) 3. Develop knowledge and competencies to practice HR functions focused on organization performance: 91% indicated skills as intermediate or higher (36% intermediate, 36% proficient, 18% advanced expertise) 4. Develop knowledge and competencies to practice HR functions focused on workplace climate: 82% indicated skills as intermediate or higher (27% as intermediate, and 55% as proficient) 5. Develop knowledge and competencies to practice HR functions focused on business and HR strategy: 82% indicated skills as intermediate or higher (36% as intermediate, 36% as proficient, and 9% as advanced expertise). Generally, these results indicate students perception of acquisition of skills. The program will also incorporate the exit survey as a required part of its capstone course to increase the rate of response, and revise the response scale for consistency with other programs. Summary of Achievement of Intended Student Learning Outcomes: Intended Student Learning Outcomes Learning Assessment Measures 14

16 Program ISLOs Measure 1 Measure 2 Measure 3 Measure 4 Measure 1 1. Program Learning Outcome 1 2. Program Learning Outcome 2 3. Program Learning Outcome 3 4. Program Learning Outcome 4 5. Program Learning Outcome 5 Measure 2 Proposed Courses of Action for Improvement in Learning Outcomes for which Targets Were Not Met: 1. Not applicable. Measure 3 Measure 4 15

17 Student Learning Assessment for: Master of Business Administration (M.B.A.) Program Intended Student Learning Outcomes (Program ISLOs) 1. Finance: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Finance. 2. Economics: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Economics. 3. Strategy: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Strategy. 4. Organizational & Human Resources: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Organizational & Human Resources. 5. Marketing: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Marketing. 6. Leading in a Dynamic Environment: Develop an enhanced awareness of their own strengths and potential as organizational actors and change agents. 7. Problem Solving/Analytical Skills: Apply critical thinking skills such as problem solving and logical analysis. 8. Communication: Demonstrate effective communication skills. 9. Teamwork Skills: Demonstrate their ability to participate effectively in teams. 10. Ethical Responsibility: Analyze the ethical components of organizational decisions. Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. CompXM Functional Skills/Assurance of Learning Assessment Program ISLOs Assessed by this Measure: 1, 3, 4, 5, 6, 7, 9, Economics Assessment Program ISLOs Assessed by this Measure: 2 3. Communications Assessment Program ISLOs Assessed by this Measure: 8 Objectives (Targets/Criteria) for Measures: Mean score of 50% or higher for areas of CompXM Functional Skills/Assurance of Learning Assessment mapped to corresponding Program ISLOs. When more than one area is mapped to a Program ISLO, simple mean of the multiple areas is used, if applicable. 80% or more of students achieve an average rubric score of 2.0 (Average) or greater (on a 3.0 scale) in the final economics assessment in MBA508, Managerial Economics. 65% or more of students are rated as Proficient or higher on the University-level Communications rubric in an artifact from MBA524, Strategic Management (MBA program capstone course). 16

18 Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. End of Program (EoP) Survey Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 Objectives (Targets/Criteria) for Measures: Mean score of 4.0 or higher (on a 5.0 scale) for individual Program ISLOs for all EoP surveys completed in the report year. When applicable, multiple survey questions are mapped out to individual Program ISLOs and scores on questions are averaged to obtain the Program ISLO mean score. Learning Assessment Results: Master of Business Administration (M.B.A.) Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: CompXM Functional Skills/Assurance of Learning Assessment The direct measures of student learning outcomes indicate the following results, as compared against the benchmark criterion of 50% performance: 1. Finance: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Finance: Mean = 44% (mapped to the areas of Accounting, 45%, and Finance, 43%, in CompXM Functional Skills) 3. Strategy: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Strategy: Mean = 48% (mapped to the area of Strategy in CompXM Functional Skills) 4. Organizational & Human Resources: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Organizational & Human Resources: Mean = 55% (mapped to the area of Human Resources in CompXM Functional Skills) 5. Marketing: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Marketing: Mean = 53% (mapped to the area of Marketing in CompXM Functional Skills) 6. Leading in a Dynamic Environment: Develop an enhanced awareness of their own strengths and potential as organizational actors and change agents: Mean = 52% (mapped to the area of Teamwork and/or Leadership skills in CompXM Assurance of Learning) 7. Problem Solving/Analytical Skills: Apply critical thinking skills such as problem solving and logical analysis: Mean = 47% (mapped to the areas of Analytical and/or Quantitative Skills, 46%, and Critical-thinking and/or Decision-making Skills, 48%, in CompXM Assurance of Learning) 9. Teamwork Skills: Demonstrate their ability to participate effectively in teams: Mean = 52% (mapped to the area of Teamwork and/or Leadership skills in CompXM Assurance of Learning) 10. Ethical Responsibility: Analyze the ethical components of organizational decisions: Mean = 52% (mapped to the area of Ethics, Legal, and/or Social Responsibility Skills in CompXM Assurance of Learning) Out of eight Program ISLOs assessed through CompXM, five met established criteria/targets (Organizational and Human Resources; Marketing; Leading in a Dynamic Environment; Teamwork Skills; and Ethical Responsibility) and three were below the established threshold (Finance; Strategy; and Problem Solving/Analytical Skills). 17

19 2. Summary of Results for Measure 2: Economics Assessment The assessment of artifacts (essay-based final examination from MBA508, Managerial Economics) indicated the following results based on a sample of n=31 drawn from two sections of the course taught in AY and assessed on a five-level Likert Scale, with assigned values from 1.0 (Poor) to 3.0 (Excellent): Criterion: 80% of students perform at a level of 2.0 (Average) or higher. Assessment result: 93.6% of students (29 out of 31) performed at a level of 2.0 (Average); average score of 2.54 (performing at slightly above level of 2.5, Good). These results indicate a strong acquisition of skills and knowledge relevant to this Program ISLO. 3. Summary of Results for Measure 3: Communications Assessment The program works together with the University assessment team on determining appropriate assessment artifacts for communication assessment and analyzing it using a University-wide rubric through a discipline-agnostic assessment process. The University-wide target for written communications is an overall performance at 65% or higher at the level of Proficient or above. The Written Communication assessment results indicate the following outcomes for a sample of 10 student artifacts: Graduate Achievement of Written Communication (MBA Data Only) Rubric Criteria Less than proficient % Less than proficient Proficient or above % Proficient or above Context and Purpose 2 20% 8 80% Content Development and Organization % 0 0% Linguistic Conventions and Mechanics 0 0% % Sources and Evidence % 0 0% The results indicate that the MBA students excelled in the Context and Purpose and Linguistic Conventions and Mechanics dimensions of writing. However, overall, they did not meet the 65% target. Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: End of Program (EoP) Survey The results of the EoP survey, with a total of 13 respondents, indicate the following self-assessments by students of their perception of acquisition of program learning outcomes: 1. Finance: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Finance: Mean =

20 2. Economics: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Economics: Mean = Strategy: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Strategy: Mean = Organizational & Human Resources: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Organizational & Human Resources: Mean = Marketing: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Marketing: Mean = Leading in a Dynamic Environment: Develop an enhanced awareness of their own strengths and potential as organizational actors and change agents: Mean = Problem Solving/Analytical Skills: Apply critical thinking skills such as problem solving and logical analysis: Mean = Communication: Demonstrate effective communication skills: Mean = Teamwork Skills: Demonstrate their ability to participate effectively in teams: Mean = Ethical Responsibility: Analyze the ethical components of organizational decisions: Mean = 4.5 The program has met its goals for every program outcome. The highest reported scores were for the areas of Ethical Responsibility, Leading in a Dynamic Environment, Strategy, and Problem Solving/Analytical Skills. The lowest scores were for the area of Marketing. The program is concerned about low response rates to the EoP Survey and will take action to increase such response rates in EOP data collection was not consistent in A revised data collection procedure needs to be implemented by the program faculty. Inconsistent completion of the EOP survey and apparent low incentive for students to complete the exam have resulted in very low submission rates. Program Chair and faculty will review current procedures and devise approaches that will lead to improved EOP submission rates. Summary of Achievement of Intended Student Learning Outcomes: Intended Student Learning Outcomes Learning Assessment Measures Program ISLOs Measure 1 Measure 2 Measure 3 Measure 4 Measure 1 Measure 2 Measure 3 Measure 4 1. Finance: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Finance. Not 19

21 2. Economics: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Economics. 3. Strategy: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Strategy. 4. Organizational & Human Resources: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Organizational & Human Resources. 5. Marketing: Demonstrate the ability to analyze organizational issues, evaluate possible alternatives, and determine appropriate actions through application of the discipline area of Marketing. 6. Leading in a Dynamic Environment: Develop an enhanced awareness of their own strengths and potential as organizational actors and change agents. 7. Problem Solving/Analytical Skills: Apply critical thinking skills such as Not Not 20

22 problem solving and logical analysis. 8. Communication: Demonstrate effective communication skills. 9. Teamwork Skills: Demonstrate their ability to participate effectively in teams. 10. Ethical Responsibility: Analyze the ethical components of organizational decisions. Not Proposed Courses of Action for Improvement in Learning Outcomes for which Targets Were Not Met: 1. Curriculum Recommendation: MBA524, Strategic Management Course Length (Addresses Program ISLOs 1, 3, 7) This recommendation addresses the Program ISLOs measured by the CompXM simulation, which currently include Program ISLOs 1, 3, 4, 5, 6, 7, 9, 10; and as of Fall 2017, which will also include Program ISLO 8 (Communication), which was measured through the University Learning Outcome assessment process in Results in the CompXM exam in MBA524 are highly dependent on students understanding and proficiency with the Capstone simulation, the team simulation exercise in MBA524 that runs throughout the six week duration of the course. Proficiency gained via experience with the Capstone simulation up to the point when they take the CompXM exam (the last 2 weeks of MBA524) impacts CompXM exam results. Most schools have a much longer time frame to gain competence with the Capstone simulation, typically most of an entire quarter or semester (10 to 15 weeks) before taking CompXM and thus are better prepared for CompXM. For Program Functional Learning Outcomes we are comparing our student performance against this set of generally better-prepared students. In order to reach higher overall levels of proficiency as measured in CompXM, we would need to consider lengthening the MBA524 course or add a separate Capstone Simulation course, of say 3 weeks to allow more time to gain proficiency with the Capstone simulation. The MBA Faculty will propose a specific plan of action for increasing the length of this course and aligning it with the rest of the curriculm and scheduling practices; and identify a pilot to be run in Change in Measure Assessment Methodology for Communication Program ISLO (Addresses Program ISLO 8) As of Fall 2017, the MBA program will switch to CompXM for assessment of its Communication outcome, and integrate this assessment with assessment of other Program ISLOs in the capstone course. This proposed change in direct measure for this student learning outcomes is informed by the following considerations: (1) inconsistent alignment of the University communication rubric to the writing skills expected of business students; and (2) additional review of possible artifacts and assignments that may constitute a better match for the University-level assessment of writing. 21

23 Student Learning Assessment for: Master of Health Services Administration Program Intended Student Learning Outcomes (Program ISLOs) 1. Utilize written and oral communication skills to convey health care issues that assist colleagues, administration, patients, and the public to make informed decisions. 2. Assess the impact of national health policies on institutional decisions. 3. Distinguish the ethical and legal components of organizational decisions. 4. Examine the cultural elements of health care organizational decisions. 5. Analyze the clinical, business operations, health informatics, economic, and financial components of organizational decisions. 6. Assess the use of current marketing trends and the use of health care information to achieve a competitive advantage. 7. Develop a strategic plan and an implementation plan to guide the delivery of new or enhanced health care-related service, support structure, or product at an institutional level. Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. Peregrine Health Care Assessment of Outbound Students Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5, 6, 7 2. Presentation Skills Assessment (Administed in MBA550, Colloquium in Health Services Administration) Program ISLOs Assessed by this Measure: 1 Assessment Instruments for Intended Student Learning Outcomes Measures of Student Learning: 1. End of Program (EoP) Survey Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5, 6, 7 Objectives (Targets/Criteria) for Measures: Mean score of 60% or higher for individual Program ISLOs for all outbound exam results in the report year. The 20 relevant CPC outbound exam subdiscipline areas are mapped out to individual Program ISLOs and scores on subdiscipline areas are averaged to obtain the Program ISLO mean score. Mean rubric score of 8.0 or higher (on a 10.0 scale) for all presentations assessed in the report year conducted in the final program capstone courses (MHA550, Colloquium in Health Services Administration). Objectives (Targets/Criteria) for Measures: Mean score of 3.0 or higher (on a 4.0 scale) for individual Program ISLOs for all EoP surveys completed in the report year. Multiple survey questions are mapped out to individual Program ISLOs and scores on questions are averaged to obtain the Program ISLO mean score. Learning Assessment Results: Master of Health Services Administration Summary of Results from Implementing Measures of Student Learning: IACBE Public Disclosure of Student Learning 22

24 1. Summary of Results for Measure 1: Peregrine Health Care Assessment of Outbound Students The assessment of direct measures of student learning through the Peregrine Health Care instrument indicates the following results for individual Program ISLOs: 1. Utilize written and oral communication skills to convey health care issues that assist colleagues, administration, patients, and the public to make informed decisions: 66.67% 2. Assess the impact of national health policies on institutional decisions: 61.92% 3. Distinguish the ethical and legal components of organizational decisions: 66.41% 4. Examine the cultural elements of health care organizational decisions: 67.56% 5. Analyze the clinical, business operations, health informatics, economic, and financial components of organizational decisions: 63.59% 6. Assess the use of current marketing trends and the use of health care information to achieve a competitive advantage: 65.29% 7. Develop a strategic plan and an implementation plan to guide the delivery of new or enhanced health care-related service, support structure, or product at an institutional level: 64.03% Students performed above established targets for all seven Program ISLOs. The individual areas where students performed especially well included relationship management (71.4%), communicating vision (70.4%), leadership skills and behavior (70.4%), and health care personnel (70.04%), which contributed to high performance on Program ISLOs 1, 3, 4, and 6. The individual areas that were collectively weaker included financial management (51.54%) and information management (52.91%). 2. Summary of Results for Measure 2: Presentation Skills Assessment (Administed in MBA550, Colloquium in Health Services Administration) The results of this assessment indicate the level of student performance at 9.78 on a scale of 10.0 for the report year. This level of performance exceeds the standard of 8.0 established by the program and is consistent with both Peregrine assessment of communication skills and indirect assessment of student learning on Program ISLO-2. Summary of Results from Implementing Measures of Student Learning: 1. Summary of Results for Measure 1: End of Program (EoP) Survey The results of students self-assessment of their achievement of the program learning outcome through the EoP Surveys, as measured on a 4.0 scale were as follows: 1. Utilize written and oral communication skills to convey health care issues that assist colleagues, administration, patients, and the public to make informed decisions: Assess the impact of national health policies on institutional decisions: Distinguish the ethical and legal components of organizational decisions: Examine the cultural elements of health care organizational decisions: Analyze the clinical, business operations, health informatics, economic, and financial components of organizational decisions: Assess the use of current marketing trends and the use of health care information to achieve a competitive advantage: 3.56 IACBE Public Disclosure of Student Learning 23