Updates and Reminders for the System for Assessment Management (SAM)

Transcription

1 Updates and Reminders for the System for Assessment Management (SAM) University of South Florida Office of Institutional Effectiveness, Policy, and Review

2 1. The clean up button Many people first collect information for their SAM report on a separate document, and then paste the information into SAM. To make things easier, we have added a clean up button. After pasting the information needed, click the clean up button and all the format of everything in that section will be converted to a uniform font and size. Here is the Clean up Button

3 Before and After: The clean up button Before: After:

4 2. The plan complete button After you have gone in and made all the changes/imputed all the information and you are finished with the entire plan, there is a final step. When completely finished editing the plan, at the bottom of the plans page there is a button you would click to indicate the plan is ready for review

5 The Plan Complete Button Remember: After you click that the plan is complete, remember to save!

6 3. Overall review of the Plan in SAM In order to provide an brief overview of each program s progress, we have introduced a overall rating of the plan. There are five levels that rate the overall methodology of the assessments done in the plan and level of compliance with our requirements Programs will be able to see the rating each plan has received and have the opportunity update or amend missing information The rating will be visible from each person s list of available plans (the page you come to when you click academic plans )

7 Reporting Planning Cycle Element Rubric for Academic Program Assessment Quality Level Missing Data Initial Emerging Developed Highly Developed Mission May be the departmental mission Mission statement is missing A statement is present, but is not a mission, but a description of the program Mission statement is present and appropriate Program Goals Should match the Mission Statement and each should be one complete statement Undergraduate Three must be covered (Content Specific Knowledge, Communication, Critical Thinking) Graduate and Certificate No required amount/content program goals Learning Outcome Statement Should be actionable and realistic Method of Assessment Should include type of assessments, how the program is being measured, and should provide information specific to the stated measure Performance Targets Should be thought of as PROGRAM benchmarks. Indicate what numbers would indicate that the program has met their programmatic goal Assessment Results Include specific findings, including number of students included in the assessment, and any other appropriate statistical information Use of Assessment Results Should include actionable items for PROGRAM improvement Any one portion of the three required Goals are not completed (Content Specific Knowledge, Communication, Critical Thinking). No Goal present No Learning Outcome present or not revised from previous year No stated method of assessment or not revised from previous year No performance target present or targets do not correspond with methods No Assessment Results present No Use of Results present A statement is present, but not a Goal Not a learning Goal The statement is present, but not stated as a learning outcome Method is inappropriate; not connected or specific to the learning outcome; use of IDM, GO, external factors Performance targets present, but stated in terms of assignment, course, or degree completion Assessment results present, but unclear how they relate to methods Use of Results statement indicates no changes are necessary Learning Goals are listed, but not aligned with mission statement The Learning Outcome is present, but may not be an The Learning Outcome may appropriate student learning need minor revisions outcome Method is appropriate, but may need further description, including more information about rubric, raters, or context Perfomance targets are present, but may need minor clarification Assessment results present, but not specific Use of Results statement does not indicate what changes will be made based off data Goals are succinctly and clearly stated Learning Goals are listed and clearly aligned with the mission statement Method may need minor clarification The Learning Outcome is present and well-developed and clearly stated Method is clear, concise and well-defined. Meets all reporting requirements Performance targets are appropriate and well-stated Assessment results present and clear, but missing minor data (such as: number of students) Use of Results statement is present and clear; may need minor clarification Assessment results present and clear. All data reported appropriately Use of Results statement is present and clear and specifically indicates the changes that are being made

8 Overall Plan Review This is where you will find your plans rating

9 Overall Plan Rating Scale Missing Data Initial Emerging Developed Highly Developed If a plan receives a yellow or red overall rate, we will go into the plan and select that is not complete Programs will be notified and asked to make changes to sections that still need work When they have made secondary adjustments, programs will click the plan complete button

10 4. Supervisor Role A new role available in SAM. Role has the same functions as a Contributor (which most are!), including making changes to all plans assigned to that user For those who oversee plans, but do not wish to receive regular s regarding training, changes in SAM, or other day-to-day functions. If you wish to have your role changed to Supervisor, please contact our office at assessment@usf.edu

11 More Changes to Come We are listening! More changes are planned for YOUR EASE OF USE! Coming Soon: Print to PDF Ability to run reports Please keep telling us what you want to see! (Disclaimer: We can t guarantee if and when any changes might be made, but we try to make SAM the best it can be!)

12 REMINDER: SAM will kick you out of the program! There is a automatic time out component CLICK SAVE OFTEN, even it you are not done!

13 Please Contact us with Questions! The Office of Institutional Effectiveness, Academic Planning and Review Melanie Wicinski Assistant Director of Assessment (Academic and Administrative Assessment) Adrianne Bowe Slagle Assessment Specialist and Trainer