Chapter 4: Familiarising Yourself with Q-interactive Assess

Transcription

1 Chapter 4: Familiarising Yourself with Q-interactive Assess Step-by-Step Instructions January 2013 Copyright NCS Pearson, Inc. or its affiliate(s). All rights reserved. Q-interactive, WAIS-IV, WISC-IV, CVLT-II, and CVLT-C are trademarks in the U.S. and/or other countries, of Pearson Education, Inc. or its affiliates.

2 Introduction. This document walks you through Q-interactive Assess, the app that you download from itunes. You will learn about the various features within the assessment environment including: Accessing Q-interactive Assess Using the Q-interactive Assess Home Screen Understanding the various types of Subtest Screens Becoming familiar with the subtest administration components Recording and Scoring subtests Learning about the Alert Messages Resolving flagged test items Reviewing Scores, Audio Recordings and Observational Notes Transferring a completed battery to Q-interactive Central General Administration Tips. Make sure your ipad is connected to a secure Wi-Fi or 3G connection, so you can transfer your assessments from Q-interactive Central to Q-interactive Assess. Set up the testing environment in the same manner as you do for a traditional assessment session. Consider the client s ipad, the stimulus book. Maintaining Wi-Fi connectivity during an assessment is recommended, so data can be transferred and saved throughout the assessment session. Wi-Fi connectivity will drain the battery faster. It is recommended that you monitor the battery power level frequently and charge the ipad between sessions. The ipad is like a computer. Rebooting the ipad prior to each test session may help improve performance. Data will not be lost as data is constantly being saved on the Pearson server and on the ipad. For subtests that require a verbal response, the audio recording function automatically records the client s responses. You can disable the audio recording permanently under the ipad settings. See Chapter 1 for further instructions. 2

3 Accessing Q-interactive Assess. After you have sent a battery (assessment assigned to a client) to the ipad from Q-interactive Central, you will be able to access it by logging into Q-interactive Assess. Step 1: On the Clinician s ipad, tap on Assess app located on the ipad home screen. Step 2: Log into Assess by entering your Q-interactive user name and password. 3

4 The assessment batteries you send to the ipad should automatically appear under Not Started, on the left side of the screen. Use the sync button to pull down assessment batteries that have been sent while you are logged in to Q- interactive Assess. Assess Home Screen. When you first come into Assess, you will be on the Home Screen. Here you can view the status of your assessment batteries, edit the client profile, and begin/resume a battery. Starting from the top, below are a few icons you should become acquainted with prior to administering a battery: Hides the assessment battery session schedule panel Logs you out of Q-interactive Assess Indicates Bluetooth connectivity Reminds you how much battery power remains Quick access to system version information Additional icons appear at the top of the screen when you are administering an assessment battery. You will learn more about these icons 4

5 Assessment Status: On the far left you can monitor the status of all of your assessment sessions. Not Started- Assessment batteries in which no subtest has been administered. In Progress- Subtest(s) has been administered, but the full assessment battery has not been completed To Do- Assessment battery has been administered, but flagged items have not been resolved. Complete- Assessment battery has been administered and there are no unresolved items. Note: An Exclamation Point within the Test or Results tab indicates that tasks within the tab need to be resolved. Additional instructions on how to resolve incomplete tasks are provided in the Resolving Flagged Items section. Interview Tab: Once you select a client, the Interview Tab displays the client information associated with the assessment battery for the client (highlighted in blue) in the far left side. Client information highlighted in red on this screen is required and editable. Any changes made to the client profile will be automatically saved. 5

6 Test Tab: Within the Test Tab, you can begin/resume the administration of the subtests listed within the highlighted assessment battery. You can also edit the subtests included in the assessment battery. The Start button will change to Resume if you stop during an assessment session. You can tap on Resume to continue the session from where you left off. Once the assessment battery has been completed and all items have been scored, the Start button will change to Review. Subtest Screen Types. The simplicity and familiarity of Q-interactive was achieved by being consistent in the designing of the subtests. Therefore, as you administer an assessment battery within Q-interactive you will see the following types of subtest screens. Subtest Cover: This is the first screen of the assessment battery and is considered the beginning of a subtest administration. Once you advance the screen by swiping from right to left, the subtest cannot be removed from the battery list and you will be charged for the subtest. 6

7 Instruction Card: As the name implies, this screen displays the instructions for the test item. These instructions are the same and are presented in the same way as in the Administration Manuals. The blue text represents the instructions to the client. The black text provides additional administration guidance to the clinician. Capture Screen. Once you have swiped off of the Instruction Screen, you will automatically advance to the Capture Screen. Depending on the subtest, the capture screen will include various tools. In general, the capture screen shows the test item, scoring buttons, and event buttons. Contextual Events- DK: Don t Know NR: No Response P: Prompt Rotation Gap Configuration Break 7

8 Subtest Administration Components. Now that you have a general overview of the assessment environment, let s dive into the actual components of an assessment battery. Step 1: Once you have logged into Q-interactive Assess (app from ipad Home Screen), tap on the client you want to give the assessment battery to and then the Test Tab. Step 2: Tap on Start to begin the assessment battery. As you complete each subtest, the next subtest in line will automatically begin as indicated by its Cover Screen. 8

9 Global Navigation Tools: Let s first review the additional tools that are located at the top of the screen throughout the assessment session. Tool Descriptions: Wi-Fi Signal Indicator Assess Home Screen Button- At anytime you can go back home. Your battery will be saved and you can resume where you left off. Side Bar- Access subtest items, results, and flagged items Information- a condensed version of the Examiner s Manual, offering a quick overview of subtest administration and scoring for each item Discontinue- Selecting this button allows you to discontinue a subtest even if the discontinue criteria have not been met yet. Connectivity Indicator- If a red X appears within the dotted circle, this indicates loss of Wi-Fi connectivity. You may see this icon when you are in the process of syncing. Pencil icon- opens up the notepad where you can write observational notes throughout the assessments. Notes are categorised by subtest, test item, and general. Notes can be deleted or saved as images. Picture-in-Picture- For the assessments that require the client ipad, this image will be white. When you tap on it, you can see what is being displayed on the client s ipad. In Picture Completion, when a client touches the client ipad screen to respond to an item, a fingerprint will display within the Picture in Picture, indicating where the client touched. 9

10 Assessment Tools. Q-interactive Assess has a variety of tools designed to save you time. Below are images of these tools and a brief description of their functionality. Audio Recording: For subtests requiring verbal responses, you can record these responses and replay them later to verify scoring. The audio recording function is automatically turned on for CVLT -II, CVLT -C, Arithmetic, Color-Word Interference, Comprehension, Digit Span, Information, Letter-Number Sequencing, Picture Completion, Similarities, Verbal Fluency, Vocabulary, and Word Reasoning. As you advance to the Capture Screen, a red dot will display between the Speech Bubble and the subtest name, indicating the response is being recorded. If you need to deactivate the audio recording, you can turn off the recording via the App settings. Read Chapter 1 - Preparing Your ipad for Optimal Assessment Experience for how-to instructions. Timer: Some subtests are timed. For those subtests, a timer will appear on the Instruction and Capture Screens. The Clinician controls the timer. Below is a brief overview of the Timer: Total allotted time for test item Timer counts up Timer Control- Start/Stop. When time is stopped, button will read Resume. Timer counts down Elapsed time. (Timer will continue to track the time once allotted time as been reached. Time will display in red when it is within 10 seconds of the time limit.) Adjust time by tapping on the Elapsed Time. Up/Down arrows will appear. Tap on either arrow until desired time displays. 10

11 Instructions: When the Instructions icon is tapped, a pop-up message will display that contains feedback that should be provided in response to specific client behaviors (e.g., prompts, repetitions, etc.). Events Buttons: These tools are found on the far right on the Capture Screen. These buttons are used to access item-specific feedback or supplement scoring. DK- Don t Know NR- No Response P- Prompt R- Repeated Item Q- Query 11

12 Verbatim Response: In specific subtests, you may want to write the client s verbatim response even though it is being recorded. At the bottom of the screen is a Response Capture Area, where you can write the responses using a stylus. To navigate between multiple responses, use the Up/Down Arrows to view the responses. To write a string of words or responses, tap on the Return Arrow to advance to a new Response Capture Area. Note Taking: Besides capturing verbatim responses, you may want to record observations that you see throughout the assessment sessions. The notes that you used to take in the margins of a record form can now be made on your ipad. Step 1: To access the Note Pad, tap on the Pencil icon at the top of the screen. 12

13 Step 2: If you want to categorise your note (General, Subtest Level, or Item-Level) tap on the Down Arrow to the right of General and then tap on the desired category. The notes are color-coded based on the selected category. To write additional notes, touch on the Pencil with Plus Sign icon. To indicate an important note, touch the Exclamation Point icon. To delete a note, touch the trash can icon. Step 3: To view all your notes, touch on the Square within Square icon. Once you are done looking at your notes, tap on the Done icon. At the end of your assessment session you will be able to review and archive any notes taken during the session. Read Chapter 5 - Archiving and Exporting Assessment Batteries for step-by-step instructions. 13

14 Picture-in-Picture: An easy way to ensure the client is seeing the exact same test item on your ipad is to tap the Stim Viewer icon. Once you have tapped on Show Picture, touch on the Picture-in-Picture icon. A pop-up window will display on your ipad, showing you what the client sees. In addition, in such subtests like Picture Completion you as the clinician can see a client s response. When the client touches the missing piece on his/her ipad, a fingerprint where the client touched displays on the Practitioner s ipad within the Picture within Picture window. View of Practitioner s ipad View of Client s ipad Client touched the ipad. Recording & Scoring Subtest Responses on Q-interactive. As with the design of subtest screens on Q-interactive, the operation of recording and scoring on Q-interactive is very similar to how clinicians perform these functions within the traditional assessment environment. However, there are a few nuances when you digitise paper/pencil assessments, which are highlighted below for: Block Design Picture Completion Vocabulary, Similarities, Information, and Comprehension Coding, Symbol Search, and Cancellation Digit Span, Arithmetic, and Letter-Number Sequencing Matrix Reasoning, Picture Concepts, Visual Puzzles, and Figure Weights CVLT-II and CVLT-C D-KEFS Color-Word Interference D-KEFS Trail Making and Design Fluency D-KEFS Verbal Fluency Test 14

15 Block Design Record completion time using the timer on the Examiner Device. To record a correct response, select the Copy button on the Capture Screen. This will copy the correct design to the Constructed Design location. To record an incorrect response: Solid color block- double-tap a block to make it either red or white. Double tap again, to make the block the opposite color. Half red and half white block- single tap the block in appropriate corners. The corner you touch will be the red half. 15

16 To rotate the constructed design, touch the design with two fingers, one on each side, and rotate. Event Buttons located below the timer can be used to indicate: rotations, breaks in configurations, or constructions that contain gaps greater than ¼ between the blocks. Score the response using the buttons on the top of the Capture Screen. 16

17 Picture Completion Record completion time using the timer on the Examiner Device. Clients can point to the correct answer on the Client Device, which is recorded in the Picture-in-Picture Pop- Over located in the upper right hand corner of the Capture Screen. A client s verbal response can be captured using the Handwriting Capture Area at the bottom of the capture screen. Alternatively, the sample responses below each score button are organised into Picklist Buttons that can be selected to indicate that a particular response was provided. 17

18 All 0 point responses on Picture Completion require you to prompt the client to point to the correct answer. The verbatim instructions for this prompt are located in an Event Button underneath the timer, and the hand icon located on each Picklist Button is a reminder to provide the prompt. Score responses using the buttons located at the top of the Capture Screen. 18

19 Vocabulary, Similarities, Information, and Comprehension Picklist located at the bottom of each corresponding score button. Handwriting Capture Area A client s verbal response can be captured using the Handwriting Capture Area at the bottom of the Capture Screen. Alternatively, the sample responses below each score button are organised into Picklist Buttons that can be selected to indicate that a particular response was provided. Score responses using the buttons located at the top of the capture screen. Some Comprehension items require that the client provide responses belonging to two or more categories in order to receive full credit. For these items, the categories are listed below the scoring buttons, and selecting a category will display a pop-over that contains sample responses. 19

20 Coding, Symbol Search, and Cancellation These subtests use paper Response Booklets. Record completion time using the timer on the Examiner Device. Score each subtest using the scoring template. Tap on the Correct and Incorrect boxes. A Number Pad displays at the bottom of the screen to enter in the results. 20

21 Digit Span, Arithmetic, and Letter-Number Sequencing For Arithmetic, record completion time using the timer on the Examiner Device. A client s verbal response can be captured using the Handwriting Capture Area at the bottom of the Capture Screen. Correct answers are located below the scoring buttons used to score each item. 21

22 Matrix Reasoning, Picture Concepts, Visual Puzzles, and Figure Weights For Visual Puzzles and Figure Weights, record completion time using the timer on the Examiner Device. The client can touch a response on the Client Device, which is automatically displayed on the Examiner Device. Alternatively, the examiner can touch a response on the Capture Screen to record a verbal response. Note that the client can self-correct and touch more than one response, all of which are recorded on the Capture Screen. Once the intended response is clarified, the examiner can touch the unintended responses to deselect them. Score responses using the buttons located at the top of the Capture Screen. 22

23 CVLT-II and CVLT-C Responses can be recorded two ways. First, Correct Responses and Across-List Intrusions are listed alphabetically on the Capture Screen. Touching a word automatically adds it to the list and scores it as a Correct Response, Across-List Intrusion, and/or a Repetition Error (if the word already appears in the list). Second, client responses can also be recorded in the Dual Pane Handwriting Capture area at the bottom of the screen. Write one word in each box; the words will appear in the list once you begin writing in the next box. By switching between the boxes you are able to quickly and accurately record responses. Words that are written in the handwriting capture area can be scored by tapping on the word in the list, which displays a pop-over. Select CI to score a response as a Category Intrusion, NI to score it as a Non-Category Intrusion, or SI to score it as a Synonym/Subordinate Intrusion. Use the red button the first time an intrusion is made on a condition. If that error is repeated, use the orange button. Intrusions can also be recorded by selecting the CI, NI, and SI buttons below the word lists. This creates a blank scored response in the list, and the word can be filled in after administration via the pop-over. 23

24 To move a response to a different position in the list, hold down on the response until the button turns colors and drag it to the desired position. D-KEFS Color-Word Interference Record completion time using the timer on the Examiner Device. Indicate Uncorrected Errors by tapping a word one time. Indicate a Self-Corrected Error by tapping the word again. Tapping the word a third time will reset the word to its default position. 24

25 If the client does not complete a condition within the time limit, arrows can be selected to designate the client s last response. D-KEFS Trail Making and Design Fluency These subtests use paper Response Booklets. Record completion time using the timer on the Examiner Device. Score each subtest using the scoring template, and enter the number of correct responses and errors for each condition on the Capture Screen. 25

26 D-KEFS Verbal Fluency Test Record completion time using the timer on the Examiner Device. Client responses can be recorded in the Dual Pane Handwriting Capture Area at the bottom of the screen. Write one word in each box; the words will appear in the list once you begin writing in the next box. By switching between the boxes you are able to quickly and accurately record responses. Responses are automatically organised into 15-second columns based on when you begin writing in a response capture pane. To move a response to a different position in the list, hold down on the response until the button turns colors and drag it to the desired position. 26

27 To edit a response, touch the response in the list. A popover will appear, which can be used to edit the response. Responses can be scored in two ways. First, selecting the All C button at the top of each column will score every response as correct. Alternatively, you can select the response and score it as correct, a Repetition Error, or a Set Loss Error within the pop-over. Use the red Set Loss Error button the first time an error is made on a condition. If that error is repeated, use the orange Set Loss Error button. Learning about the Alert Messages. During the assessment session, your actions may prompt an alert message to display on the screen. There are various alert messages that guide you through a standard administration of each subtest. As the clinician, you can either choose to proceed with the recommended action stated within the alert message or ignore the message. 27

28 Discontinue Rule. The discontinue rule message will display if you tap on the hand icon at the top of the screen or if the client incorrectly answers a designated number of test items in a row. Option1: Test the limits by either tapping on the Test the Limits button at the bottom left corner or the X located in the top right corner. If you decide to test the limits, the system will only use items administered prior to the standardised discontinue point to calculate the subtest raw score. Option 2: Discontinue the subtest by tapping on the Discontinue button at the bottom right corner. Starting Point. Based on the age of the client, this message will alert you to where you should begin within the subtest. As the clinician you can choose to begin at the suggested item or can start the subtest at the first item. 28

29 Back to Previous Item. If you swipe left, to go back to the previous item, this message will display prompting you to confirm this action. You are asked to confirm this action because swiping back erases any data obtained from the item you are swiping FROM. Option 1: If you do not want to go back to the previous item, tap on the Cancel button. Option 2: If you want to proceed back to the previous item tap on the Previous button. Transferring Assessment Battery to Q-interactive Central. Prior to a clinician transferring a completed assessment battery to Q-interactive Central to archive or export results, he/she will need to confirm that all items are scored. Once the transfer has occurred, the assessment battery is no longer on the ipad. Please see the example below on how scoring options are displayed within Q-interactive. This example is item 13 from WAIS-IV Block Design. The allotted time for each point is displayed below the point buttons for 29

30 easy reference. You as the clinician will tap on the appropriate score based on how long it took the client to respond. For additional tips on how to score subtests, like Block Design, read the section above titled, Recording & Scoring Subtest Responses. Flagging Items. During an assessment session, there may be instances where you as the clinician may want to mark an item so that you can review and score it later. Items will be automatically flagged, if the clinician does not score the item before swiping to the next item. Tap on the Flag icon to mark an item. Once an item is flagged, the flag icon turns red. 30

31 Accessing Previously-Administered Items. After you have completed a subtest, you can access your client's responses to previous items. Step 1: Tap on the "Sidebar" to view a client s responses to each subtest administered, then tap on the subtest you want to review. For example, this clinician is viewing Item 3 of the WAIS-IV Information Subtest. Clinician tapped on Item 3, to view the item and the client s response. Step 2: Once you have reviewed the item and score, tap on Done to go back to the previous screen. 31

32 Resolving flagged test items. All flagged test items are organised together within an All To Do section so they can be accessed quickly and efficiently. All To Do can be accessed in either of two places. Option 1: There is a section at the top of the Test Sidebar pop-over labeled All To Do. Selecting that button will reveal all flagged items. Selecting the first flagged item will take you to that item s capture card, where you can begin resolving scores. Option 2: There is an All To Do button within the Results tab on the home screen, The number in the red circle indicates how many items need to be resolved. Step 1: Tap on All To Do button to view the first flagged item.. 32

33 Step 2: Resolve the item by completing the scoring. To advance to the next unresolved item, tap on the arrow above the Flag icon. Step 3: Once all unresolved items have been addressed, tap Done, and you will be taken back to the screen from which you entered All To Do. As you review unresolved items, you may want to refer to the audio recording or observational notes that you wrote during the assessment session to ensure items are scored properly 33

34 Reviewing audio recordings. As you administer certain subtests, Q-interactive automatically records a client s response. You can listen to these responses anytime once a subtest has been administered and prior to the subtest being transferred to Q-interactive Central. Step 1: To access the audio recording, tap on the Sidebar icon. From there, tap on the Subtest name and then the item you wish to review. Step 2: Tap on the speaker icon to listen to the audio recording. 34

35 Step 3: Tap the Play arrow and Done will you have finished listening and resolving the item. Reviewing Notes associated with Assessment Battery. As you resolve items, you may what to review any notes that you took during the assessment session. You may access these notes from the Result Tab. The number within the All Notes button indicates the number of notes written during the assessment session. 35

36 Reviewing Results in Assess. The Results tab displays scores at three different levels: Subtests, Composite, or Comparison. Select the respective buttons to view scores corresponding to each level. Subtest Scores. Selecting the Subtests button displays subtest scaled scores. Selecting the arrow next to a subtest name reveals the subtest raw scores, as well as arrows that expand to show item-level scores and additional measures like testing time, event buttons, etc. View of Additional Measures: 36

37 For some tests you can view whether a subtest score is a relative strength or weakness. Step 1: Select the column header titled Scaled Score and select the comparison and significance value desired for the strength and weakness analysis. Note below that subtests can also be sorted according to administration order or performance by selecting the Administration Order column header. Some subtests, such as D-KEFS Trail Making Test, do not have an overall subtest scaled score. Rather, these subtests consist of multiple conditions, each of which has a unique score. Therefore, the overall subtest score is blank. Open up the subtest to view the scaled scores associated with each individual condition. 37

38 Composite Scores. The Composites screen displays all composite and index scores for your battery. Touching the scores on the graph displays the percentile rank and confidence intervals related to a score. Selecting the arrow next to the composite name expands the screen, showing all subtests in the composite. Furthermore, selecting the Substitution and Proration icon (looks like a gear) next to a composite score allow you to prorate or substitute composites. Simply check the subtests that you want to contribute to a composite, and scores will be automatically adjusted. 38

39 Comparison Scores. Some instruments contain scores that compare performance between composite or index scores, which can be located under the Comparisons tab. The sample and significance level used for comparisons can be modified using the column header highlighted below. Transferring a completed battery to Q-interactive Central. Once you have resolved all items and have listened to the audio files from your assessment session, it is time to transfer the completed battery back to Q-interactive Central. This will allow you to save any data to your computer. 39

40 Step 1: Ensure there are no exclamation points on either the Test or Results Tab. From the Interview Tab, tap on the Transfer button and tap on Transfer in the pop-up window. Step 2: Log into Q-interactive Central, and go to the Assessment Tab to confirm that the assessment successfully transferred to Q-interactive Central. For step-by-step instructions on how to export and archive client data, read Chapter 5 of the User Guide. 40