An introduction to: Q-interactive October 2014 Jeremy Clarke Technology Consultant
Good bye paper
Changing Times
What is Q-interactive?
Q-interactive is a Comprehensive Digital Assessment Platform, where you can create custom batteries at both the instrument and subtest level. Time Saving tool that provides computeradaptive testing and real time scoring with administration accuracy and speed. Game Changer in individually-administered clinical assessments.
Q-interactive is A more effective way to do your job, work with your clients, and evolve the practice.
Q-interactive Digital platform for individually-administered tests consisting of two primary components CENTRAL: Browser-based function for generating client profiles, building test batteries, creating assessment sessions, and sharing results. ASSESS: Application that lets an examiner administer a test via two tablets connected by Bluetooth.
Distribution 1 2 3 4 Access itunes App Store to download free Q-interactive Assess app Log into app using Q-interactive ID Test Content is delivered to the device upon authentication to the Q-interactive Web Application. Data are stored securely using encryption on the ios file system System Retrieves Content based on user ID and corresponding qualifications
Q-interactive is a platform The instruments you love, delivered electronically. Create assessment session 1 5 Store long-term Send securely to ipad application 2 4 Send securely back to Central Test! 3
Q-interactive Development
Starting with Clinicians Hear Create Deliver HCD Toolkit IDEO
Your Guiding Principles Keep me (clinician) in control Let me focus on my student Don t allow technology to become a barrier Save me time Assist with proper administration Needs to feel familiar, but make it better (capture flexibility is key) Keep it simple Equivalency matters when migrating existing content
Customers Have Been With Us Throughout the Development
Goals of the 1 st Beta Trial Test Q-interactive in real world environment Identify any usability and technical concerns Determine the appropriate level of training and support needed for initial release Identify and observe Usage and Edge Case o An edge case is an example of a real life example that tests the extremes of our usual characteristics for examiner and examinee interactions and characteristics Record and address any non-identified requirements for public release
Initial Impressions This is great! I love it! This is the future of our industry. This is going to be a wonderful training tool for people to learn the instruments. Now that I have gotten used to it, testing actually takes less time overall. It took me a little while to get it, but now that I do it is so much easier than paper!
Psychometric Study Findings
Psychometric Support If a test is designed so that more than one method can be used for administration or for recording responses then the manual should clearly document the extent to which scores arising from these methods are interchangeable. If the results are not interchangeable, this fact should be reported, and guidance should be given for the interpretation of scores obtained under the various conditions or methods of administration. Standard 6.11, Standards for Educational and Psychological Testing(1999).
Equivalency Study Results All subtests meet the equivalency criterion (effect size <.20). 13 of 15 subtests meet the equivalency criterion. On Matrix Reasoning and Picture Concepts, children perform slightly better with Q-interactive (effect sizes of.27 and.21). All scores that were evaluated (free recall) meet the equivalency criterion. Results of the CVLT-II study apply, because the tasks and the digital interface are the same. All four of the subtests evaluated (Verbal Fluency, Design Fluency, Trail Making, and Color-Word Interference) meet the equivalency criterion.
Equivalency Results NEPSY/CMS Methods 20 demographically-matched pairs Test-retest method Paper-Digital Digital-Paper Scores from first administration compared to scores of second administration Results Test Effect Size CMS Dot Locations -0.16 Picture Locations -0.13 NEPSY-II Inhibition Naming Time -0.07 Inhibition Time -0.06 Switching Time -0.12 Errors -0.17 Memory for Designs Content -0.11 Spatial -0.20 Total -0.19 Picture Puzzles 0.19
Client and Data Security
Security
Q-interactive Security Need more details on Security? Please visit www.helloq.ca
Advantages of Digital
Our Work Flow - Before and After. Traditional Assessment World The World of Q-interactive Light Weight Minimal Test Components
Create & Manage Caseloads
Where are my test materials and kits?
Custom Batteries @ Your Fingertips
The timer, my client, the protocol
Writing Verbatim Responses
Block Design
Block Design
Observational Note Taking
Time to score Taking it home I m on what column?
Results
Practice Implications of Digital Transformation
Sample of Item Level Data Report
Current Assessment Library
Assessment Library
Content
Future Assessments Full Battery Full Battery Full Battery In Development
Speech & Language Assessments Full Battery Available 2015 Full Battery Available 2015 Full Battery Available 2015
Hardware Requirements Two (2) Apple Full Size ipad (ipad 2 or newer) One (1) capacitiveenabled stylus Recommended for an optimal experience: Computer with Internet Access Antiglare Screen Covers Durable Protective Cases
Let s Go Live!
Addressing Clinician Needs Manage ever-increasing caseloads Diagnose patients faster Reduce human errors Want to customize batteries Need help managing my clutter / inventory Eliminate / minimize juggling materials Remove mundane task Provide me portability
Thank You! Questions? Learn more & sign up for a FREE trial of Q- interactive at www.helloq.ca