An introduction to: Q-interactive. October 2014 Jeremy Clarke Technology Consultant

Transcription

1 An introduction to: Q-interactive October 2014 Jeremy Clarke Technology Consultant

2 Good bye paper

3 Changing Times

4 What is Q-interactive?

5 Q-interactive is a Comprehensive Digital Assessment Platform, where you can create custom batteries at both the instrument and subtest level. Time Saving tool that provides computeradaptive testing and real time scoring with administration accuracy and speed. Game Changer in individually-administered clinical assessments.

6 Q-interactive is A more effective way to do your job, work with your clients, and evolve the practice.

7 Q-interactive Digital platform for individually-administered tests consisting of two primary components CENTRAL: Browser-based function for generating client profiles, building test batteries, creating assessment sessions, and sharing results. ASSESS: Application that lets an examiner administer a test via two tablets connected by Bluetooth.

8 Distribution Access itunes App Store to download free Q-interactive Assess app Log into app using Q-interactive ID Test Content is delivered to the device upon authentication to the Q-interactive Web Application. Data are stored securely using encryption on the ios file system System Retrieves Content based on user ID and corresponding qualifications

9 Q-interactive is a platform The instruments you love, delivered electronically. Create assessment session 1 5 Store long-term Send securely to ipad application 2 4 Send securely back to Central Test! 3

10 Q-interactive Development

11 Starting with Clinicians Hear Create Deliver HCD Toolkit IDEO

12 Your Guiding Principles Keep me (clinician) in control Let me focus on my student Don t allow technology to become a barrier Save me time Assist with proper administration Needs to feel familiar, but make it better (capture flexibility is key) Keep it simple Equivalency matters when migrating existing content

13 Customers Have Been With Us Throughout the Development

14 Goals of the 1 st Beta Trial Test Q-interactive in real world environment Identify any usability and technical concerns Determine the appropriate level of training and support needed for initial release Identify and observe Usage and Edge Case o An edge case is an example of a real life example that tests the extremes of our usual characteristics for examiner and examinee interactions and characteristics Record and address any non-identified requirements for public release

15 Initial Impressions This is great! I love it! This is the future of our industry. This is going to be a wonderful training tool for people to learn the instruments. Now that I have gotten used to it, testing actually takes less time overall. It took me a little while to get it, but now that I do it is so much easier than paper!

16 Psychometric Study Findings

17 Psychometric Support If a test is designed so that more than one method can be used for administration or for recording responses then the manual should clearly document the extent to which scores arising from these methods are interchangeable. If the results are not interchangeable, this fact should be reported, and guidance should be given for the interpretation of scores obtained under the various conditions or methods of administration. Standard 6.11, Standards for Educational and Psychological Testing(1999).

18 Equivalency Study Results All subtests meet the equivalency criterion (effect size <.20). 13 of 15 subtests meet the equivalency criterion. On Matrix Reasoning and Picture Concepts, children perform slightly better with Q-interactive (effect sizes of.27 and.21). All scores that were evaluated (free recall) meet the equivalency criterion. Results of the CVLT-II study apply, because the tasks and the digital interface are the same. All four of the subtests evaluated (Verbal Fluency, Design Fluency, Trail Making, and Color-Word Interference) meet the equivalency criterion.

19 Equivalency Results NEPSY/CMS Methods 20 demographically-matched pairs Test-retest method Paper-Digital Digital-Paper Scores from first administration compared to scores of second administration Results Test Effect Size CMS Dot Locations Picture Locations NEPSY-II Inhibition Naming Time Inhibition Time Switching Time Errors Memory for Designs Content Spatial Total Picture Puzzles 0.19

20 Client and Data Security

21 Security

22 Q-interactive Security Need more details on Security? Please visit

23 Advantages of Digital

24 Our Work Flow - Before and After. Traditional Assessment World The World of Q-interactive Light Weight Minimal Test Components

25

26 Create & Manage Caseloads

27 Where are my test materials and kits?

28 Custom Your Fingertips

29 The timer, my client, the protocol

30 Writing Verbatim Responses

31 Block Design

32 Block Design

33 Observational Note Taking

34 Time to score Taking it home I m on what column?

35 Results

36 Practice Implications of Digital Transformation

37 Sample of Item Level Data Report

38 Current Assessment Library

39 Assessment Library

40 Content

41 Future Assessments Full Battery Full Battery Full Battery In Development

42 Speech & Language Assessments Full Battery Available 2015 Full Battery Available 2015 Full Battery Available 2015

43 Hardware Requirements Two (2) Apple Full Size ipad (ipad 2 or newer) One (1) capacitiveenabled stylus Recommended for an optimal experience: Computer with Internet Access Antiglare Screen Covers Durable Protective Cases

44 Let s Go Live!

45 Addressing Clinician Needs Manage ever-increasing caseloads Diagnose patients faster Reduce human errors Want to customize batteries Need help managing my clutter / inventory Eliminate / minimize juggling materials Remove mundane task Provide me portability

46 Thank You! Questions? Learn more & sign up for a FREE trial of Q- interactive at