SDP TOOLKIT FOR EFFECTIVE DATA USE

Transcription

1 SDP TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES Webinar 1 TOOLKIT FOR EFFECTIVE DATA USE Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 1

2 Patty Diaz Senior Program Manager, Fellows Todd Kawakita Manager of Product Development Jared Silver Data Architect and Manager Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 2

3 1 2 SDP TOOLKIT FOR EFFECTIVE DATA USE 3 A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES 4 5 Q & A Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 3

4 MISSION Transform the use of data in education to improve student achievement. Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 4

5 Theory of Action Right People Right Decisions Right Data Right Analysis Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 5

6 I. Fellows Create and support a national network of high quality data analysts Place Fellows in partner agencies. who will influence policy at the local, state, and national levels. Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 6

7 I. Fellows Create and support a national network of high quality data analysts 2. Diagnostics Create policy- and management-relevant standardized analyses Perform Diagnostics in partner agencies. who will influence policy at the local, state, and national levels. for districts and states. Human Capital Teacher Effectiveness College-Going Success Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 7

8 I. Fellows Create and support a national network of high quality data analysts 2. Diagnostics Create policy- and management-relevant standardized analyses 3. Scale Improve the way data is used in the education sector. who will influence policy at the local, state, and national levels. for districts and states. Achieve broad impact through wide dissemination of analytic tools, methods, and best practices. Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 8

9 SDP TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES Human Capital Teacher Effectiveness College-Going Success Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 9

10 SDP TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES What is the relationship between 8 th grade test scores and college enrollment rates? College-Going Success Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 10

11 SDP TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES What is the relationship between 8 th grade test scores and college enrollment rates? College-Going Success Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 11

12 SDP TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES essential data elements check, and build variables for your datasets relevant datasets from different sources your datasets best practices to facilitate shared and replicable data analysis - Test Scores - College Enrollment - High School Graduation - Student School Enrollment Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 12

13 SDP TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES essential data elements check, and build variables for your datasets relevant datasets from different sources your datasets best practices to facilitate shared and replicable data analysis Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 13

14 SDP TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES Identify: Data Specification Guide Clean: Data Building Tasks Connect: Data Linking Guide Analyze: Diagnostic Analyses Guide Adopt: Coding Style Guide Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 14

15 SDP TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES Identify: Data Specification Guide Clean: Data Building Tasks Connect: Data Linking Guide Analyze: Diagnostic Analyses Guide Adopt: Coding Style Guide Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 15

16 SDP TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES Identify: Data Specification Guide Clean: Data Building Tasks Connect: Data Linking Guide Analyze: Diagnostic Analyses Guide Adopt: Coding Style Guide Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 16

17 Data Specification Guide Successful data analysis begins with proper identification of data elements necessary to answer key questions of interest. Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 17

18 Data Specification Guide 5 W s of Data Collection WHY WHAT WHERE WHO WHEN are we collecting data? Research questions? Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 18

19 Data Specification Guide 5 W s of Data Collection WHY WHAT WHERE WHO WHEN are we collecting data? Research questions? data is needed? Student demographics (ethnicity, gender, birth date) Teacher demographics Student learning classifications (ELL, SpEd, FRPL) Teacher experience, pay, certifications (HR data) School enrollment, attendance, and graduation Class enrollment, class grades, student/teacher links Test scores College Enrollment (NSC data) Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 19

20 Data Specification Guide 5 W s of Data Collection WHY WHAT WHERE WHO WHEN are we collecting data? Research questions? data is needed? does the data live? Student demographics (ethnicity, gender, birth date) Teacher demographics Student learning classifications (ELL, SpEd, FRPL) Teacher experience, pay, certifications (HR data) School enrollment, attendance, and graduation Class enrollment, class grades, student/teacher links Test scores College Enrollment (NSC data) Student Information System (SIS) Longitudinal Data Store (LDS) or Data Warehouse (DW) HR Systems Excel Spreadsheets or MS Access On paper! Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 20

21 Data Specification Guide 5 W s of Data Collection WHY WHAT WHERE WHO WHEN are we collecting data? Research questions? data is needed? does the data live? Owns these systems and is responsible for delivering the data? Student demographics (ethnicity, gender, birth date) Teacher demographics Student learning classifications (ELL, SpEd, FRPL) Teacher experience, pay, certifications (HR data) School enrollment, attendance, and graduation Class enrollment, class grades, student/teacher links Test scores College Enrollment (NSC data) Student Information System (SIS) Longitudinal Data Store (LDS) or Data Warehouse (DW) HR Systems Excel Spreadsheets or MS Access On paper! Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 21

22 Data Specification Guide 5 W s of Data Collection WHY WHAT WHERE WHO WHEN are we collecting data? Research questions? data is needed? Student demographics (ethnicity, gender, birth date) Teacher demographics Student learning classifications (ELL, SpEd, FRPL) Teacher experience, pay, certifications (HR data) School enrollment, attendance, and graduation Class enrollment, class grades, student/teacher links Test scores College Enrollment (NSC data) does the data live? Student Information System (SIS) Longitudinal Data Store (LDS) or Data Warehouse (DW) HR Systems Excel Spreadsheets or MS Access On paper! Owns these systems and is responsible for delivering the data? (over what date range/school years) do we need data for, in case of a longitudinal analysis? Reliability of historical data elements? Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 22

23 Data Specification Guide 5 W s of Data Collection WHY WHAT WHERE WHO WHEN are we collecting data? Research questions? data is needed? Student demographics (ethnicity, gender, birth date) Teacher demographics Student learning classifications (ELL, SpEd, FRPL) Teacher experience, pay, certifications (HR data) School enrollment, attendance, and graduation Class enrollment, class grades, student/teacher links Test scores College Enrollment (NSC data) does the data live? Student Information System (SIS) Longitudinal Data Store (LDS) or Data Warehouse (DW) HR Systems Excel Spreadsheets or MS Access On paper! Owns these systems and is responsible for delivering the data? (over what date range/school years) do we need data for, in case of a longitudinal analysis? Reliability of historical data elements? HOW should the data Thursday, January 26, 2012 appear? Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 23

24 Identifies uniqueness of observations in each file to avoid data duplication (double counting) Standardizes encoded values for certain data points for consistency (i.e. ethnicity, subject matter) Importance listed for each data element Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 24

25 Broad range of data points covers many research questions, many data points common to different analyses Structured in a way that facilitates analyses and similar to many existing data systems Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 25

26 Data Specification Guide Specification meant to be a format to extract research data files to, not as a stand alone database structure May need to merge data across data stores to reach final layout Software o ETL: MS SSIS, Oracle WB, Informatica, DataStage o Reporting: Cognos, Crystal Reports, Oracle BI o Statistical: Stata, SAS, SPSS Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 26

27 Coding Style Guide To ensure that statistical code is easily shared across a team and is replicable by future users, SDP and the Center for Education Policy Research (CEPR) recommends that you follow best coding, programming, and data management practices. Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 27

28 Coding Style Guide Coding Style Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 28

29 Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 29

30 Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 30

31 Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 31

32 Coding Style Guide 27 changes 4 changes Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 32

33 Coding Style Guide Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 33

34 Q & A Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 34

35 SDP TOOLKIT FOR EFFECTIVE DATA USE A GUIDE FOR CONDUCTING DATA ANALYSIS IN EDUCATION AGENCIES Will Be Released Prior to Webinar On: Thursday, February 2 Thursday, February 9 Thursday, February 16 Identify: Data Specification Guide Clean: Data Building Tasks Connect: Data Linking Guide Analyze: Diagnostic Analyses Guide Adopt: Coding Style Guide Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 35

36 Thank You The toolkit is currently in BETA. Please send us your feedback at goo.gl/aavdf. Check for the most recent toolkit version. Please contact us at if you have any questions about the toolkit. Thursday, January 26, 2012 Webinar1 TOOLKIT FOR EFFECTIVE DATA USE 36