CONSTRUCT RELIABILITY OF INFORMATION AND COMMUNICATION TECHNOLOGY ACCEPTANCE

CONSTRUCT RELIABILITY OF INFORMATION AND COMMUNICATION TECHNOLOGY ACCEPTANCE Rinaldi 1, Deni Wahyuni 2, Mohd. Isa Hamzah 3 and Norazah Mohd Nordin 4 1 Politeknik Negeri Padang, Kampus Limau Manis, Padang, Sumatera Barat 251632, r.rinaldi@ymail.com 2 Politeknik Negeri Padang, Kampus Limau Manis, Padang, Sumatera Barat 251632, deniwahyuni@gmail.com 3 Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia,isa_hamzah@ukm.edu.my 4 Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia, drnmn@ukm.edu.my ABSTRACT Construct reliability is an important step as preliminary study that refers to the stability and consistency of the instrument toward a concept. It provides early information before the actual study is conducted to identify acceptance of Information and Communication Technology (ICT) among higher education institution students. Thus, this study was conducted to determine the construct reliability of acceptance of ICT among higher education institution students. It was adoption from instrumen of UTAUT II that consists of 8 constructs (performance expectancy, effort expectancy, social influence, facilitating condition, hedonic motivation, fair price, habit and behavioral intention). The instrument was one set questionnaire that consist 8 construct using five point Likert scale. Sampling was purposive that focus on first year and last year student of education faculty as respondent. Data collected and analyzed by Statistical Package for the Social Science (SPSS 22.0) software. Construct reliability refered to alpha cronbach value (α) that should be more than 0.70. Finding showed that alpha cronbach (α) for each construct performance expectancy (α=0.898), effort expectancy (α=0.738), social influence (α=0.881), facilitating condition (α=0.869), hedonic motivation (α=0.835), fair price (α=0.806), habit (α=0.768) and behavioral intention (α=0.819) were more than 0.7. It showed each construct has high reliability. Thus, all items in questionaire were reliabled to identify acceptance of Information and Communication Technology (ICT) among higher education institution students accurately. Keywords: construct reliability, ICT acceptance, measurement tools, alpha cronbach, item consistency INTRODUCTION Study on ICT acceptance among higher education institutions students has developed year by year (Gastelu et al., 2015). One of theory that covers the ICT acceptance and comprehensive theory that combines 8 theories and models in examining acceptance of ICT is UTAUT II. It is observed from eight constructs i.e performance expectancy, effort expectancy, social influence, facilitating condition, hedonic motivation, price value, habit and behavioral intention. We adopt constructs and definitions from UTAUT II by Venkatesh et al. (2012). Performance expectancy is defined as the degree to which using a technology will provide benefits to consumers in performing certain activities. Effort expectancy is the degree of ease associated with consumers use of technology. Social influence is the extent to which consumers perceive that important others (e.g., family and friends) believe they should use a particular technology. Then, Brown and Venkatesh (2005) stated that facilitating conditions refer to consumers perceptions of the resources and support available to perform a behavior to use ICT. Hedonic motivation, conceptually as perceive enjoyment is defined as the fun or pleasure addressed from using a ICT. It is one of important role in determining technology acceptance and use, recently as stated by Thong et al. (2006). Price value is defined as consumers cognitive tradeoff between the perceived benefits of the applications and the monetary cost for using them. The price value is positive when the benefits of using a technology are perceived to be greater than the monetary cost and such price value has a positive impact on intention. Habit has two ways definition. In first way, habit refers to behaviour and second way habit is defined as the extent to which an individual believes the behavior to be automatically because of learning. However, prior to identify the ICT acceptance, preliminary study that identify construct reliability need to be addresed. Construct reliability is one of critical step in preliminary study that to identify the consistency and reliability of a instrument that using questionnaire. The various measurements will ultimately require measurement tools through which the values will be captured (Kember & Leung, 2008). One of the most common tasks often encountered in social science research is ascertaining reliability of a measurement tool. Reliability comes to the forefront when variables developed from summated scales are used as predictor components in objective models (Wong et al., 2012). Since summated scales are an assembly of interrelated items designed to measure underlying constructs, it is very important to know whether the same set of items would elicit the same responses if the same questions are recast and re-administered to the same respondents. Variables derived from test instruments are declared to be reliable only when they provide stable and reliable responses over a repeated administration of the test. The researchers always wish to know if the measurement tool employed actually measures the intended research concept or construct (is it valid? or true measures?) or if the measurement tools used to quantify the variables provide stable or consistent responses (is it reliable? or repeatable?). As simple as this may seems, it is often omitted or just mentioned passively in the research proposal or report (Drost, 2011). Reliability refers to the degree to which the results obtained by a measurement and procedure can be replicated. It importantly contributes to the validity of a questionnaire, it is however 136

not a sufficient condition for the validity of a questionnaire. Lack of reliability may arise from divergence between observers or instruments of measurement such as a questionnaire or instability of the attribute being measured that will invariably affect the validity of such questionnaire. In this study, reliability is determined by using alpha cronbach. It was developed by Lee Cronbach in 1951 (Cronbach, 1951) to provide a measure of the internal consistency of a test or scale. It is expressed as a number between 0 and 1. Internal consistency describes the extent to which all the items in a test measure the same concept or construct and hence it is connected to the inter-relatedness of the items within the test. Internal consistency should be determined before a test can be employed for research or examination purposes to ensure validity. Preliminary study is a small study prior to main study. It is conducted in order to identify questionnaire items obtained the objectives (Gall et al., 2005). It guides researchers to get early informations about items in construct either good items or bad items that can influence to data accuracy (Chua Yan Piaw, 2006). Thus, this study is conducted to identify the construct reliability of Information and Communication Technology acceptance. METHOD Sampling design adopted in this study was purposive sampling that only Islamic higher education institution students joined as respondents. This sampling is choosen because the main study is to determine acceptance of Information and Communication Technology (ICT) among Islamic higher education institution students. Reliability can be established using a pilot test by collecting data from 30 subjects not included in the sample as stated by Chua Yan Piaw (2006). In this study 30 students were involved as respondents that enrolled in Islamic university in Padang, West Sumatera, Indonesia. This study is conducted by using questionnaire as instrument. A questionnaire is adopted from Unified Theory of Acceptance and Use of Technology II (UTAUT II) that performed by Venkatesh et al. (2012). It contains 9 parts (Part A, Part B, Part C, Part D, Part E, Part F, Part G, Part H and Part I). Part A is to identify profile of respondents. Part B is to examine the level of acceptance based performance expectancy. Part C is to examine the level of acceptance based effort expectancy, Part D is to examine the level of acceptance based social influence, Part E is to examine the level of acceptance based facilitating condition, Part F is to examine the level of acceptance based hedonic motivation, Part G is to examine the level of acceptance based habit, Part H is to examine the level of acceptance based the behavioral intention and Part I is to examine the level of acceptance based price value. All of the items were a 5-point Likert type scale of 5=strongly agree, 4=agree, 3= neither agree nor disagree, 2=disagree, 1=strongly disagree. Data gathered were processed and analyzed using software the Statistical Package for the Social Sciences 22.0 (SPSS version 22). Construct reliability is showed by alpha cronbach. Alpha Cronbach determines the internal consistency or average correlation of items in a survey instrument to gauge its reliability. It is choosen to analysed the reliability using alpha cronbach due to Alpha Cronbach isthe most common measure of internal consistency (reliability). It is most commonly used when you have multiple Likert questions in a survey/questionnaire that form a scale and you wish to determine if the scale is reliable (Streiner, 2003; Wongpakaran et al., 2011). In this study, good item or item with accepted reliability has alpha cronbach more than 0.70. It refers to Brymen & Cramer (2005) as following: Table 1. Construct reliability based on alpha cronbach Alpha cronbach Reliability 0.90 1.00 Extremelly high 0.70 0.89 High 0.30-0.69 Moderate 0.00 0.30 Low 137

RESULTS AND DISCUSSION Reliability results as shown in alpha cronbach value for each construct as following Table 2. Table 2. Alpha cronbach each construct Construct Item Alpha cronbach Reliability Performance Expectancy I find mobile Internet useful in my daily life 0.898 high (3 items) Using mobile Internet helps me accomplish things more quickly Using mobile Internet increases my productivity. Effort Expectancy Learning how to use mobile Internet is easy for me 0.738 high (4 items) My interaction with mobile Internet is clear and understandable I find mobile Internet easy to use It is easy for me to become skillful at using mobile Internet Social Influence (3 items) People who are important to me think that I should use mobile Internet. People who influence my behavior think that I should use mobile Internet People whose opinions that I value prefer that I use mobile Internet. 0.881 high Facilitating Condition I have the resources necessary to use mobile Internet 0.869 high (4 items) I have the knowledge necessary to use mobile Internet Mobile Internet is compatible with other technologies I use I can get help from others when I have difficulties using mobile Hedonic Motivation Using mobile Internet is fun 0.835 high (3 items) Using mobile Internet is enjoyable Using mobile Internet is very entertaining Price Value Mobile Internet is reasonably priced 0.806 high (3 items) Mobile Internet is a good value for the money At the current price, mobile Internet provides a good value Habit The use of mobile Internet has become a habit for me 0.768 high (3 items) I am addicted to using mobile Internet. I must use mobile Internet Behavioral Intention I intend to continue using mobile Internet in the future 0.819 high (3 items) I will always try to use mobile Internet in my daily life I plan to continue to use mobile Internet frequently Results showed that construct performance expectancy consists of 3 items has alpha cronbach 0.898. It is high reliability. Limayem and Hirt (2003) were also obtained high reliability for this construct. Thus, these items, I find mobile Internet useful in my daily life, using mobile Internet helps me accomplish things more quickly and using mobile internet increases my productivity can be consistency used to identify acceptance of ICT from performance expectancy aspect. 138

Further, next construct, effort expectancy that consists of 4 items has alpha cronbach 0.738. It is high reliability. Gupta et al. (2008) were also obtained high reliability for this construct. Thus, these items, learning how to use mobile internet is easy for me, my interaction with mobile internet is clear and understandable, I find mobile internet easy to use and it is easy for me to become skillful at using mobile internet can be consistency used to identify acceptance of ICT from effort expectancy aspect. Table 2 also showed that construct social influence that consists of 3 items has alpha cronbach 0.881. It is high reliability. Thong et al. (2006) were also obtained high reliability for this construct. Thus, these items, people who are important to me think that I should use mobile internet, people who influence my behavior think that I should use, mobile internet and people whose opinions that I value prefer that I use mobile internet can be consistency used to identify acceptance of ICT from social influence aspect. High reliability was also obtained by facilitating condition construct (4 items). It showed by its alpha cronbach, 0.869. It was the same result as Gastelu et al. (2015) that reported that facilitating condition construct has high reliability. Thus, these items that consist of I have the resources necessary to use mobile internet, I have the knowledge necessary to use mobile internet, mobile internet is compatible with other technologies I use and I can get help from others when I have difficulties using mobile can be consistency used to identify acceptance of ICT from facilitating condition aspect. For the construct hedonic motivation was also has high reliability as shown by its alpha cronbach of 0.835. Hedonic motivation as one of important aspect in using ICT as reported by Venkatesh et al. (2012). The items that involved to measure the construct were using mobile internet is fun, using mobile internet is enjoyable and using mobile internet is very entertaining. Table 2 also showed that construct price value (3 items) obtained alpha cronbach 0.806. It is high reliability. Gupta et al. (2008) were also reported that these items consistency in measuring acceptance if ICT in the term of price value. Three items are mobile internet is reasonably priced, mobile internet is a good value for the money at the current price and mobile internet provides a good value. Other constructs, habit and behavioral intention also obtained high reliability with alpha cronbach 0.768 and 0.819, respectively. To identify acceptance of ICT based on habit, items that involved were the use of mobile internet has become a habit for me, I am addicted to using mobile internet and I must use mobile internet. Then, for identifiying behavioral intention aspect, items that involved were I intend to continue using mobile Internet in the future, I will always try to use mobile Internet in my daily life and I plan to continue to use mobile Internet frequently. CONCLUSION This paper has demonstrated the procedure for determining the reliability of questionnaire as instrument. It emphasized that reliability tests are especially important when derivative variables are intended to be used for subsequent predictive analyses. If the scale shows poor reliability, then individual items within the scale must be re-examined and modified or completely changed as needed. However, in this study reported that each construct obtained alpha cronbach more than 0.7. It showed that each construct has high reliability in identifiying the ICT acceptance among higher education institution students. It means that this instrument can be used in main study on acceptance of Information and Communication Technology (ICT) among higher education institution students based Unified Theory of Acceptance and Use of Technology II (UTAUT II). Thus, this construct can be utilized in main study. REFERENCES Brown, S.A. & Venkatesh, V. (2005). Model of adoption of technology in the household: a baseline model test and extension incorporating household life cycle. MIS Quarterly 29 (4), 399-426. Brymen, J. & Cramer, D. (2005). Quantitative Data Analysis with SPSS 12 and 13: A Guide for Social Scientist. Hove: Routledge. Chua Yan Piaw. (2006). Kaedah dan Statistik Penyelidikan. Malaysia: Mc.Graw Hill Sdn Bhd. Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika 16, 297-334. Drost E.A. (2011). Validity and reliability in social science research. Education Research & Perspective 38, 105-23. Gall, J.P., Gall, M.D. & Borg, W.R. (2005). Applying Educational Research a Practical Guide. Boston: Allyn and Bacon. Gastelu, C.A.T., Kiss, G. & Dominguez, A.L. (2015). Level of ICT competencies at the university. Procedia-Social and Behavioral Sciences 174, 137-142. Gupta, B., Dasgupta, S. & Gupta, A. (2008). Adoption of ICT in a government organization in a developing country: An empirical study. Journal of Strategic Information Systems 17 (2), 140-154. Kember, D. & Leung, D.Y. (2008). Establishing the validity and reliability of course evaluation questionnaires. Assessment & Evaluation in Higher Education 33, 341-53. Limayem, M. & Hirt, S.G. (2003). Force of habit and information systems usage: Theory and initial validation. Journal of the AIS 4 (1), 65-97. Streiner, D. (2003). Starting at the beginning: an introduction to coefficient alpha and internal consistency. Journal of personality assessment 80, 99-103. Thong, J.Y.L., Hong, S.J. & Tam, K.Y. (2006). The effects of post-adoption beliefs on the expectation confirmation model for information technology continuance. International Journal of Human-Computer Studies 64 (9), 799-810. Venkatesh, V., Thong, J.Y.L. & Xu, X. (2012). Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology. MIS Quarterly 36, 157-178. 139

Wongpakaran, T., Wongpakaran, N. & Wannarit, K. (2011). Validity and reliability of the Thai version of the experiences of close relationships-revised questionnaire. Singapore Medical Journal 52, 100 106. 140