EFFECTIVENESS OF PERFORMANCE APPRAISAL: ITS OUTCOMES AND DETRIMENTS IN PAKISTANI ORGANIZATIONS

323 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ EFFECTIVENESS OF PERFORMANCE APPRAISAL: ITS OUTCOMES AND DETRIMENTS IN PAKISTANI ORGANIZATIONS Hafiz Muhammad Ishaq * Dr. Muhammad Zahid Iqbal ** Arshad Zaheer *** Introduction Effectiveness of performance appraisal has so far been studied in different contexts. However, exploring important areas like outcomes of effectiveness of performance appraisal and identification of factors that can make harm to the effectiveness of performance appraisal in perspective of Pakistani organizations was needed. Therefore, the researchers set objectives of this paper to study the outcomes of effectiveness of performance appraisal and to find key detriments to effectiveness of performance appraisal in Pakistani organizations. This paper aims at answering the following research questions: 1. What are outcomes of effective performance appraisal in Pakistani organizations? 2. What are the factors that can harm effectiveness of performance appraisal in Pakistani organizations? Literature Review Published literature concerning outcomes and detriments of effectiveness of performance appraisal are discussed separately as under: Outcomes of Effective Performance Appraisal Common outcomes of an effective performance appraisal process are employees learning about themselves, employees knowledge about how they are doing, employees learning about what management values (Beer, 1981). According to Stephan and Dorfman (1989) outcomes of effective performance appraisal are improvement in the accuracy of employee performance and establishing relationship between performance on tasks and a clear potential for reward. Dobbins, Cardy and Platz-Vieno (1990) told five outcomes i.e. use of evaluations as feedback to improve performance, reduced employee turnover, increased motivation, existence of feelings of equity among employees, linkage between performance and rewards. Nurse (2005) viewed provision of information for the development of managerial strategies for training and development as an outcome. Teratanavat, Raitano and Kleiner (2006) found outcomes like reduced employee stress, review of overall progress, linkage between current performance and employee s goals, and development of specific action plans for future. Detriments to Effectiveness of Performance Appraisal Literature uncovered following aspects that can make harm to the effectiveness of performance appraisal: exemptions to the highly visible employees, conduct of performance * The author is pursuing his Ph.D in Human Resource Management. He is an Assistant Professor at Federal Urdu University of Arts, Science and Technology, Islamabad, Pakistan ishaq74nk@yahoo.com ** The author is an educationist and currently working at Allama Iqbal Open University as Assistant Regional Director. He received his Ph.D in Human Resource Development from National University of Modern Languages Islamabad. Contact: mzahid75@yahoo.com *** The author is pursuing his Ph.D in Management Science from Foundation University, Rawalpindi, Pakistan arshad_zz@yahoo.com

324 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ appraisal to punish the low performers, rewards on nonperformance, doubts in the mind of performers about appraisal s after effects, organization s politics that leads to disturb performance of targeted employee (Deluca, 1993); use of fundamentally flawed appraisals, focus on encouraging individual, which automatically discourages teamwork/collaboration, inconsistencies in setting and applying appraisal criteria, focus on extremes (exceptionally good or poor performance), appraisal s focus on achievement of short-term goals, support to autocrat supervisors, subjectivity of appraisal results and creation of emotional anguish in employees (Segal, 2000); use of vague qualities and irrelevant measurement criteria, use of useless checklists for evaluation, monologues instead of dialogues in feedback sessions, reluctance of appraisers to offer feedback, supervisor s misguidance to appraiser (Nurse, 2005); inaccuracies at supervisor/organization s end (Horvath & Andrews, 2007). Procedure and Measures The researchers designed a survey questionnaire for managers and operatives working with public and private sector organizations of Pakistan. As suggested by Fink (1995b), only purposeful statements based upon research objective and hypotheses were included. All questions were closed to elicit standardized response. Medium of communication was English with focus on use of conventional language. Wording of survey questions/statements was kept simple and unbiased (McClelland, 1993) and questions of trivial nature were avoided (McClelland, 1994). Instructions/legends were also given at the start of every set of questions having same format (Cooper & Emory, 1995). For expeditious response, survey questionnaires were administered through referrals. The researchers maximized accuracy in the test scores by applying measurement scaling carefully. The research design of the study used five-point Likert scale for all survey questions (Fink, 1995a). Nominal scales were also used for few personal information questions. The researchers focused mainly on inferential statistics with the purpose to test the hypotheses, but for description of facts found in data, tools of descriptive statistics were also used. Data were prepared for application of statistical treatments for further descriptive and confirmatory analyses. Three hypotheses were developed and tested to find as to whether they had answered the research questions. Two independent samples t-tests were performed to analyze difference between mean values of two groups in the respective data set. Hypotheses were: H 1 : There is a significant difference of opinion between managers/employees working with public and private sector organizations regarding (a) outcomes of effective performance appraisal and (b) detriments to effectiveness of performance appraisal. H 2 : There is a significant difference of opinion between managers and employees working with public/private sector organizations regarding (a) outcomes of effective performance appraisal and (b) detriments to effectiveness of performance appraisal. H 3 : There is a significant difference of opinion between male and female managers/employees working with public/private sector organizations regarding (a) outcomes of effective performance appraisal and (b) detriments to effectiveness of performance appraisal. Respondents Characteristics Managers who appraised performance and employees whose performance was appraised in Pakistani public and private sector organizations were considered as elements of population for the study. The researchers contacted some 300 managers/employees working with public and private sector organizations of Pakistan through survey questionnaires. Overall response of survey questionnaires, ready for further analysis, was 42%. The researchers gave due importance to the

325 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ issue of blank responses and straightaway excluded the questionnaires having less than 75% responses as suggested by Sekaran (2003). Before application of statistical treatments on data, it was analyzed that average response of survey questions was 99%. Minimum response to survey questions in a questionnaire was 95% whereas maximum response was 100%. In addition, table 1 displays aggregate profile of the respondents. Table 1 Respondents Characteristics Selected Dimensions % n Age 20 to 29 years 77.08 88 30 to 39 years 15.04 17 40 to 52 years 07.08 08 Gender Male 78.2 97 Female 21.8 27 Education Masters or above 31.6 36 Graduation 68.4 78 Experience Less than 1 year 34.0 34 1 to 3 years 38.0 38 4 to 7 years 17.0 17 8 years or above 11.0 11 Job Position Managerial/Officer 66.7 76 Employee/Operative 33.3 38 Type of Organization Pubic Sector Organization 50.0 57 Business/Private Sector Organization 45.6 52 Own Business 4.4 5

326 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ Instrument s Reliability Inter-item reliability coefficient i.e. Cronbach s alpha for overall questionnaire (33 items) was 0.869. Thus, Cronbach s alphas for outcomes (14 items) and detriments (19 items) of effectiveness of performance appraisal were 0.813 and 0.904 respectively. To delete an item from questionnaire, Cronbach s alphas ranged between 0.790 0.826 for outcomes and 0.896 0.904 for detriments, which were good enough for further statistical analyses (Sekaran, 2003). Therefore no item was eliminated. Data Reduction Factor Analysis Factor analysis was applied to reduce data. Table 2 shows that overall no variable was eliminated. Thus, for 33 items of two variables of outcomes and detriments of effectiveness of performance appraisal, a total of 9 iterations were performed for communalities and rotated components matrices. The number of eliminated items came to 19. Therefore, 14 items with higher factor loadings carried forward for further statistical analysis. The coefficients of Kaiser-Meyer- Olkin (KMO) against all latent variables were more than 0.50 (i.e. Minimum = 0.715 and Maximum = 0.759). Bartlett s Coefficient against all latent variables was found significant at p = 0.01.

327 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ Table 2 Summary of Factor Analysis and Tests of Assumptions for Factor Analysis Kaiser-Meyer-Olkin (KMO) and Bartlett s Coefficients Variables Total Items Items Eliminated Total (C a, RM b ) Items Remaining Iterations Total (C a, RM b ) KMO c Bartlett d χ 2 df Sig. Outcomes of Effective PA 14 8 6 4 0.715 164.096 15 0.000* Detriments to Effectiveness of PA 19 11 8 5 0.759 225.833 28 0.000* Total 33 19 14 9 a C = Communalities b RM = Rotation Matrix c KMO = Kaiser-Meyer-Olkin Measure of Sampling Adequacy d Bartlett s Test of Sphericity * p < 0.01

328 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ The factors having higher loads existed in the variables of outcomes and detriments of effectiveness of performance appraisal. Table 3 shows that these variables have 14 items with higher loads based on communalities and rotated component matrices. The estimates of the variance in each item accounted for by the components in the factor solution were above 0.50. According to rotation sums of squared loadings, component/s collectively explained more than 60% of the variance. Regarding variable of outcomes of effectiveness of performance appraisal, items eliminated were Employees learning about themselves, Establishment of relationship between performance and reward, Use of evaluations as feedback to improve performance, Existence of feelings of equity among employees, Development of managerial strategies for training, Reduced employee stress, Review of overall progress and Development of specific action plans for future. For variable of detriments to effectiveness of performance appraisal, items eliminated were Exemptions to the highly visible employees, Conduct of performance appraisal to punish the low performers, Use of fundamentally flawed appraisals, Focus on encouragement of individual instead of teamwork, Focus on extremes (exceptionally good or poor performance), Support to autocrat (dictator type) supervisors, Use of vague qualities and irrelevant measurement criteria, Use of useless checklists for evaluation, Monologues instead of dialogues in feedback sessions, Supervisor s misguidance to rater and Inaccuracies at supervisor/organization s end.

329 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ Table 3 Factor Loadings Outcomes and Detriments of Effectiveness of Performance Appraisal Dominating Administrative Purposes and Uses a Extraction b Component c Rotation Sums 1 2 3 of Squared Loadings Cumulative % Outcomes of Effective PA Employees knowledge about how they are doing 0.706 0.831 63.050 Improvement in the accuracy of employee performance 0.669 0.809 Linkage between current performance and employee's goals 0.505 0.702 Employees learning about what management values 0.559 0.642 Reduced employee turnover 0.757 0.861 Increased motivation 0.587 0.704 Detriments to Effectiveness of PA Organizational politics that disturb performance of targeted employees 0.753 0.851 67.096 Doubts in the mind of performers about appraisal's after effects 0.632 0.746 Rewards on nonperformance 0.557 0.685 Creation of emotional anguish in employees 0.757 0.855

330 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ Reluctance of raters to offer feedback 0.699 0.773 Appraisal's focus on achievement of short term goals 0.746 0.827 Subjectivity of appraisal results 0.616 0.619 Inconsistencies in setting and applying appraisal criteria 0.608 0.615 a Initial Value of all items is 1.000 b Extraction Method: Principal Component Analysis c Rotation Method: Varimax with Kaiser Normalization

331 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ RESULTS AND DİSCUSSİON Table 4 Means and Standard Deviations Variables M SD Outcomes of Effective PA 4.04 0.553 Employees knowledge about how they are doing 4.26 0.799 Improvement in the accuracy of employee performance 4.06 0.868 Linkage between current performance and employee's goals 4.00 0.909 Employees learning about what management values 4.00 0.882 Reduced employee turnover 3.60 1.037 Increased motivation 4.27 0.784 Detriments to Effectiveness of PA 3.60 0.649 Organizational politics that disturb performance of targeted employees 3.70 1.150 Doubts in the mind of performers about appraisal's after effects 3.69 0.983 Rewards on nonperformance 3.29 1.238 Creation of emotional anguish in employees 3.49 1.029 Reluctance of raters to offer feedback 3.45 0.966 Appraisal's focus on achievement of short term goals 3.74 1.044 Subjectivity of appraisal results 3.65 0.929 Inconsistencies in setting and applying appraisal criteria 3.60 1.063 Table 4 shows that minimum M was 3.29 against rewards on nonperformance (item studied under variable of detriments to effectiveness of performance appraisal). Maximum M was 4.27 against increased motivation (item studied under variable of outcomes of effectiveness performance appraisal). Thus, overall mean scores and relative standard deviations revealed respondents strong and general agreement to the outcomes and detriments of PA effectiveness respectively. Table 5 displays the results of two independent samples t statistic, applied to test the hypotheses 1, 2 and 3. The average perceptions of managers/employees of public and private

332 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ sector organizations of Pakistan were same in respect of variables of outcomes and detriments of effectiveness of performance appraisal. Results related to hypothesis 2, revealed that average perceptions of managers/officers and employees/operatives of public/private sector organizations of Pakistan were same in respect of outcomes but different in case of detriments of effectiveness of performance appraisal. Results of third hypothesis revealed that average perceptions of male and female managers/employees of public/private sector organizations of Pakistan were different in respect of outcomes but same regarding detriments of effectives of performance appraisal. These results overall support literature for outcomes of effectiveness of performance appraisal while corresponding with the previous studies (e.g. Beer, 1981; Stephan & Dorfman, 1989; Dobbins, Cardy & Platz-Vieno, 1990; Nurse, 2005; Teratanavat, Raitano & Kleiner, 2006) and also support literature (see Deluca, 1993; Segal, 2000; Nurse, 2005; Horvath & Andrews, 2007) while studying factors that can make harm to the effectiveness of performance appraisal. Conclusions Conclusions substantiated the research objectives while answering the research questions that Pakistani public and private sector organizations do believe in the role of outcomes and detriments for effectiveness of performance appraisal. The respondents are more aware about outcomes of effective performance appraisal than factors that can make harm to the effectiveness of performance appraisal. As regards detriments to PA effectiveness, Managers have different view from employees. Likewise, regarding outcomes of PA effectiveness, male and female managers/operatives have different views.

333 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ Table 5 Two Independent Samples t Table on Comparison between Mean Perceptions of Male and Female, Managers and Operatives of Public and Private Sector Pakistani Organizations Regarding Measurement, Outcomes and Detriments of Effectiveness of Performance Appraisal Variables Two independent samples t Sector-wise (Public-Private) Position-wise (Manager-Operative) Gender-wise (Male-Female) t df Sig. t df Sig. t df Sig. Outcomes of Effective PA 0.574 95.41 0.567-0.020 66.66 0.984-2.826 65.28 0.006* Detriments to Effectiveness of PA 0.191 98 0.849 2.062 79.25 0.043* 1.222 37.59 0.229 *p < 0.05 (two tailed)

334 II. ULUSLARARASI SOSYAL BİLİMCİLER KONGRESİ REFERENCES Beer, M. (1981, Winter). Performance appraisal: dilemmas and possibilities. Organizational Dynamics, 9(3), 24 36. Retrieved August 24, 2007, from Business Source Premier Database, http://search.epnet.com Cooper, D. R., & Emory, C. W. (1995). Business research methods (5 th ed.). Irwin, USA: Mc-Graw Hills Companies Inc. Deluca, M. J. (1993). Handbook of compensation management. Englewood Cliffs: Prentice Hall. Dobbins, G. H., Cardy, R. L., & Platz-Vieno, S. J. (1990, September). A contingency approach to appraisal satisfaction: an initial investigation of the joint effects of organizational variables and appraisal characteristics. Journal of Management, 16(3), 619 632. Retrieved August 21, 2007, from Business Source Premier Database, http://search.epnet.com Fink, A. (1995a). How to analyze survey data. London: Sage Publications. Fink, A. (1995b). How to ask survey questions. London: Sage Publications. Horvath, M., & Andrews, S. (2007, March). The Role of Fairness Perceptions and Accountability Attributions in Predicting Reactions to Organizational Events. Journal of Psychology, 141(2), 203-222. Retrieved July 26, 2007, from Academic Search Premier Database, http://search.epnet.com McClelland, S. B. (1993, July/August). A systematic approach to determining productivity improvement training needs. Industrial Management, 35(4), 15 18. Retrieved May 04, 2005, from Business Source Premier database, http://search.epnet.com McClelland, S. B. (1994). Training needs assessment data-gathering methods: Part 2, individual interviews. Journal of European Industrial Training, 18(2), 27 31. Retrieved May 04, 2005, from Business Source Premier database, http://search.epnet.com Nurse, L. (2005, July). Performance appraisal, employee development and organizational justice: exploring the linkages. The International Journal of Human Resource Management, 16(7), 1176 1194. Retrieved July 31, 2007 from Taylor & Francis Journals Database, http://www.informaworld.com Segal, J. (2000, October). 86 Your Appraisal Process?. HR Magazine, 45(10), 199. Retrieved July 26, 2007, from Business Source Premier Database, http://search.epnet.com Sekaran, U. (2003). Research methods for business: A skill-building approach. (4 th ed.). USA: John Willey & Sons. Stephan, W., & Dorfman, P. (1989, March). Administrative and Developmental Functions in Performance Appraisals: Conflict or Synergy? Basic & Applied Social Psychology, 10(1), 27-41. Retrieved July 26, 2007, from Academic Search Premier Database, http://search.epnet.com Teratanavat, R., Raitano, R., & Kleiner, B. (2006, May). How to Reduce Employee Stress. Nonprofit World, 24(3), 22 24. Retrieved July 26, 2007, from Business Source Premier Database, http://search.epnet.com