Class Time: Mondays 9:00 a.m. to 12:00 a.m. Location: Rm. # 51307, Graduate School of Management Office Hours: By appointment

Transcription

1 Objectives: Multilevel Research Methodology (D ) I-Shou University August 17, 2005 Organizational phenomena are inherently multilevel in nature. Management research focusing on a single level risks misspecification fallacies and may result in misleading findings. The primary purpose of this course is to provide students with adequate understanding of the conceptual issues relevant to multilevel research. The secondary purpose is to expose the students to several analytical approaches with the hope that students will adopt them in future research endeavors. Instructors: C.C. Lin timothy@mail.npust.edu.tw T.K. Peng tkpeng@isu.edu.tw Class Time: Mondays 9:00 a.m. to 12:00 a.m. Location: Rm. # 51307, Graduate School of Management Office Hours: By appointment Required Textbooks: Klein, K.J. & Kozlowski, S.W. (eds.) (2000). Multilevel Theory, Research, and Methods in Organizations: Foundations, Extensions, and New Directions. San Francisco: Jossey-Bass. Recommended Books and Readings: Journal of Management (1997). Special Issue on Hierarchical Linear Models. 23, 6. Academy of Management Review, (1999). Special topic forum on multilevel theory building. 24, 2. Kreft, I. & de Leeuw, J. (1998). Introducing Multilevel Modeling. Thousand Oaks, CA:Sage. Raudenbush, S.W. & Bryk, A.S. (2002). Hierarchical Linear Models in Social and Behavioral Research: Application and Data Analysis Methods. 2 nd edition. Thousand Oaks, CA: Sage. Prerequisites: You are expected to have a working knowledge of general linear models (regression, ANOVA, and ANCOVA) and to have reasonable experience in using common statistical software such as SPSS. Grading: Class participation and contribution 30% Assigned presentations 35% Term Project 35%

2 Term Project: You are responsible for an individual project to be due toward the end of the semester. In this project, you need to locate two empirical studies dealing with identical or similar multilevel issues, one using OLS technique(s) and the other HLM, and to compare and contrast their theoretical perspectives, research designs, analytical techniques, etc. You are expected to share your insights with the class. Be sure you make a valuable contribution to all of us. 1.September 20 Course Introduction No Assignment 2.September 27 Issues in Level of Analysis Thorndike, E.L. (1939). On the fallacy of imputing the correlations found for groups to the individuals or smaller groups composing them. American Journal of Sociology, 52, Robinson, W.S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15, Schwartz, S. (1994). The fallacy of the ecological fallacy: The potential misuse of a concept and the consequences. American Journal of Public Health. 84, Klein, K., Dansereau, F. & Hall, R. (1994). Level issues in theory development, data collection, and analysis. Academy of Management Review, 19, October 4 Multilevel Nature of Organizational Phenomena Hackman, J.R. (2003). Learning more by cross level: Evidence from airplanes, hospitals, and orchestras. Journal of Organizational Behavior, 24, Mossholder, K.W. & Bedeian, A.G. (1983). Cross-level inference and organizational research: Perspectives on interpretation and application. Academy of Management Review, 8, 4, Rousseau, D.M. (1985). Issues of level in organizational research: Multi-level and cross-level perspectives. Research in Organizational Behavior, 7, Hofmann, D.A. (2002). Issues in multilevel research: Theory development, measurement, and analysis. In S.G. Rogelberg s (ed.) Handbook of

3 Research Methods in Industrial and Organizational Psychology Oxford, UK: Blackwell. Feldman, D. C. (1984). The development and enforcement of group norms. Academy of Management Review, 9: Johns, G. (1999). A multi-level theory of self-serving behavior in and by organizations. In Sutton, R. I., & Staw, B. M. (Eds.), Research in Organizational Behavior, 21: Weingart, L. (1997). How did they do that? The ways and means of studying group process. In Staw B. M., & Cummings L. L. (eds.) 19: Research in Organizational Behavior, 4. October 11 Research Design in Multilevel Research Kline, K.J. & Kozlowski, S.J. (2000). From micro to meso: Critical steps in conceptualizing and conducting multilevel research. Organizational Research methods. 3, 3, Glick, W.H. (1985). Conceptualizing and measuring organizational and psychological climate: Pitfalls of multilevel research. Academy of Management Review, 10, Tosi, H. (1992). The organization and the environment: The E/O link in the model. The Environment/Organization/Person Contingency Model: A Meso Approach to the Study of Organizations Greenwich, Conn: JAI. Cappelli, P., & Sherer, P. (1991). The missing role of context in OB: The need for a meso-level approach. In Staw, B. M, & Cummings, L. L. (Eds.), Research in Organizational Behavior, 13: House, R. J., Rousseau, D.M., & Thomas-Hunt, M. (1995). The meso paradigm: A framework for the integration of micro and macro organizational behavior. In Staw, B. M., & Cummings, L. L. (Eds.), Research in Organizational Behavior, 17: October 18 Extending Multilevel Organizational Theory ( I ) Kozlowski, S.W.J. & Kline, K. (2000). A multilevel approach to theory and

4 research in organizations: Contextual, temporal, and emergent processes. In K. and K, October 25 Extending Multilevel Organizational Theory ( II ) Klein, K., Palmer, S.L., Conn, A.B. (2000). Interorganizational Relationships: A multilevel perspective. In K. and K Chao, G.T. (2000). Multilevel issues and culture: An integrative view. In K. & K November 1 Measurement and Aggregation Burke, M.J. et al., (1999). On average deviation indices for estimating interrater agreement. Organizational Research Methods, 2,, 1, Burke, M.J. & Dunlap, W.P. (2002). Estimating interrater agreement with the average deviation index: A user s guide. Organizational Research Methods, 5, 2, James, L.R., Demaree, R.G., & Wolf, G. (1984). Estimating with-group reliability with and without response bias. Journal of Applied Psychology, 69, 1, James, L.R., Demaree, R.G., & Wolf, G. (1993). R wg: An assessment of within-group interrater agreement. Journal of Applied Psychology, 78, 2, November 8 Approaches to Multilevel Data Analysis ( I ) Bleise, P.D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and Analysis. In K. & K James, L.R., & Williams, L. (2000). The cross-level operator in regression, ANCOVA, and contextual anlysis. In K. & K November 15 Approaches to Multilevel Data Analysis ( II ) Dansereau, F., Yammarino, F.J., & Kohles, J. (1999). Multiple levels of analysis from a longitudinal perspective: Some implications for theory building. Academy of Management Review, 24, Klein, K.J., Bliese, P.D. et al., (2000). Multilevel analytical techniques: Commonalities, differences, and continuing questions. In K. & K

5 10. November 22 Introduction to HLM (I) Hofmann, D.A. (1997). An overview of the logic and rationale of HLM. Journal of Management. 23, 6, Hofmann, D.A. & Griffin, M.A., Gavin, M.B. The application of hierarchical linear modeling to organizational research. In K. & K November 29 Introduction to HLM (II) Bliese, P. D. & Hanges, P. J. (2004). Being too liberal and too conservative: The perils of treating grouped data as though they were independent. Organizational Research Methods, 7: Hofmann, D. A., & Gavin, M. B. (1998). Centering decisions in hierarchical linear models: Implications for research in organizations. Journal of Management, 24: Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83: Klein, K. J., Conn, A.B., Smith, D.B., & Sorra, J.S. (2001). Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. Journal of Applied Psychology, 86, 3-16.(T) 12. December 6 Empirical Examples for HLM Gavin, M. B., & Hofmann, D. A. (2002). Using hierarchical linear modeling to investigate the moderating influence of leadership climate. Leadership Quarterly, 13, Kark, R., Shamir, B. Chen, G. (2003). The two faces of transformational leadership: Empowerment and dependency. Journal of Applied Psychology. 88, 2, Steensma, H.K., Marino, L., & Dickson, P. H. (2000). The influence of national cultural on the formation of technology alliances by entrepreneurial firms. Academy of Management Journal, 43, Vancouver, J.B. (1997). The application of HLM to the analysis of the dynamic interaction of environment, person and behavior. Journal of Management, 23,

6 Kidwell, R. E., Mossholder, K.W., & Bennett, N. (1997). Cohesiveness and organizational citizenship behavior: A multilevel analysis using work groups and individuals. Journal of Management, 23, Sacco, J.M., & Schmitt, N., (2005). A dynamic multilevel model of demographic diversity and misfit effects. Journal of Applied Psychology, 90, 2, Whitener, E.M. (2001). Do high commitment human resource practices affect employee commitment? A cross-level analysis using hierarchical linear modeling. Journal of Management, 27, Paris, L. (2004). The effects of gender and culture on implicit leadership theories: A cross-cultural study. William H. Newman Award, Academy of Management meeting. (Award given to a single-authored paper based on dissertation) Bloom, M., & Milkovich, G. (1998). Relationships among risk, incentive pay, and organizational performance. Academy of Management Journal, 41, Eyring, J. D., Johnson, D. S., & Francis, D. J. (1993). A cross-level units-of-analysis approach to individual differences in skill acquisition. Journal of Applied Psychology, 78, Glission, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams. Journal of Organizational Behavior, 23, December 13 Comparison between HLM and OLS(I) Liao H. & Chaung, A. (2004). A multilevel investigation of factors influencing employee service performance and customer outcomes. Academy of Management of Journal, 47, 1, (H) Yeo, G.B., & Neal, A. (2004). A multilevel analysis of effort, practice, and performance: Effects of ability, conscientiousness, and goal orientation. Journal of Applied Psychology, 89, (H) Jex, S. M., & Bliese, P.D. (1999). Efficacy beliefs as a moderator of the impact of work-related stressors: A multilevel study. Journal of Applied Psychology, 84, (H) Klein, K. J., Conn, A.B., Smith, D.B., & Sorra, J.S. (2001). Is everyone in agreement? An exploration of within-group agreement in employee

7 perceptions of the work environment. Journal of Applied Psychology, 86, 3-16.(T) Gozalez-Roma, V. et al., (2002). An examination of the antecedents and moderator influences of climate strength. Journal of Applied Psychology, 87, 3, (T) 14. December 20 Comparison between HLM and OLS(II) Mossholder, K.W, Bennett, N., & Martin, C. L. (1998). A multilevel analysis of procedural justice context. Journal of Organizational Behavior, 19, (H) Griffin, M.A., Patterson, M.G., & West, M.A. (2001). Job satisfaction and teamwork: The role of supervisor support. Journal of Organizational Behavior, 22, (H) Dietz, J, Pugh, S.D., & Wiley, J.W. (2004). Service climate effects on customer attitudes: An examination of boundary conditions. Academy of Management Journal, 47, 1, (T) Lambert, S. (2000). Added benefits: The link between work-life benefits and organizational citizenship behavior. Academy of Management Journal, 43, (T) 15. December 27 Lab Practices 16. January 3 Lab Practices 17. January 10 Project presentation 18. January 17 Conclusion Brass, D.J. (2000). Networks and Frog Ponds: Trends in multilevel research. In K.& K Dansereau, F. & Yammarino, F.J. (2000). Within and between analysis: The variant paradigm as an underlying approach to theory building and tesing. In K. & K Rousseau, D.M. (2000). Multilevel competencies and missing linkages. In K. & K Chen, G., Mathieu, J. E., & Bliese, P. D A framework for conducting multilevel construct validation. In F. J. Yammarino & F. Dansereau (Eds.),

8 Research in multilevel issues: Multilevel issues in organizational behavior and processes (Vol. 3): Elsevier: Oxford, U.K. Sacco, J.M., & Schmitt, N. (2005). A dynamic multilevel model of demographic diversity and misfit effects. Journal of applied Psychology. 90, 2,