Development and validation of a hybrid measure of organisational communication satisfaction

Share:

How to Cite

Development and validation of a hybrid measure of organisational communication satisfaction. (2022). Communicare: Journal for Communication Studies in Africa, 34(1), 1-26. https://doi.org/10.36615/jcsa.v34i1.1616
  • Articles
  • Submited: October 15, 2022
  • Published: October 17, 2022

Abstract

The purpose of the study was to develop a hybrid quantitative audit of organisational communication
satisfaction for the public service. In Study One, a two-factor solution was obtained, based on
parallel analysis as a factor determination strategy with data obtained from 264 civil servants
using a 30 item measure. In Study Two, the items of the new EFA-generated organisational
communication satisfaction scale were renumbered consecutively and the scale was crossvalidated
on a new sample of 288 civil servants from the Addis Ababa City Administration. The
cross-validation necessitated model respecification and re-estimation. The respecified model
underwent validation at different levels. All seven aspects of validity, namely content validity,
construct validity, factorial validity, reliability, convergent validity, discriminant validity and
nomological validity were addressed and found to be adequate, pointing to a refinement in the
measurement of communication satisfaction. However, limitations are also indicated as avenues
for further enquiry.

References

  1. Ahmed, A. (2006). Auditing communication satisfaction among academic staff: An approach to managing academic excellence. The Business Review, 15(1):330-333.
  2. Anastasi, A. (1988). Psychological testing. New York: Macmillan.
  3. Anglim, J. (2007). Structural equation modelling. Retrieved September 21, 2014, from http://web.psych.unimelb.edu.au/jkanglim/IntroductiontoSEM.pdf
  4. Aragon, S.J. & Gesell, S.B. (2003). Patient satisfaction theory and its robustness across gender in emergency departments: A multigroup structural equation modelling investigation. American Journal of Medical Quality, 18(6):229-241.
  5. https://doi.org/10.1177/106286060301800603
  6. Aron, A. & Aron, N. (1999). Statistics for psychology (2nd ed.). Upper Saddle River, NJ: Prentice Hall.
  7. Ashton, W. (2006). Instructions for cleaning a k. Retrieved July4, 2014, from http://www.sbaer.uca.edu/research/1998/SBIDA/98sbi178.txt 5/7/200l4
  8. Babbie, E. (1992). Practicing social research. Belmont, CA: Wadsworth.
  9. Bagozzi, R. (1983). Issues in the application of covariance structure analysis: A further comment. Journal of Consumer Research, 9:449-450.
  10. https://doi.org/10.1086/208939
  11. Baker, K. 2000. Organisational communication. Retrieved October 12, 2014, from http://www.au.af.mil/au/awc/awcgate/doe/benchmark/ch13.pdf
  12. Barki, H. & Hartwick, J. (1994). User participation, conflict, and conflict resolution: The mediation roles of influence. Information Systems Research, 5(4):422-438.
  13. https://doi.org/10.1287/isre.5.4.422
  14. Barrett, P. (2007). Structural Equation Modelling: Adjudging Model Fit, Personality and individual Differences, 42 (5):815-24.
  15. https://doi.org/10.1016/j.paid.2006.09.018
  16. Barrett, P.T. & Kline, P. (1981). The observation to variable ratio in factor analysis. Personality Study in Group Behavior, 1:23-33.
  17. Black, K. (2004). Business statistics for contemporary decision making. New Delhi: Wiley.
  18. Bollen, K.A. & Lennox, R. (1991). Conventional wisdom on measurement: A structural equation perspective. Psychological Bulletin, 110(2):305-314.
  19. https://doi.org/10.1037/0033-2909.110.2.305
  20. Bolman, G. & Deal, E. (1991). Leadership and management effectiveness: A multi-frame, multisector analysis. Human Resource Management, 30:509-534.
  21. https://doi.org/10.1002/hrm.3930300406
  22. Bowen, N. & Guo, S. (2012). Structural equation modelling. Oxford, UK: Oxford University Press.
  23. Byrne, B. (2001). Structural equation modelling with AMOS: Basic concepts, applications, programming. London: Lawrence Erlbaum.
  24. Byrne, Z. & LeMay, E. (2006). Different media for organisational communication: perceptions of quality and satisfaction. Journal of Business and Psychology 21(2):149-173.
  25. https://doi.org/10.1007/s10869-006-9023-8
  26. Carmines, E. & McIver, J. (1981). Analyzing models with unobserved variables: Analysis of covariance structures. In G.W. Bohrnstedt & E.F. Borgatta (Eds.), Social measurement: Current issues (pp.65-115). Beverly Hills, CA: Sage.
  27. Carriere, J., Bourque, C. & Bonaccio, S. (2007). The role of communication satisfaction as a mediator between an organisation's internal communication systems and two job outcomes: job satisfaction and organisational commitment. Retrieved November 10, 2014, from http://luxor.acadiau.ca/library/ASAC/v28/05/05_60.pdf
  28. Clampitt, P.G. & Girard, D.M. (1987). Time for reflection: A factor analytic study of the communication satisfaction instrument. Retrieved October 15, 2014, from http://imetacomm.com/wpcontent/themes/Structure%20Premium%20White/organic_structure_white/downloads/Metacomm_FactorAnalytical.pdf
  29. Clampitt, P. & Girard, D. (1993). Communication satisfaction: A useful construct? The New Jersey Journal of Communication,1(2):84-102.
  30. https://doi.org/10.1080/15456879309367255
  31. Cohen, R. (1997). Negotiating across cultures: International communication in an interdependent world. Washington, DC: United States Institute of Peace.
  32. Comrey, A.L. & Lee, H.B. (1992). A first course in factor analysis. Hillsdale, New Jersey: Erlbaum.
  33. Crino, D. & White, C. (1981). Satisfaction in communication: An examination of the Downs-Hazen Measure. Psychological Reports, 49:831-838.
  34. https://doi.org/10.2466/pr0.1981.49.3.831
  35. Cusella, L. (1984). Conceptual issues in organisational communication: elements of a model of conceptual authenticity. Communication Quarterly 32(4), 293-300.
  36. https://doi.org/10.1080/01463378409369566
  37. Deconinck, J., Johnson, T., Busbin, T. & Lockwood, F. (2008). An examination of the validity of the Downs and Hazen communication satisfaction questionnaire. The Marketing Management Journal, 18(2):145-153.
  38. DeCoster, J. (1998). Overview of factor analysis. Retrieved October 4, 2014, from http://www.sat-help.com/notes.html
  39. -. (2011). Scale construction. Retrieved June 2, 2014, from http://www.stat-help.com/scale.pdf
  40. DeWine, S., James, A. & Walence, W. (1985). Validation of organisational communication audit. Paper presented at the International Communication Association convention, Honolulu.
  41. Downs, C. (1988). Communication audits. London: Scott, Foresman.
  42. Downs, C.W. & Hazen, M.D. (1977). A factor analytic study of communication satisfaction. Journal of Business Communication, 14(3):63-73.
  43. https://doi.org/10.1177/002194367701400306
  44. Downs, C.W. Hazen, M., Quiggins, J. & Medley, J. (1973). An empirical and theoretical investigation of communication satisfaction. Retrieved August 5, 2014, from http://www.eric.ed.gov/ERICWebPortal/recordDetail?accno=ED084613
  45. Duncan, D. (1975). Introduction to structural equation models. New York: Academic Press.
  46. Edwards, J.R. & Bagozzi, R. (2000). On the nature and direction of relationships between constructs and measures. Psychological Methods, 5(2):155-174.
  47. https://doi.org/10.1037/1082-989X.5.2.155
  48. Farrell, A.M. (2009). Insufficient discriminant validity: A comment on Bove, Pervan, Beatty and Shiu. Journal of Business Research, 63:324-327.
  49. https://doi.org/10.1016/j.jbusres.2009.05.003
  50. Farrell, A.M. & Rudd, J. (2009). Factor analysis and discriminant validity: A brief review of some practical issues. Retrieved July 2, 2014, from http://www.duplication.net.au/ANZMAC09/papers/ANZMAC2009-389.pdf
  51. Fornell, C. (1983). Issues in the application of covariance structure analysis: A comment. Journal of Consumer Research, 9:443-448.
  52. https://doi.org/10.1086/208938
  53. Galloway, K. (1997). Random sampling. Retrieved August 5, 2014, from http://www.tardis.ed.ac.uk/~kate/qmcweb/s3.htm
  54. Garson, D. (2004). Structural equation modelling. Retrieved July 12, 2014, from http://faculty.chass.ncsu.edu/garson/PA765/stuctur.htm
  55. Gerbing, D.W. & Anderson, J.C. (1984). On the meaning of within-factor correlated measurement errors. Journal of Consumer Research, 11:572-580.
  56. https://doi.org/10.1086/208993
  57. Gray, J. & Laidlaw, H. (2004). Improving measurement of communication satisfaction. Management Communication Quarterly, 17(3):425-448.
  58. https://doi.org/10.1177/0893318903257980
  59. Greenbaum, H., DeWine, S. & Downs, H. (1987). Management and organisational communication measurement: A call for review and evaluation. Management Communication Quarterly, 1(1):129-144.
  60. https://doi.org/10.1177/0893318987001001008
  61. Gregson, T. (1990). Communication satisfaction: A path analytic study of accountants affiliated with CPA Firms. Behavioural Research in Accounting, 2:32-49.
  62. Guadagnoli, E. & Velicer, W.F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin,103:265-275.
  63. https://doi.org/10.1037/0033-2909.103.2.265
  64. Guerrero, L.K., Devito, J.A. & Hecht, M.L. (1999). The nonverbal communication reader: Classic and contemporary readings. (2nd ed.). Long Grove, IL: Waveland Press.
  65. Hecht, M. (1978). Measures of communication satisfaction. Human Communication Research, 4:350-368.
  66. https://doi.org/10.1111/j.1468-2958.1978.tb00721.x
  67. Hofstede, G. (1991). Cultures and organisations. London: McGraw-Hill.
  68. -. (2001). Culture's consequences: Comparing values, behaviors, institutions, and organisations across nations (2nd ed.). Thousand Oaks, CA: Sage.
  69. Hooper, D., Coughlan, J. & Mullen, M. (2008). Structural equation modelling: Guidelines for determining fit. Electronic Journal of Business Research Methods, 6(1):53-60.
  70. Hoyle, R.H. (2012). Handbook of structural equation modelling. New York: Guilford Press.
  71. Iyer, S. & Israel, D. (2012). Structural equation modelling for testing the impact of organisation communication satisfaction on employee engagement. South Asian Journal of Management, 19(1):51-181.
  72. Jacobs, R. (2012). Theories of practice: the human resource frame. Retrieved October 1, 2014, from http://www83.homepage.villanova.edu/.../MPA%208002/.../8002%20MPA/structural.ppt
  73. Jöreskog, K.G. (1993). Testing structural equation models. In K. A. Bollen & J. Scott Long (Eds.), Testing structural equation model (pp. 294-316). Newbury Park, CA: Sage.
  74. Jöreskog, K.G. & Sörbom, D. (1989). Lisrel 7: A guide to the program and applications (2nd ed.). Chicago, Ill.: SPSS.
  75. Kitayama, S., Markus, H.R. & Kurakawa, M. (2000). Culture, emotion, and well-being: Good feelings in Japan and the United States. Cognition & Emotion, 14:93-124.
  76. https://doi.org/10.1080/026999300379003
  77. Kline, R.B. (2005). Principles and practice of structural equation modelling (2nd ed.). New York: Guilford Press.
  78. Koike, H., Gudykunst, W., Stewart, L., Ting-Toomey, S. & Nishida, T. (1988). Communication openness, satisfaction and length of employment in Japanese organisations. Communication Research Reports 5(2):97-102.
  79. https://doi.org/10.1080/08824098809359808
  80. Landreneau, K. & Creek, W. 2011. Sampling strategies. Retrieved July 17, 2014 from http: //www.natco1.org/research/files/SamplingStrategies.pdf
  81. Lewis, B., Templeton, F. & Byrd, T.A. (2005). A methodology for construct development in MIS research. European Journal of Information Systems, 14(4):388-400.
  82. https://doi.org/10.1057/palgrave.ejis.3000552
  83. Marsh, H.W. (1989). Confirmatory factor analysis of multitrait-multimethod data: Many problems and few solutions. Applied Psychological Measurement, 13:335-361.
  84. https://doi.org/10.1177/014662168901300402
  85. McGinn, T. (2011). Instructions for probability proportional to size sampling technique. Retrieved October 2, 2014 from www.rhrc.org/resources/.../55b%20pps%20sampling%20technique.pd
  86. Miller, K. (2003). Organisational communication. Singapore: Wadsworth.
  87. Mount, D. & Back, K. (1999). A factor analytic study of communication satisfaction in the lodging industry. Journal of Hospitality and Tourism Research, 23(4):401-418.
  88. https://doi.org/10.1177/109634809902300405
  89. Noar, S. (2009). The role of structural equation modelling in scale development. Structural Equation Modelling: A Multidisciplinary Journal, 10(4):622-647.
  90. https://doi.org/10.1207/S15328007SEM1004_8
  91. Overwalle, F., Meylighen, F. & Heath, M. (2011). Trust in communication between individuals: A conceptual approach. Retrieved June 5, 2014, from http://www.tandfonline.com/doi/abs/10.1080/10196780050177072
  92. Pace, R.W. & Faules, D.F. (1994). Organisational communication (3rd ed.). London: Prentice-Hall.
  93. Pardee, W. (2008). Hybrid vigor. Microsoft Encarta. New York: Microsoft Corporation.
  94. Pearce, C.G. & Segal, G.J. (2004). Effects of organisational communication satisfaction on job performance and firm growth in small businesses. Retrieved September 10, 2014, from http://www.sbaer.uca.edu/research/sbida/1998/pdf/27.pdf
  95. Peter, J. (1981). Construct validity: A review of basic issues and marketing practices. Journal of Marketing Research, 18(3):133-145.
  96. https://doi.org/10.1177/002224378101800201
  97. Pincus, D. (1986). Communications satisfaction, job satisfaction, and job performance. Human Communication Research, 12(3):395-419.
  98. https://doi.org/10.1111/j.1468-2958.1986.tb00084.x
  99. Putti, J.M., Aryee, S. & Phua, J. (1990). Communication relationship satisfaction and organisational commitment. Group & Organisational Studies, 15(1):44-52.
  100. https://doi.org/10.1177/105960119001500104
  101. Roberts, K. & O'Reilly, C. (1974). Failures in upward communication: Three possible culprits. Academy of Management Journal, 17(2):205-215.
  102. https://doi.org/10.2307/254974
  103. Rogers, E.M. & Rogers, R. (1976). Communications in organisations. New York: Free Press.
  104. Rubin, R., Palmgreen, P. & Sypher, E. (Eds). (1994). Communication research measures. New York: Guilford Press.
  105. Savalei, V. & Bentler, P. (2012). Structural equation modelling. Retrieved June 4, 2014, from www.terry.uga.edu/~rgrover/chapter_17.pdf
  106. Savolainen, P. (2001). Finding a right way to communicate
  107. evaluation of communication practices in a multicultural project. Retrieved June 12, 2014, from https://jyx.jyu.fi/dspace/bitstream/handle/123456789/9106/psavolai.pdf?
  108. Schalles, C. (2013). Usability evaluation of modelling languages. London: Springer.
  109. https://doi.org/10.1007/978-3-658-00051-6
  110. Schumacker, R. & Lomax, R. (2004). A beginner's guide to structural equation modelling. London: Lawrence Erlbaum.
  111. https://doi.org/10.4324/9781410610904
  112. Short, E. & Williams, B. (1983). The social psychology of telecommunications. London: Wiley.
  113. Simon, A.F. 2006. Computer-mediated communication: task performance and satisfaction. Journal of Social Psychology, 146:349-379.
  114. https://doi.org/10.3200/SOCP.146.3.349-379
  115. Smolkowski, K. (2012). Correlated errors in CFA and SEM models. Retrieved July 5, 2014, from http://www.ori.org/~keiths/Files/Tips/Stats_SEMErrorCorrs.html
  116. Stanton, J., Sinar, E., Balzer, E. & Smith, W. (2002). Issues and strategies for reducing the length of self-help reports. Personnel Psychology, 55(1):167-194.
  117. https://doi.org/10.1111/j.1744-6570.2002.tb00108.x
  118. Stevens, J. (2002). Applied multivariate statistics for the social sciences. Mahwah, NJ: Lawrence Erlbaum.
  119. https://doi.org/10.4324/9781410604491
  120. Switzer, G., Wisniewski, S., Belle, S., Dew, M. & Schultz, R. (1999). Selecting, developing, and evaluating research instruments. Social Psychiatry and Psychiatric Epidemiology, 34(1): 399-409.
  121. https://doi.org/10.1007/s001270050161
  122. Thayer, O. (1969). Communication and communication systems. Homewood, III: Irwin, Inc.
  123. Thomas, G., Zolin, R. & Hartman, J. (2009). The central role of communication indeveloping trust and its effect on employee involvement. Journal of Business Communication, 46(3):287-310.
  124. https://doi.org/10.1177/0021943609333522
  125. Tojib, R. & Suglanto, L. (2006). Content validity of instruments in IS research. Journal of Information Technology Theory and Application, 8(3):31-46.
  126. Ullman, J. (2001). Structural equation modelling. In B.G. Tabachnick & L.S. Fidell (Eds.), Using multivariate statistics (pp.676-780). New York: Allyn & Bacon.
  127. Ullman, J. (2006). Structural equation modelling: reviewing the basics and moving forward. Journal of Personality Assessment, 87(1):35-50.
  128. https://doi.org/10.1207/s15327752jpa8701_03
  129. Varona, F. (1996). Relationship between communication satisfaction and organisational commitment in three Guatemalan organisations. The Journal of Business Communication, 33(2):111-140.
  130. https://doi.org/10.1177/002194369603300203
  131. Varona, F. (2002). Conceptualisation and management of communication satisfaction and organisational commitment in three Guatemalan organisations. American Communication Journal, 5(3):1-17.
  132. Walker, D. (2010). A confirmatory factor analysis of the attitudes toward research scale. Retrieved August 1, 2014, from http://mlrv.ua.edu/2010/vol36 1/Walker proof 2.pdf
  133. Wiio, O. (1978). Contingencies of organisational communication. Helsinki: Helsinki School of Economics Publications B-30.
  134. Worthington, R. & Whittaker, T. (2006). Scale development research: a content analysis and recommendations for best practices. The Counseling Psychologist, 34(6):806-838.
  135. https://doi.org/10.1177/0011000006288127
  136. Zait, A. & Bertea, P. (2011). Methods for testing discriminant validity. Management Marketing, 9(2):218-224.
  137. Zwijze-Koning, K. & De Jong, M. (2007). Evaluating the communication satisfaction questionnaire as a communication audit tool. Management Communication Quarterly, 20(3):261-282.
  138. https://doi.org/10.1177/0893318906295680
How to Cite
Development and validation of a hybrid measure of organisational communication satisfaction. (2022). Communicare: Journal for Communication Studies in Africa, 34(1), 1-26. https://doi.org/10.36615/jcsa.v34i1.1616

Send mail to Author


Send Cancel

Custom technologies based on your needs

  • ORCID
  • Crossref
  • PubMed
  • Clarivate