Development and validation of a hybrid measure of organisational communication satisfaction

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- Articles
- Submited: October 15, 2022
-
Published: October 17, 2022
Abstract
The purpose of the study was to develop a hybrid quantitative audit of organisational communication
satisfaction for the public service. In Study One, a two-factor solution was obtained, based on
parallel analysis as a factor determination strategy with data obtained from 264 civil servants
using a 30 item measure. In Study Two, the items of the new EFA-generated organisational
communication satisfaction scale were renumbered consecutively and the scale was crossvalidated
on a new sample of 288 civil servants from the Addis Ababa City Administration. The
cross-validation necessitated model respecification and re-estimation. The respecified model
underwent validation at different levels. All seven aspects of validity, namely content validity,
construct validity, factorial validity, reliability, convergent validity, discriminant validity and
nomological validity were addressed and found to be adequate, pointing to a refinement in the
measurement of communication satisfaction. However, limitations are also indicated as avenues
for further enquiry.
Article Metrics Graph
References
- Ahmed, A. (2006). Auditing communication satisfaction among academic staff: An approach to managing academic excellence. The Business Review, 15(1):330-333.
- Anastasi, A. (1988). Psychological testing. New York: Macmillan.
- Anglim, J. (2007). Structural equation modelling. Retrieved September 21, 2014, from http://web.psych.unimelb.edu.au/jkanglim/IntroductiontoSEM.pdf
- Aragon, S.J. & Gesell, S.B. (2003). Patient satisfaction theory and its robustness across gender in emergency departments: A multigroup structural equation modelling investigation. American Journal of Medical Quality, 18(6):229-241.
- https://doi.org/10.1177/106286060301800603
- Aron, A. & Aron, N. (1999). Statistics for psychology (2nd ed.). Upper Saddle River, NJ: Prentice Hall.
- Ashton, W. (2006). Instructions for cleaning a k. Retrieved July4, 2014, from http://www.sbaer.uca.edu/research/1998/SBIDA/98sbi178.txt 5/7/200l4
- Babbie, E. (1992). Practicing social research. Belmont, CA: Wadsworth.
- Bagozzi, R. (1983). Issues in the application of covariance structure analysis: A further comment. Journal of Consumer Research, 9:449-450.
- https://doi.org/10.1086/208939
- Baker, K. 2000. Organisational communication. Retrieved October 12, 2014, from http://www.au.af.mil/au/awc/awcgate/doe/benchmark/ch13.pdf
- Barki, H. & Hartwick, J. (1994). User participation, conflict, and conflict resolution: The mediation roles of influence. Information Systems Research, 5(4):422-438.
- https://doi.org/10.1287/isre.5.4.422
- Barrett, P. (2007). Structural Equation Modelling: Adjudging Model Fit, Personality and individual Differences, 42 (5):815-24.
- https://doi.org/10.1016/j.paid.2006.09.018
- Barrett, P.T. & Kline, P. (1981). The observation to variable ratio in factor analysis. Personality Study in Group Behavior, 1:23-33.
- Black, K. (2004). Business statistics for contemporary decision making. New Delhi: Wiley.
- Bollen, K.A. & Lennox, R. (1991). Conventional wisdom on measurement: A structural equation perspective. Psychological Bulletin, 110(2):305-314.
- https://doi.org/10.1037/0033-2909.110.2.305
- Bolman, G. & Deal, E. (1991). Leadership and management effectiveness: A multi-frame, multisector analysis. Human Resource Management, 30:509-534.
- https://doi.org/10.1002/hrm.3930300406
- Bowen, N. & Guo, S. (2012). Structural equation modelling. Oxford, UK: Oxford University Press.
- Byrne, B. (2001). Structural equation modelling with AMOS: Basic concepts, applications, programming. London: Lawrence Erlbaum.
- Byrne, Z. & LeMay, E. (2006). Different media for organisational communication: perceptions of quality and satisfaction. Journal of Business and Psychology 21(2):149-173.
- https://doi.org/10.1007/s10869-006-9023-8
- Carmines, E. & McIver, J. (1981). Analyzing models with unobserved variables: Analysis of covariance structures. In G.W. Bohrnstedt & E.F. Borgatta (Eds.), Social measurement: Current issues (pp.65-115). Beverly Hills, CA: Sage.
- Carriere, J., Bourque, C. & Bonaccio, S. (2007). The role of communication satisfaction as a mediator between an organisation's internal communication systems and two job outcomes: job satisfaction and organisational commitment. Retrieved November 10, 2014, from http://luxor.acadiau.ca/library/ASAC/v28/05/05_60.pdf
- Clampitt, P.G. & Girard, D.M. (1987). Time for reflection: A factor analytic study of the communication satisfaction instrument. Retrieved October 15, 2014, from http://imetacomm.com/wpcontent/themes/Structure%20Premium%20White/organic_structure_white/downloads/Metacomm_FactorAnalytical.pdf
- Clampitt, P. & Girard, D. (1993). Communication satisfaction: A useful construct? The New Jersey Journal of Communication,1(2):84-102.
- https://doi.org/10.1080/15456879309367255
- Cohen, R. (1997). Negotiating across cultures: International communication in an interdependent world. Washington, DC: United States Institute of Peace.
- Comrey, A.L. & Lee, H.B. (1992). A first course in factor analysis. Hillsdale, New Jersey: Erlbaum.
- Crino, D. & White, C. (1981). Satisfaction in communication: An examination of the Downs-Hazen Measure. Psychological Reports, 49:831-838.
- https://doi.org/10.2466/pr0.1981.49.3.831
- Cusella, L. (1984). Conceptual issues in organisational communication: elements of a model of conceptual authenticity. Communication Quarterly 32(4), 293-300.
- https://doi.org/10.1080/01463378409369566
- Deconinck, J., Johnson, T., Busbin, T. & Lockwood, F. (2008). An examination of the validity of the Downs and Hazen communication satisfaction questionnaire. The Marketing Management Journal, 18(2):145-153.
- DeCoster, J. (1998). Overview of factor analysis. Retrieved October 4, 2014, from http://www.sat-help.com/notes.html
- -. (2011). Scale construction. Retrieved June 2, 2014, from http://www.stat-help.com/scale.pdf
- DeWine, S., James, A. & Walence, W. (1985). Validation of organisational communication audit. Paper presented at the International Communication Association convention, Honolulu.
- Downs, C. (1988). Communication audits. London: Scott, Foresman.
- Downs, C.W. & Hazen, M.D. (1977). A factor analytic study of communication satisfaction. Journal of Business Communication, 14(3):63-73.
- https://doi.org/10.1177/002194367701400306
- Downs, C.W. Hazen, M., Quiggins, J. & Medley, J. (1973). An empirical and theoretical investigation of communication satisfaction. Retrieved August 5, 2014, from http://www.eric.ed.gov/ERICWebPortal/recordDetail?accno=ED084613
- Duncan, D. (1975). Introduction to structural equation models. New York: Academic Press.
- Edwards, J.R. & Bagozzi, R. (2000). On the nature and direction of relationships between constructs and measures. Psychological Methods, 5(2):155-174.
- https://doi.org/10.1037/1082-989X.5.2.155
- Farrell, A.M. (2009). Insufficient discriminant validity: A comment on Bove, Pervan, Beatty and Shiu. Journal of Business Research, 63:324-327.
- https://doi.org/10.1016/j.jbusres.2009.05.003
- Farrell, A.M. & Rudd, J. (2009). Factor analysis and discriminant validity: A brief review of some practical issues. Retrieved July 2, 2014, from http://www.duplication.net.au/ANZMAC09/papers/ANZMAC2009-389.pdf
- Fornell, C. (1983). Issues in the application of covariance structure analysis: A comment. Journal of Consumer Research, 9:443-448.
- https://doi.org/10.1086/208938
- Galloway, K. (1997). Random sampling. Retrieved August 5, 2014, from http://www.tardis.ed.ac.uk/~kate/qmcweb/s3.htm
- Garson, D. (2004). Structural equation modelling. Retrieved July 12, 2014, from http://faculty.chass.ncsu.edu/garson/PA765/stuctur.htm
- Gerbing, D.W. & Anderson, J.C. (1984). On the meaning of within-factor correlated measurement errors. Journal of Consumer Research, 11:572-580.
- https://doi.org/10.1086/208993
- Gray, J. & Laidlaw, H. (2004). Improving measurement of communication satisfaction. Management Communication Quarterly, 17(3):425-448.
- https://doi.org/10.1177/0893318903257980
- Greenbaum, H., DeWine, S. & Downs, H. (1987). Management and organisational communication measurement: A call for review and evaluation. Management Communication Quarterly, 1(1):129-144.
- https://doi.org/10.1177/0893318987001001008
- Gregson, T. (1990). Communication satisfaction: A path analytic study of accountants affiliated with CPA Firms. Behavioural Research in Accounting, 2:32-49.
- Guadagnoli, E. & Velicer, W.F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin,103:265-275.
- https://doi.org/10.1037/0033-2909.103.2.265
- Guerrero, L.K., Devito, J.A. & Hecht, M.L. (1999). The nonverbal communication reader: Classic and contemporary readings. (2nd ed.). Long Grove, IL: Waveland Press.
- Hecht, M. (1978). Measures of communication satisfaction. Human Communication Research, 4:350-368.
- https://doi.org/10.1111/j.1468-2958.1978.tb00721.x
- Hofstede, G. (1991). Cultures and organisations. London: McGraw-Hill.
- -. (2001). Culture's consequences: Comparing values, behaviors, institutions, and organisations across nations (2nd ed.). Thousand Oaks, CA: Sage.
- Hooper, D., Coughlan, J. & Mullen, M. (2008). Structural equation modelling: Guidelines for determining fit. Electronic Journal of Business Research Methods, 6(1):53-60.
- Hoyle, R.H. (2012). Handbook of structural equation modelling. New York: Guilford Press.
- Iyer, S. & Israel, D. (2012). Structural equation modelling for testing the impact of organisation communication satisfaction on employee engagement. South Asian Journal of Management, 19(1):51-181.
- Jacobs, R. (2012). Theories of practice: the human resource frame. Retrieved October 1, 2014, from http://www83.homepage.villanova.edu/.../MPA%208002/.../8002%20MPA/structural.ppt
- Jöreskog, K.G. (1993). Testing structural equation models. In K. A. Bollen & J. Scott Long (Eds.), Testing structural equation model (pp. 294-316). Newbury Park, CA: Sage.
- Jöreskog, K.G. & Sörbom, D. (1989). Lisrel 7: A guide to the program and applications (2nd ed.). Chicago, Ill.: SPSS.
- Kitayama, S., Markus, H.R. & Kurakawa, M. (2000). Culture, emotion, and well-being: Good feelings in Japan and the United States. Cognition & Emotion, 14:93-124.
- https://doi.org/10.1080/026999300379003
- Kline, R.B. (2005). Principles and practice of structural equation modelling (2nd ed.). New York: Guilford Press.
- Koike, H., Gudykunst, W., Stewart, L., Ting-Toomey, S. & Nishida, T. (1988). Communication openness, satisfaction and length of employment in Japanese organisations. Communication Research Reports 5(2):97-102.
- https://doi.org/10.1080/08824098809359808
- Landreneau, K. & Creek, W. 2011. Sampling strategies. Retrieved July 17, 2014 from http: //www.natco1.org/research/files/SamplingStrategies.pdf
- Lewis, B., Templeton, F. & Byrd, T.A. (2005). A methodology for construct development in MIS research. European Journal of Information Systems, 14(4):388-400.
- https://doi.org/10.1057/palgrave.ejis.3000552
- Marsh, H.W. (1989). Confirmatory factor analysis of multitrait-multimethod data: Many problems and few solutions. Applied Psychological Measurement, 13:335-361.
- https://doi.org/10.1177/014662168901300402
- McGinn, T. (2011). Instructions for probability proportional to size sampling technique. Retrieved October 2, 2014 from www.rhrc.org/resources/.../55b%20pps%20sampling%20technique.pd
- Miller, K. (2003). Organisational communication. Singapore: Wadsworth.
- Mount, D. & Back, K. (1999). A factor analytic study of communication satisfaction in the lodging industry. Journal of Hospitality and Tourism Research, 23(4):401-418.
- https://doi.org/10.1177/109634809902300405
- Noar, S. (2009). The role of structural equation modelling in scale development. Structural Equation Modelling: A Multidisciplinary Journal, 10(4):622-647.
- https://doi.org/10.1207/S15328007SEM1004_8
- Overwalle, F., Meylighen, F. & Heath, M. (2011). Trust in communication between individuals: A conceptual approach. Retrieved June 5, 2014, from http://www.tandfonline.com/doi/abs/10.1080/10196780050177072
- Pace, R.W. & Faules, D.F. (1994). Organisational communication (3rd ed.). London: Prentice-Hall.
- Pardee, W. (2008). Hybrid vigor. Microsoft Encarta. New York: Microsoft Corporation.
- Pearce, C.G. & Segal, G.J. (2004). Effects of organisational communication satisfaction on job performance and firm growth in small businesses. Retrieved September 10, 2014, from http://www.sbaer.uca.edu/research/sbida/1998/pdf/27.pdf
- Peter, J. (1981). Construct validity: A review of basic issues and marketing practices. Journal of Marketing Research, 18(3):133-145.
- https://doi.org/10.1177/002224378101800201
- Pincus, D. (1986). Communications satisfaction, job satisfaction, and job performance. Human Communication Research, 12(3):395-419.
- https://doi.org/10.1111/j.1468-2958.1986.tb00084.x
- Putti, J.M., Aryee, S. & Phua, J. (1990). Communication relationship satisfaction and organisational commitment. Group & Organisational Studies, 15(1):44-52.
- https://doi.org/10.1177/105960119001500104
- Roberts, K. & O'Reilly, C. (1974). Failures in upward communication: Three possible culprits. Academy of Management Journal, 17(2):205-215.
- https://doi.org/10.2307/254974
- Rogers, E.M. & Rogers, R. (1976). Communications in organisations. New York: Free Press.
- Rubin, R., Palmgreen, P. & Sypher, E. (Eds). (1994). Communication research measures. New York: Guilford Press.
- Savalei, V. & Bentler, P. (2012). Structural equation modelling. Retrieved June 4, 2014, from www.terry.uga.edu/~rgrover/chapter_17.pdf
- Savolainen, P. (2001). Finding a right way to communicate
- evaluation of communication practices in a multicultural project. Retrieved June 12, 2014, from https://jyx.jyu.fi/dspace/bitstream/handle/123456789/9106/psavolai.pdf?
- Schalles, C. (2013). Usability evaluation of modelling languages. London: Springer.
- https://doi.org/10.1007/978-3-658-00051-6
- Schumacker, R. & Lomax, R. (2004). A beginner's guide to structural equation modelling. London: Lawrence Erlbaum.
- https://doi.org/10.4324/9781410610904
- Short, E. & Williams, B. (1983). The social psychology of telecommunications. London: Wiley.
- Simon, A.F. 2006. Computer-mediated communication: task performance and satisfaction. Journal of Social Psychology, 146:349-379.
- https://doi.org/10.3200/SOCP.146.3.349-379
- Smolkowski, K. (2012). Correlated errors in CFA and SEM models. Retrieved July 5, 2014, from http://www.ori.org/~keiths/Files/Tips/Stats_SEMErrorCorrs.html
- Stanton, J., Sinar, E., Balzer, E. & Smith, W. (2002). Issues and strategies for reducing the length of self-help reports. Personnel Psychology, 55(1):167-194.
- https://doi.org/10.1111/j.1744-6570.2002.tb00108.x
- Stevens, J. (2002). Applied multivariate statistics for the social sciences. Mahwah, NJ: Lawrence Erlbaum.
- https://doi.org/10.4324/9781410604491
- Switzer, G., Wisniewski, S., Belle, S., Dew, M. & Schultz, R. (1999). Selecting, developing, and evaluating research instruments. Social Psychiatry and Psychiatric Epidemiology, 34(1): 399-409.
- https://doi.org/10.1007/s001270050161
- Thayer, O. (1969). Communication and communication systems. Homewood, III: Irwin, Inc.
- Thomas, G., Zolin, R. & Hartman, J. (2009). The central role of communication indeveloping trust and its effect on employee involvement. Journal of Business Communication, 46(3):287-310.
- https://doi.org/10.1177/0021943609333522
- Tojib, R. & Suglanto, L. (2006). Content validity of instruments in IS research. Journal of Information Technology Theory and Application, 8(3):31-46.
- Ullman, J. (2001). Structural equation modelling. In B.G. Tabachnick & L.S. Fidell (Eds.), Using multivariate statistics (pp.676-780). New York: Allyn & Bacon.
- Ullman, J. (2006). Structural equation modelling: reviewing the basics and moving forward. Journal of Personality Assessment, 87(1):35-50.
- https://doi.org/10.1207/s15327752jpa8701_03
- Varona, F. (1996). Relationship between communication satisfaction and organisational commitment in three Guatemalan organisations. The Journal of Business Communication, 33(2):111-140.
- https://doi.org/10.1177/002194369603300203
- Varona, F. (2002). Conceptualisation and management of communication satisfaction and organisational commitment in three Guatemalan organisations. American Communication Journal, 5(3):1-17.
- Walker, D. (2010). A confirmatory factor analysis of the attitudes toward research scale. Retrieved August 1, 2014, from http://mlrv.ua.edu/2010/vol36 1/Walker proof 2.pdf
- Wiio, O. (1978). Contingencies of organisational communication. Helsinki: Helsinki School of Economics Publications B-30.
- Worthington, R. & Whittaker, T. (2006). Scale development research: a content analysis and recommendations for best practices. The Counseling Psychologist, 34(6):806-838.
- https://doi.org/10.1177/0011000006288127
- Zait, A. & Bertea, P. (2011). Methods for testing discriminant validity. Management Marketing, 9(2):218-224.
- Zwijze-Koning, K. & De Jong, M. (2007). Evaluating the communication satisfaction questionnaire as a communication audit tool. Management Communication Quarterly, 20(3):261-282.
- https://doi.org/10.1177/0893318906295680