Communication Skills Assessments and Rubrics In The Higher Education: A Meta-Analysis
DOI:
https://doi.org/10.11113/sh.v16n3.2159Keywords:
assessment, communication skills, higher education, rubricsAbstract
Effective communication skills are crucial in the higher education system. Consequently, there is a growing concern about how higher education institutions can better equip students with the communication skills required for success in both academic and professional settings. The assessment of communication skills, especially in higher education, is complex and can have a substantial impact on students' academic achievements, preparedness for their careers, and overall professional growth. Due to this disparities and assessment challenges, this meta-analysis sought to answer the following research questions: (a) What are the assessments employed for communication skills in multi-discipline studies in higher education? (b) What are the “key findings” contributing to the issues of communication skills assessment in higher education? In this article, a meta-analysis was conducted to determine the types of communication skill assessments and other key findings concerning the assessment issues in this area. Sources were identified using Scopus, Web of Science, Wiley Online Library, Taylor & Francis Online and Springerlink, and, after inclusion criteria were applied, 21 samples of articles were included in the meta-analysis. The findings demonstrate the existence of issues from the aspects of audience, mode, and purpose of the assessments, which mainly are: (1) impact of language proficiency and ICT competency; (2) communication skills approach to non-scientific audience; (3) blended assessment and feedback communication; (4) use of explicit and direct teaching assessment; (5) critical thinking and opportunity for justifying scientific ideas; and (6) benefit of early and continuous communication tasks. The review finds an extensive gap on the communication skills assessment related to higher-order thinking and problem-solving abilities in junior students. This meta-analysis may be of great interest to university policymakers, language lecturers, and academic lecturers from other disciplines who are searching for the best assessments strategies to measure students' communication skills.
References
Agrawal, A. K., & Mittal, G. (2018). The Role of ICT in Higher Education for the 21st Century: ICT as A Change Agent for Education. Swaranjali Publication
Al-araibi, A. A. M., Naz’ri bin Mahrin, M., Yusoff, R. C. M., & Chuprat, S. B. (2019). A model for technological aspect of e-learning readiness in higher education. Education and Information Technologies, 24(2), 1395–1431. https://doi.org/10.1007/s10639-018-9837-9 Alias, A., & Osman, K. (2015). Assessing oral communication skills in science: A rubric development. Asia Pacific Journal of Educators and Education, 30(1), 1-18.
Ashaver, D., & Igyuve, S. M. (2013). The use of audio-visual materials in the teaching and learning processes in colleges of education in Benue State-Nigeria. IOSR Journal of Research & Method in Education, 1(6), 44-55.
Borup, J., West, R. E., & Thomas, R. (2015). The impact of text versus video communication on instructor feedback in blended courses. Educational Technology Research and Development, 63(2), 161–184. https://doi.org/10.1007/s11423-015-9367-8
Brossard, D., Lewenstein, B., & Bonney, R. (2005). Scientific knowledge and attitude change: The impact of a citizen science project. International Journal of Science Education, 27(9), 1099-1121.
Byram, M. (2020). Teaching and Assessing Intercultural Communicative Competence: Revisited. Multilingual matters.
Dunbar, N. E., Brooks, C. F., & Kubicka-Miller, T. (2006). Oral Communication Skills in Higher Education: Using a Performance-Based Evaluation Rubric to Assess Communication Skills. Innovative Higher Education, 31(2), 115–128. https://doi.org/10.1007/s10755-006-9012-x
ENQA (2014). The Concept of Excellence in Higher Education. Brussels: ENQA. (https://goo.gl/fh3O4C) (2017-03-22). Retrieved date: 28 march 2024
Harper, R., & Vered, K. O. (2017). Developing communication as a graduate outcome: Using ‘Writing Across the Curriculum’ as a whole-of-institution approach to curriculum and pedagogy. Higher Education Research & Development, 36(4), 688–701. https://doi.org/10.1080/07294360.2016.1238882
Harris, K. M., Phelan, L., McBain, B., Archer, J., Drew, A. J., & James, C. (2016). Attitudes toward learning oral communication skills online: The importance of intrinsic interest and student-instructor differences. Educational Technology Research and Development, 64(4), 591–609. https://doi.org/10.1007/s11423-016- 9435-8
Isaias, P., & Issa, T. (2014). Promoting communication skills for information systems students in Australian and Portuguese higher education: Action research study. Education and Information Technologies, 19(4), 841–861. https://doi.org/10.1007/s10639-013-9257-9
Johnson, S., Veitch, S., & Dewiyanti, S. (2015.). A framework to embed communication skills across the curriculum: A design-based research approach. 16.
Kamal, N., Arsad, N., Rahni, A. A. A., Yahya, I., & Ibrahim, W. N. W. (2016). Students’ Communication Skills Assessment By External Lecturers And Industry Representatives. 11, 10.
Kaplan, M., & Dahlstrom, M. F. (2017). How narrative functions in entertainment to communicate science. The Oxford handbook of the science of science communication, 311-319.
King, C. (2018). Exploring the Use Of Visual Aids As Tool To Understanding Subject Specific Terminology In Life Sciences (Doctoral dissertation, Stellenbosch: Stellenbosch University).
Hamodi, C., López-Pastor, A.T., & López-Pastor, V.M. (2017). If I Experience Formative Assessment Whilst at University Will I Put it into Practice Later as a Teacher? Formative and Shared Assessment in Initial Teacher Education (ITE). European Journal of Teacher Education, 40(2), 171-190. https://doi.org/10.1080/02619768.2017.1281909
Kelp, N. C., Pisano, A., Alderfer, S., & Levinger, N. E. (2023). Inclusive Science Writing about Socioscientific Issues for Diverse Audiences. Prompt: A Journal of Academic Writing Assignments, 7(2), 73-80
Mercer-Mapstone, L. D., & Kuchel, L. J. (2016). Integrating Communication Skills into Undergraduate Science Degrees: A Practical and Evidence-Based Approach. Teaching & Learning Inquiry: The ISSOTL Journal, 4(2), 122-149. https://doi.org/10.20343/teachlearninqu.4.2.11
Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med 6(7): e1000097. doi:10.1371/journal.pmed1000097
Moon, J. A. (2010). Using story to enrich learning and teaching: in higher education and professional development. Routledge.
Nikolic, S., Stirling, D., & Ros, M. (2018). Formative assessment to develop oral communication competency using YouTube: Self- and peer assessment in engineering. European Journal of Engineering Education, 43(4), 538–551. https://doi.org/10.1080/03043797.2017.1298569
Othman, R., & Awang, Z. (2010). Assessing Oral Communication Skills in the Final Year Project Design Course of an Undergraduate Engineering Program. 12.
Perera, J., Mohamadou, G., & Kaur, S. (2010). The use of objective structured self-assessment and peer- feedback (OSSP) for learning communication skills: Evaluation using a controlled trial. Advances in Health Sciences Education, 15(2), 185–193. https://doi.org/10.1007/s10459-009-9191-1
Ponzio, N. M., Alder, J., Nucci, M., Dannenfelser, D., Hilton, H., Linardopoulos, N., & Lutz, C. (2018). Learning Science Communication Skills Using Improvisation, Video Recordings, and Practice, Practice, Practice. Journal of Microbiology & Biology Education, 19(1), 1-8. https://doi.org/10.1128/jmbe.v19i1.1433
Ratcliff, C. L., & Sun, Y. (2020). Overcoming resistance through narratives: Findings from a meta-analytic review. Human Communication Research, 46(4), 412-443.
Romero-Martín, R., Castejón-Oliva, F.-J., López-Pastor, V.-M., & Fraile-Aranda, A. (2017). Formative assessment, communication skills and ICT in Initial Teacher Education. Comunicar, 25(52), 73–82. https://doi.org/10.3916/C52-2017-07
Saaranen, T., Vaajoki, A., Kellomäki, M., & Hyvärinen, M.-L. (2015). The simulation method in learning interpersonal communication competence—Experiences of masters’ degree students of health sciences. Nurse Education Today, 35(2), e8–e13. https://doi.org/10.1016/j.nedt.2014.12.012
Said, N. E. M., Mahamod, Z., & Alias, A. (2013). Communication and Leadership Skills: A Comparative Study of the Malay Language Specialization Trainee Teachers in Malaysia. Asian Social Science, 9(16), p142. https://doi.org/10.5539/ass.v9n16p142
Sarwari, A. Q., & Abdul Wahab, M. N. (2017). Study of the relationship between intercultural sensitivity and intercultural communication competence among international postgraduate students: A case study at University Malaysia Pahang. Cogent Social Sciences, 3(1).. https://doi.org/10.1080/23311886.2017.1310479
Sarwari, A. Q., Ibrahim, A. H. & Nor Ashikin, A. A. (2016).The Impact of English Language Proficiency on Interpersonal Interactions among Students from Different Nationalities in a Malaysian Public University. Pertanika Journal of Social Sciences & Humanities. 24 (1), 415 – 42.
Sarwari, A. Q., Wahab, M. N., Said, M. H. M., & Aziz, N. A. A. (2018). Assessment of the characteristics of interpersonal communication competence among postgraduate students from different cultures. Journal of Intercultural Communication, 18(2), 1-12.
Saterbak, A., Moturu, A., & Volz, T. (2018). Using a Teaching Intervention and Calibrated Peer ReviewTM Diagnostics to Improve Visual Communication Skills. Annals of Biomedical Engineering, 46(3), 513–524. https://doi.org/10.1007/s10439-017-1946-x
Stevens, S., Mills, R., & Kuchel, L. (2019). Teaching communication in general science degrees: Highly valued but missing the mark. Assessment & Evaluation in Higher Education, 44(8), 1163–1176. https://doi.org/10.1080/02602938.2019.1578861
Vlachopoulos, D., & Makri, A. (2019). Online communication and interaction in distance higher education: A framework study of good practice. International Review of Education, 65(4), 605–632. https://doi.org/10.1007/s11159-019-09792-3
Wilby, K. J., Govaerts, M., Austin, Z., & Dolmans, D. (2019). Discriminating Features of Narrative Evaluations of Communication Skills During an OSCE. Teaching and Learning in Medicine, 31(3), 298–306. https://doi.org/10.1080/10401334.2018.1529570
Yeap, R. (2008). Evaluating IMU Communication Skills Training Programme: Assessment Tool Development. 63(3), 3.
Zhai, C., & Wibowo, S. (2023). A systematic review on artificial intelligence dialogue systems for enhancing English as foreign language students’ interactional competence in the university. Computers and Education: Artificial Intelligence, 4, 100134.
