Main Article Content


Multimodal inputs (both auditory and visual) in the forms of films and videos have long been used in teaching EFL listening comprehension. Previous studies have shown that listening while watching videos can significantly aid students’ comprehension. However, videos were rarely used as testing materials since they contained more than aural input so they did not ‘really’ test listening. This study explored the extent to which multimodal testing materials can be used in testing listening comprehension for EFL students and how the results would differ from that of mono modality testing materials. The participants were 100 students of the English Department, Bina Nusantara University (henceforth Binus) University Jakarta. The researchers gave them two kinds of tests: the video listening test (VLT) and audio listening test (ALT). The materials were two short videos from YouTube. The first test, ALT was given after the participants listened to the videos twice. On the contrary, VLT was administered after they watched the videos twice. To examine the differences in the effects of VLT or ALT on EFL students’ performance in listening comprehension, the data were analyzed quantitatively. The results indicate that students got better scores for VLT compared to ALT. The findings imply that students’ performance in listening comprehension is significantly improved with multimodal testing materials


audio listening test listening comprehension video listening test multimodality

Article Details

Author Biographies

Clara Herlina Karjo, Bina Nusantara University, Jakarta

Clara Herlina Karjo is an associate professor at Bina Nusanatara University Jakarta Indonesia

Menik Winiharti, Bina Nusanatara University, Jakarta

Menik Winiharti is an associate professor at Bina Nusanatar University Jakarta Indonesia

Safnil Arsyad, The University of Bengkulu

Safnil Arsyad is a professor at the English Education Postgraduate Program of FKIP of University of Bengkulu SCOPUS ID:55933198900
How to Cite
Karjo, C. H., Winiharti, M., & Arsyad, S. (2022). Video or audio listening tests for English language teaching context: which is more effective for classroom use?. JOALL (Journal of Applied Linguistics and Literature), 7(1), 149–166.


  1. Anderson, A., & Lynch, T. (1988). Listening. Oxford: Oxford University Press.
  2. Ba?al, A., Gülözer, K. & Demir, ?. (2015). Use of Video and Audio Texts in EFL Listening Test. Journal of Education and Training Studies, 3(6), 83-89.
  3. Behroozizad, S. ; Majidi, S. (2015). The effect of different modes of English captioning on EFL learners’ general listening comprehension: Full text vs. keyword captions. Advances in Language and Literary Studies, 6(4), 1670-1677.
  4. Blau, E. K. (1990). The effect of syntax, speed and pauses on listening comprehension. TESOL Quarterly, 24, 746-753.
  5. Brindley, G. & Slatyer, H. (2002). Exploring task difficulty in ESL listening assessment. Language Testing, 19(4), 369-394
  6. Brown, G. (1995). dimensions of difficulty in listening comprehension. In D. Mendelshohn & J. Rubin (Eds). A Guide for the Teaching of Second Language Listening, 59-73. San Diego: Domine Press.
  7. Chang, C. C., Lei, H. and Tseng, J. S. (2011) Media presentation mode, English listening comprehension and cognitive load in ubiquitous learning environments: Modality effect or redundancy effect? Australasian Journal of Educational Technology, 27(4), 633–654
  8. Chiang, C. S. & Dunkel, P. (1992). The effect of speech modification, prior knowledge and listening proficiency on EFL lecture learning. TESOL Quarterly, 26, 345-374.
  9. Chung, J. M. (1999). The effects of using video texts supported with advance organizers and captions on Chinese college students’ listening comprehension: An empirical study. Foreign Language Annals, 32(3), 296–308
  10. Creswell, J. (2009). Research design: Qualitative, Quantitative and Mixed Methods Approaches, 3rd Edition. London, United Kingdom: SAGE.
  11. Cross, J. (2011). Comprehending news videotexts: the influence of visual contents. Language Learning and Technology 15(2), 42-68.
  12. Danan, M. (2004). Captioning and subtitling: Undervalued language learning strategies. Meta: Translators’ Journal, 49(1), 67–77.
  13. Ferris, D. (1998). Students' view on academic aural/oral skills: A comparative needs analysis. TESOL Quarterly, 289-318.
  14. Gao, Y. (2012). Effects of speaker variability on learning spoken English for EFL learners. Faculty of Arts and Social Sciences, 59-67.
  15. Gilakjani, A., & Ahmadi, M. (2011). A study of factors affecting EFL learners' English listening comprehension and the strategies for improvement. Journal of Language Teaching and Research, 2(5), 977-988.
  16. Gilakjani, A. P., & Sabouri, N. B. (2016). The Significance of listening comprehension in English language teaching. Theory and Practice in Language Studies, 6(8), 1670–1677.
  17. Griffith, R. (1992). Speech rate and listening comprehension: Further evidence of the relationship. TESOL Quarterly, 26, 385-391.
  18. Gruba, P. (1993). A comparison study of video and audio in language testing. JALT Journal 15, 85-88.
  19. Gruba, P. (1997). The role of video media in listening assessment. System, 25(3), 335–345.
  20. Guillory, H. G. (1998). The effects of keyword captions to authentic French video on learner comprehension. Calico Journal, 15(1-3), 89–108.
  21. Guo, P.J., Kim, J. & Rubin, R. (2014). How video production affects students engagement: An empirical study of MOOC videos. Proceedings of the First ACM Conference on Learning @ Scare Conference. Atlanta, Georgia.
  22. Harmer, J. (2007). The Practice of English Language Teaching. Harlow: Pearson Longman.
  23. Hemmati, F., & Ghaderi, E. (2014). The Effect of Four Formats of multiple-choice questions on the listening comprehension of EFL learners. Procedia - Social and Behavioral Sciences, 98, 637–644
  24. Hosogoshi, K. (2016). Effects of captions and subtitles on the listening process : Insights from EFL learners ’ listening strategies. Jalt Call Journal, 12(3), 153–178.
  25. Huang, H. C., & Eskey, D. E. (1999-2000). The Effects of closed-captioned television on the listening comprehension of intermediate English as a second language (ESL) students. Journal of Educational Technology Systems, 28(1), 75-96.
  26. Jafari, K. and Hashim, F. (2012). The effects of using advance organizers on improving EFL learners’ listening comprehension: A mixed-method study. System, 40(2), 270–281.
  27. Jewitt, C. (2013). Multimodal Teaching and Learning. In C. Chapelle, The Encyclopaedia of Applied Linguistics (pp. 1-5). Chichester: Blackwell Publishing.
  28. Jing, Z. (2010). Testing via news videos: An exploratory study. International Journal of Applied Linguistics, 20(2), 178–205
  29. Kay, R. H. (2012). Exploring the use of video podcast in education: A comprehensive review of the literature. Computers in Human Behavior, (28) 3, 820-831
  30. Kelly, R. (1991). Lexical ignorance: The main obstacle to listening comprehension with advanced FL learners. IRAL, 29, 135-150.
  31. Koolstra, C. M. & Beentjes, J. W. J. (1999). Children’s vocabulary acquisition in a foreign language through watching subtitled television programs at home. Educational Technology Research & Development, 47(1), 51–60.
  32. Krashen, S. (1985). The input hypothesis. London, England: Longman
  33. Kruger, J. & Doherty, S. (2016). Measuring cognitive load in the presence of educational video: Towards a multimodal methodology. Australasian Journal of Educational Technology, 32(6), 19-31.
  34. Markham, P. L., Peter, L. A., & McCarthy, T. J. (2001). The effects of native language vs. target language captions on foreign language students’ dvd video comprehension. Foreign Language Annals, 34(5), 439–445.
  35. Matter, J. (1989). Some fundamental problems in understanding French as a foreign language. In H.W. Dechert & M. Raupach (Eds.). Interlingual processes. 105-119. Gunter Narr: Tubingen.
  36. Ockey, G. (2007). Construct implication of including still image or video in computer-based listening tests. Language Testing, 24, 517–537.
  37. Plastina, A.F. (2013). Multimodality in English for specific purposes: Reconceptualizing meaning-making practices. LFE: Revista de Lenguas Para Finas Especificos, 19, 385-410
  38. Purdy, M. (1997). What is listening? In M.Purdy, & Borisoff, Listening in everyday life: A personal and professional approach (pp. 1-20). Lanham: University Press of America.
  39. Ruan, X. (2015). The role of multimodal in Chinese EFL studentsautonomous listening comprehension & multiliteracies. Theory and Practice in Language Studies, 5(3), 549-565.
  40. Shin, D. (1998). Using videotaped lectures for testing academic language. International Journal of Listening 12, 56-79.
  41. Suvorov, R. (2009). Context visuals in L2 listening test: the effects of photograph and video vs audio-only format. In C. Chapelle, H. Jun, &I. Katz, Developing and Evaluating Language Learning Materials (pp. 53-68). Ames: Iowa State University.
  42. Suvorov, R. (2014). The use of eye-tracking in research on video-based second language (L2) listening assessment: A comparison of context videos and content videos. Language Testing, 32 (4),463-483.
  43. Suvorov, R. (2015). Interacting with visuals in L2 listening test: An eye-tracking study. ARAGs Research Report Online: British Council.
  44. Taylor, R. & Geranpayeh, A. (2011). Assessing listening for academic purposes: Defining and operationalizing the academic construct. Journal of English for Academic Purposes, 10, 89-110.
  45. Ur, P. (1984). Teaching Listening Comprehension. Cambridge: Cambridge University Press.
  46. Vandergrift, L. (2004). Listening to learn or learning to listen? Annual Review of Applied Linguistics, 24, 3-25
  47. Vanderplank, R. (2013). “Effects of” and “effects with” captions: How exactly does watch a tv program with same-language subtitles make a difference to language learners? Language Teaching, 1-16.
  48. Vanderplank, R. (2016). The State of the Art I: Selected Research on Listening Comprehension and Vocabulary Acquisition. In Captioned Media in Foreign Language Learning and Teaching, 75-104. Palgrave: Macmillan.
  49. Wagner, E. (2008). Video listening tests: What are they measuring? Language Assessment Quarterly, 5/3, 218-243.
  50. Wagner, E. (2010). The effect of the use of video texts on ESL listening test-taker performance. Language Testing, 27, 493-513.
  51. Wagner, E. (2013). An Investigation of how the channel of input and access to test questions affect L2 listening test performance. Language Assessment Quarterly, 10(2),178-195
  52. Wang, J. & Miao, Y. (2003). Theory and method for EFL listening teaching. Computer-assisted Foreign Language Teaching, 8(2), 1-5.
  53. Winke, P., Gass, S., & Sydorenko, T. (2010). The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14(1), 65–86.
  54. Yang, J. C., & Chang, P. (2014). Captions and reduced forms instruction: The impact on EFL students’ listening comprehension. ReCALL : The Journal of EUROCALL, 26(1), 44-61.
  55. Zareaian, G., Adel, S. M. & Noghani, F. A. (2015). The effect of multimodal presentation on EFL Learners' listening comprehension and self-efficacy. Academic Research International, 6(1), 263-271.