Verbal, visual, and verbal-visual puns in translation: cognitive multimodal analysis

Keywords: cognitive translation analysis, domestication, foreignization, verbal pun, verbal-visual pun, visual pun

Abstract

This paper presents results of cognitive multimodal analysis of English to Ukrainian and English to Russian translations of verbal, visual and verbal-visual puns found in the American animated tragicomedy sitcom “BoJack Horseman”. We have found that translation of verbal puns presupposes overcoming constraints caused by linguacultural specificity of the pun-producing source-text linguistic expressions (idioms and/or allusions). Translation of visual puns entails constructing an illuminating verbal context, which facilitates interpretation of the images. Translation of verbal-visual puns, both those in which the incongruous conceptual structures are cued verbally, and the image dubs the text, and those in which one of the incongruent structures is cued verbally and the other is triggered visually, demands reconciling the image with the text on top of coping with linguacultural specificity. We have revealed that to render the analyzed puns the translators resort to three basic translation procedures: retention, reduction, and replacement. Literal translation resulting in retention of a pun leads to foreignization of the target text unless the recipients can be expected to infer the pun due to the impact of cultural globalization. In all analyzed cases, translators failed to retain pun meanings cued by the image. Reduction and replacement result in complete (causing a loss of a pun) compulsory (imposed by linguacultural constraints) domestication. Reduction instantiates as choosing a target-language expression that cues only one of the two incongruent conceptual structures engaged in a pun and replacement presupposes using a target-language expression that compensates for the loss of a pun by creating a different humorous stimulus. In a multimodal/multimedial context, a target-text verbal expression can be replaced by a verbal-visual one.

Downloads

Download data is not yet available.

References

Aleksandrova, E. (2020). Audiovisual translation of puns in animated films: strategies and procedures. European Journal of Humour Research, 7(4), 86-105. https://doi.org/10.7592/EJHR2019.7.4.
Attardo, S., & Raskin, V. (1991). Script theory revis(it)ed: Joke similarity and joke representation model. Humor: International Journal of Humor Research, 4(3/4), 293-348. https://doi.org/10.1515/humr.1991.4.3-4.293
Bezemer, J., & Kress, G. (2015). Multimodality, learning and communication. London, New York: Routledge.
Borodo, M. (2015). Multimodality, translation, and comics. Perspectives: Studies in Translation Theory and Practice, 23(1), 22-41. https://doi.org/10.1080/0907676X
Boria, M., Carreres, Á., Noriega-Sánchez, M., & Tomalin, M. (Eds.). (2020). Translation and multimodality: Beyond words. London, New York: Routledge.
Boria, M., & Tomalin, M. (2020). Introduction. In M. Boria, Á. Carreres, M. Noriega-Sánchez, & M. Tomalin M. (Eds.), Translation and multimodality: Beyond words (pp. 1-24). London, New York: Routledge.
Forceville, C. (1996). Pictorial metaphor in advertising. London: Routledge.
Forceville, C. (2002). Further thoughts on delimiting pictorial metaphor. Theoria et historia scientiarum, 6(1), 213-227. http://dx.doi.org/10.12775/ths.2002.009.
Forceville, C. (2009). Non-verbal and multimodal metaphor in a cognitive framework: agendas for research. In Ch. Forceville, & E. Urios-Aparisi (Eds.), Multimodal metaphor (pp. 19-42). Berlin & New York: Mouton de Gruyter.
Halliday, M. A. K. (1978). Language as social semiotic: The social interpretation of language and meaning. London: Edward Arnold.
Halliday, M. A. K. (1985). An introduction to functional grammar (1st ed.). London: Edward Arnold.
Hodge, R., & Kress, G. (1988). Social semiotics. Oxford: Polity Press.
Jakobson, R. (1959). On linguistic aspects of translation. In: R. Brower (Ed.), On translation (pp. 232-239). Cambridge, MA: Harvard University Press.
Jewitt, C. (Ed.). (2009). The Routledge handbook of multimodal analysis. London: Routledge.
Jewitt, C., Bezemer, J., & O’Halloran, K. (2016). Introducing multimodality. New York: Routledge.
Kaindl, K. (2004). Multimodality in the translation of humour in comics. In E. Ventola, C. Cassily, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 173-192). Amsterdam, Phil.: John Benjamins.
Kaindl, K. (2013). Multimodality and translation. In C. Millán, & F. Bartrina (Eds.), The Routledge Handbook of translation studies (pp. 257-270). London & New York: Routledge.
Kaźmierczak, M. (2017). Verbal-visual punning in translational perspective. Rocznik Komparatystyczny [Comparative Yearbook], 8, 121-150. https://doi.org/10.18276/rk.2017.8-06
Ketola, A. (2016). Towards a multimodally oriented theory of translation: A cognitive framework for the translation of illustrated technical texts. Translation Studies 9(1), 67-81. https://doi.org/10.1080/14781700.2015.1086670
Koestler, A. (1964). The act of creation. London: Hutchinson.
Kovalenko, L., & Martynyuk, A. (2018). English container metaphors of emotions in Ukrainian translations. Advanced Education, 5(10), 190-197. https://doi.org/10.20535/2410-8286.142723
Kövecses, Z. (2002). Metaphor: A practical introduction. Oxford: Oxford University Press.
Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. London: Routledge.
Kress, G., & van Leeuwen, T. (1996). Reading images: The grammar of visual design. London & New York: Routledge.
Kress, G., & van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. London: Arnold Publishers.
Krysanova, T., & Shevchenko, I. (2021). Conceptual blending in multimodal construction of negative emotions in film. In A. Pawelec, A. Shaw & G. Szpila (Eds.), Text-Image-Music: Crossing the borders. Intermedial conversations on the poetics of verbal, visual and musical texts. In Honour of Prof. Elzbieta Chrzanowska-Kluczewska (pp. 357–371). Berlin: Peter Lang. Retrieved from
https://www.peterlang.com/search?q1=krysanova%2C+shevchenko&searchBtn=
Lakoff, G. (1993). The contemporary theory of metaphor. In A. Ortony (Ed.), Metaphor and thought. 2nd ed. (pp. 202-251). Cambridge: Cambridge University Press.
Lukianova, T., & Ilchenko, A. (2019). Intersemiotic translation: meaning-making in film and musical art. In Cognition. Communication. Discourse, 19, 78-95. https://doi.org/10.26565/2218-2926-2019-19-05
Lukyanova, T., & Martynyuk, A. (2021). Rational and non-rational in multi-semiotic meaning making. In A. Pawelec, A. Shaw, & G. Szpila (Eds.), Text-Image-Music: Crossing the borders. Intermedial conversations on the poetics of verbal, visual and musical texts (pp. 341-355). Berlin: Peter Lang. Retrieved from
https://www.peterlang.com/view/9783631846698/html/ch36.xhtml
Luque, A. F. (2010). On the (mis/over/under)translation of the Max Brothers’ humour. In D. Chiaro (Ed.), Translation, humour and the media (pp. 175-192). London & New York: Continuum.
Marina, O. (2017). Parallax in poetry and painting: The “Craft of Rupture” or the art of paradox. In E. Chrzanowska-Kluczewska, & O. Vorobyova (Eds.), Language – literature – the arts: A cognitive-semiotic Interface. Text – meaning – context. (pp. 113-130). Frankfurt am Main: Peter Lang. Retrieved from
https://www.peterlang.com/view/9783631702505/xhtml/chapter05.xhtml
Martínez-Sierra, J. J. (2005). Translating audiovisual humour. A case study. Perspectives, 13(4), 289-296. https://doi.org/10.1080/09076760608668999.
Martynyuk, A. (2017). The art of metaphoric political insult within the cognitive framework. In E. Chrzanowska-Kluczewska, & O. Vorobyova (Eds.), Language – literature – the arts: A cognitive-semiotic Interface. Text – meaning – context. (pp. 245-260). Frankfurt am Main: Peter Lang.
Martynyuk, A., & Meleshchenko, O. (2019). Twitter-based multimodal metaphorical memes portraying Donald Trump. Lege artis. Language yesterday, today, tomorrow, 4(2), 128-167. Retrieved from https://lartis.sk/wp-content/uploads/2019/11/MartynyukMeleshchenko_Issue-2_2019.pdf
McGhee, P. (1979). Humor: Its Origin and Development. San Francisco: Freeman.
Morozova, O. (2017). Monomodal and multimodal instantiations of conceptual metaphors of Brexit. Lege artis. Language yesterday, today, tomorrow. The journal of University of SS Cyril and Methodius in Trnava, II (2), 250-283. https://doi.org/10.1515/lart-2017-0017
Minors, H. J. (Ed.). (2013). Music, text and translation. London: Bloomsbury.
O’Sullivan, C., & Cornu, J-F. (Eds.) (2019). The translation of films, 1900-1950. Oxford: Oxford University Press.
Pan, L. (2015). Multimodality and contextualization in advertisement translation: A case study of billboards in Hong Kong. The Journal of Specialized Translation, 23, 205-222. Retrieved from https://www.jostrans.org/issue23/art_li.pdfdoi
Pérez-González, L. (2014). Audiovisual translation: Theories, methods and issues. London & New York: Routledge.
Raskin, V. (1985). Semantic Mechanisms of Humor. Dordrecht: D. Reidel Publishing Company.
Shuttleworth, M. (2017). Studying Scientific Metaphor in Translation. Taylor & Francis.
Staley, R., & Derks, P. (1995). Structural incongruity and humor appreciation. Humor: International Journal of Humor Research, 8, 97-134. https://doi.org/10.1515/humr.1995.8.2.97
Suls, J. (1972). A Two-stage Model for the Appreciation of Jokes and Cartoons: An Information Processing Analysis. In J. Goldstein, & P. McGhee (Eds.), The psychology of humor. (pp. 81-100). New York: Academic Press.
Torop, P. (2019). The textual issues of meaning-making in theatre and film: a semiotic introduction. Cognition. Communication. Discourse, 19, 20-28. https://doi.org/10.26565/2218-2926-2019 19-02 .
Vorobyova, O. (2017). Virtual narrative in Virginia Wolf’s “A simple melody”: Cognitive and semiotic implications. In E. Chrzanowska-Kluczewska, & O. Vorobyova (Eds.), Language – literature – the arts: A cognitive-semiotic Interface. Text – meaning – context. (pp. 95-112). Frankfurt am Main: Peter Lang. Retrieved from: https://www.peterlang.com/view/9783631702505/xhtml/chapter04.xhtml
Zanettin, F. (Ed.). (2008). Comics in translation. Manchester: St Jerome Publishing.
Published
2021-08-02
How to Cite
Kovalenko, L., & Martynyuk, A. (2021). Verbal, visual, and verbal-visual puns in translation: cognitive multimodal analysis. Cognition, Communication, Discourse, (22), 27-41. https://doi.org/10.26565/2218-2926-2021-22-02