Xorijiy lingvistika va lingvodidaktika –
Зарубежная лингвистика и
лингводидактика – Foreign
Linguistics and Linguodidactics
Journal home page:
https://inscience.uz/index.php/foreign-linguistics
Exploring polycodic texts: a study of semiotic resources
and cognitive dynamics
Kamola ODILOVA
1
Uzbekistan State World Languages University
ARTICLE INFO
ABSTRACT
Article history:
Received September 2024
Received in revised form
10 October 2024
Accepted 25 October 2024
Available online
25 November 2024
This article examines the images of policodic texts as part of
linguistic cognition between This article examines the role of
polycodic texts in linguistic cognition, exploring the interplay
between visual, verbal, and auditory elements. The interaction
between language and cognition has long been a central theme in
linguistic studies, particularly as communication increasingly
adopts multimodal forms. This shift highlights the need to
understand the cognitive processes involved in our interactions
with such texts, positioning them as a fertile ground for scientific
research. Challenging conventional assumptions, the article
introduces polycodic text analysis as a platform to reveal how the
intertwining of different codes shapes ontogenetic insights. This
provides valuable resources for understanding the dynamics of
modern
communication
and
the
transformation
of
expressiveness in an era where poetic, multimodal meanings
create new values. The article begins by defining polycodic texts
and explaining their significance in linguocognitive research.
It then demonstrates how these texts challenge the boundaries
set by traditional linguistic frameworks for understanding
meaning-making through different semiotic modalities.
A notable observation in the article is that such intermodality
fosters deeper interpretations, reflecting the additional cognitive
processing required to synthesize various types of information
in meaning creation (Almeida, 2011; Kress, 2010). Additionally,
its theoretical frameworks – cognitive linguistics and multimodal
discourse – serve as excellent foundations for examining the
linguistic and non-linguistic elements that coexist in polycodic
texts. These frameworks emphasize the embodiment of language
and thought, demonstrating how linguistic structures are
grounded in perceptual experiences and conceptual schemas.
Furthermore, the article delves into linguistic aspects of
polycodic texts, such as the flexibility of syntactic structures and
Keywords:
polycodie texts,
linguo-cognitive aspects,
multimodal,
cognitive linguistics,
communication,
semiotic resources,
interpretation,
code.
1
PhD Student, Uzbekistan State World Languages University. Tashkent, Uzbekistan. E-mail: kt.odilova@uzswlu.uz
Xorijiy lingvistika va lingvodidaktika – Зарубежная лингвистика
и лингводидактика – Foreign Linguistics and Linguodidactics
Special Issue – 5 (2024) / ISSN 2181-3701
184
the impact of code-switching habits on speakers. Polycodic texts
offer a richer interpretative experience by blending diverse
semiotic resources, thereby involving deeper and more intricate
cognitive
associations.
In conclusion, this study enhances our understanding of the
semiotic modes and cognitive processes that underpin the
complexity of communication in contemporary life.
2181-3701/© 2024 in Science LLC.
DOI:
https://doi.org/10.47689/2181-3701-vol2-iss5
This is an open-access article under the Attribution 4.0 International
(CC BY 4.0) license (
https://creativecommons.org/licenses/by/4.0/deed.ru
Polikodli matnlarni o‘rganish: semiotik resurslar va
kognitiv dinamikani o‘rganish
ANNOTATSIYA
Kalit so‘zlar:
polikodli matnlar,
lingvokognitiv aspektlar,
multimodallik,
kognitiv tilshunoslik,
kommunikatsiya,
semiotik resurslar,
interpretatsiya,
kod.
Ushbu maqolada polikodli matnlar obrazlari vizual va verbal
hamda audial matnlar o‘rtasidagi lisoniy kognitivlikning bir
qismi sifatida tadqiq etiladi. Til va kognitsiyaning uzoq vaqt
davomida o‘zaro ta’siri tilni o‘rganishda, ayniqsa, muloqot tobora
ko‘p modulli shakllarni qabul qilayotganda markaziy mavzudir.
Bu esa bunday matnlar bilan o‘zaro munosabatlarimizda
o‘ynashga kirishadigan kognitiv jarayonlarni tushunish
zarurligini ta’kidlaydi va ularni ilmiy tadqiqot uchun unumli
zamin sifatida qaraydi. Ushbu taxminlarni shubha ostiga olgan
holda, maqola polikod matnining tahlilini turli xil kodlarning
qo‘shilishi qanday qilib ontogenetik idrokni shakllantirishini
ochib berish uchun maydon sifatida kiritadi, bu esa tobora
ko‘proq qadriyatlar poetik multimodal ma’nolar bilan
yaratilayotgandek tuyulgan davrda zamonaviy kommunikatsiya
dinamikasi va ekspressivlik transformatsiyasini tushunish
uchun resurs beradi.
Maqola polikodli matnlar nima ekanligi va nima uchun ular
lingvokognitiv tadqiqotlarda muhimligini tushuntirishdan
boshlanadi, keyin esa polikodli matnlar turli semiotik
modalliklar orqali ma’no birgalikda qanday tuzilishini tushunish
uchun til ramkalari o‘rnatadigan chegaralarni qanday shubha
ostiga qo‘yishini ko‘rsatadi. Maqolaning qiziqarli jihati shundaki,
bunday intermodallik chuqurroq talqinlarga yordam beradi,
ma’no yaratishda turli xil ma’lumotlarni sintez qilish uchun zarur
bo‘lgan qo‘shimcha kognitiv ishlov berishni aks ettiradi
(Almeida, 2011; Kress, 2010). Bundan tashqari, uning nazariy
asoslari – kognitiv tilshunoslik va ko‘p modulli diskurs polikod
matnlarida mavjud bo‘lgan lingvistik va nolingvistik
elementlarni tadqiq qilish uchun ajoyib asos bo‘lib xizmat qiladi.
Ushbu ramkalar til va fikrning mujassamligini ta’kidlaydi, chunki
til tuzilmalarining ochilishi perseptiv kechinmalar va konseptual
sxemalarga tayanadi.
Xorijiy lingvistika va lingvodidaktika – Зарубежная лингвистика
и лингводидактика – Foreign Linguistics and Linguodidactics
Special Issue – 5 (2024) / ISSN 2181-3701
185
Bundan tashqari, maqolada polikod matnlarining sintaktik
tuzilmalarning moslashuvchanligi va so‘zlovchilarda kod-
svitching odatlarining ta’siri kabi ba’zi lingvistik jihatlariga
e’tibor qaratilgan. Polikod matnlari turli semiotik manbalarning
chalkashligi tufayli boyroq talqin tajribasini taklif qiladi va
boyroq va chuqurroq kognitiv assotsiatsiyalarni o‘z ichiga oladi.
Xulosa qilib aytganda, ushbu tadqiqot zamonaviy hayotda
muloqotning murakkabligini tavsiflashda ishtirok etadigan
semiotik
modalar
va
kognitiv
jarayonlar
haqidagi
tushunchamizni boyitadi.
Изучение поликодных текстов: изучение семиотических
ресурсов и когнитивной динамики
АННОТАЦИЯ
Ключевые слова:
поликодовые тексты,
лингвокогнитивные
аспекты,
мультимодальность,
когнитивная лингвистика,
коммуникация,
семиотические ресурсы,
интерпретация,
код.
Данная статья посвящена исследованию поликодовых
текстов как части языковой когниции, проявляющейся на
пересечении визуальных, вербальных и аудиальных форм.
Взаимодействие языка и когниции долгое время остается
центральной темой лингвистических исследований,
особенно в условиях, когда коммуникация приобретает все
более многомодальный характер. Это подчеркивает
важность изучения когнитивных процессов, участвующих в
восприятии таких текстов, и открывает новые перспективы
для научного анализа.
В статье предлагается рассматривать поликодовые
тексты как пространство для исследования того, как
взаимодействие различных кодов формирует осмысление, а
также служит инструментом для анализа динамики
современной
коммуникации
и
изменения
форм
выразительности. В эпоху, когда мультимодальные формы
приобретают все большее значение, внимание к этим
процессам становится особенно актуальным.
Исследование начинается с определения поликодовых
текстов
и
обоснования
их
значимости
в
лингвокогнитивных исследованиях. Оно демонстрирует,
как такие тексты размывают границы, задаваемые
языковыми рамками, и позволяют лучше понять, как
значения формируются в процессе взаимодействия
различных семиотических модальностей. Уникальная
особенность поликодовых текстов заключается в их
способности
стимулировать
более
глубокие
интерпретации, требующие дополнительной когнитивной
обработки для синтеза разнообразной информации
(Almeida, 2011; Kress, 2010).
Теоретическая основа исследования опирается на
когнитивную лингвистику и многомодальный дискурс, что
позволяет всесторонне рассмотреть взаимодействие
лингвистических и нелингвистических элементов в
Xorijiy lingvistika va lingvodidaktika – Зарубежная лингвистика
и лингводидактика – Foreign Linguistics and Linguodidactics
Special Issue – 5 (2024) / ISSN 2181-3701
186
поликодовых текстах. Эти подходы акцентируют внимание
на воплощенности языка и мышления, показывая, как
языковые структуры опираются на перцептивный опыт и
концептуальные схемы.
Кроме того, в статье анализируются лингвистические
аспекты
поликодовых
текстов,
включая
гибкость
синтаксических структур и влияние привычек код-свитчинга.
Поликодовые тексты обогащают интерпретацию благодаря
разнообразию семиотических ресурсов, создавая более
глубокие когнитивные ассоциации.
В заключение, данное исследование способствует
расширению понимания семиотических модальностей и
когнитивных процессов, лежащих в основе современной
коммуникации, и раскрывает сложность взаимодействий в
мультимодальном пространстве.
INTRODUCTION
The interaction of language and cognition has long been a central theme in linguistic
research, especially in the field of multimodal texts, which simultaneously employ several
codes, such as visual, verbal, and auditory elements. As communication increasingly
manifests in multifaceted forms, understanding the cognitive processes that govern our
interactions with these texts becomes paramount. Multimodal texts serve as a rich area for
research, as they not only challenge traditional concepts of semiotics but also engage
cognitive abilities that underlie the creation of meaning. By examining the cognitive
mechanisms at work in the perception of multimodal texts, we can gain a deeper
understanding of the dynamics of modern communication and the evolution of linguistic
expression in an increasingly multimodal world [Kononko 2015: 215]. In this article, we aim
to analyze the linguocognitive dimensions inherent in these texts to shed light on how the
integration of different codes shapes understanding and interpretation. Ultimately, by
investigating the cognitive mechanisms involved in the perception of multimodal texts, we
can gain deeper insight into the dynamics of modern communication and the evolution of
linguistic expression in an increasingly multimodal world.
DEFINITION
AND
SIGNIFICANCE
OF
MULTIMODAL
TEXTS
IN
LINGUOCOGNITIVE RESEARCH
The concept of multimodal texts, which integrates several modes of communication
– such as visual, linguistic, and auditory elements – plays a key role in linguocognitive
research. These texts challenge traditional linguistic frameworks, demonstrating how
meaning is co-constructed through diverse semiotic resources. The interaction between
these modalities allows for richer interpretations and enhances cognitive processing, as
individuals synthesize different forms of information to extract meaning. For example, in
educational contexts, multimodal texts facilitate deeper learning by engaging students'
cognitive abilities through visual means alongside textual content, making abstract
concepts more accessible. Moreover, by analyzing how people interact with these
multifaceted texts, one can identify the cognitive strategies used in the process of
comprehension and communication, revealing the complex relationship between language
and thought. Thus, understanding multimodal texts is fundamental to advancing theories
within linguistics and cognitive science, illustrating the dynamic interaction between
language and cognition in a multicultural and multimedia society.
Xorijiy lingvistika va lingvodidaktika – Зарубежная лингвистика
и лингводидактика – Foreign Linguistics and Linguodidactics
Special Issue – 5 (2024) / ISSN 2181-3701
187
THEORETICAL FOUNDATION
When studying the complex relationships between language and cognition in
multimodal texts, it is necessary to draw upon established linguistic theories that explain
how meaning is constructed and interpreted by different audiences. Theoretical
frameworks such as cognitive linguistics and multimodal discourse analysis provide a solid
foundation for analyzing the linguistic and non-linguistic elements coexisting in these
texts. Cognitive linguistics asserts that language is an integral part of human cognition,
positing that our understanding of linguistic structures is based on perceptual experiences
and conceptual schemas that can be crucial in deciphering complex layers of meaning in
multimodal texts [Maslova 2011: 87]. Simultaneously, multimodal discourse analysis
emphasizes the significance of visual and auditory components, recognizing that
communication extends beyond verbal language and encompasses multiple modes of
expression. Thus, utilizing these frameworks allows for a comprehensive examination of
how language interacts with cognition and context in the realm of multimodal texts.
COGNITIVE LINGUISTICS AND ITS RELEVANCE FOR MULTIMODAL TEXTS
The complex interrelationships between cognitive linguistics and multimodal texts
open up significant avenues for understanding how meaning is created and interpreted
through various modes of communication. Viewing language through the lens of cognition
enables researchers and practitioners to analyze how speakers and writers construct
meaning not only through words but also through the interplay of images, sounds, and
other semiotic elements inherent in multimodal texts. This interdisciplinary approach
offers a more nuanced understanding of how individuals process information, emdiv
thoughts, and negotiate meanings in diverse communicative contexts. Furthermore,
theories of cognitive linguistics, such as conceptual metaphor theory and embodied
cognition, can elucidate how these texts prompt readers to engage with complex ideas,
fostering deeper cognitive connections and emotional responses.
Ultimately, the significance of multimodalism lies in its ability to shape and
reinterpret communication landscapes in deep ways.
CONCLUSION
In conclusion, the study of linguo-cognitive aspects in policodic texts reveals the
complex interrelationships between language, thinking, and multi-modal communication.
The dynamic interaction of verbal and nonverbal elements in these texts reflects not only
a practical necessity, but also a deep cognitive involvement that shapes understanding of
the content. As noted in this study, the effectiveness of policode texts largely depends on
their ability to intertwine language with images, sound, and other semiotic resources,
thereby improving the interpretation framework of the recipients. Moreover, the cognitive
processes activated during the perception of such texts demonstrate not only the
universality of human understanding
REFERENCES:
1.
Vinogradov, V. V. Cognitive Linguistics: Theory and Practice. Moscow: Science, 2002.
2.
Maslova, V. A. Linguocognitive Approach in Language Research. Petersburg: RGPU
named after A. I. Gersen, 2011.
3.
Kononko, I. A. Policode texts and their perception in modern society.
Ekaterinburg: Ural State University, 2015.
4.
Kirillova, E. S. Multimodal discourses in linguistics. Novosibirsk: Siberian
University Publishing House, 2018.
5.
Subetto, L. N. Cognitive Semantics: Fundamental Ideas and Approaches. Rostov-
on-Don: Phoenix, 2019.
