Loading...
|
Please use this identifier to cite or link to this item:
https://nccur.lib.nccu.edu.tw/handle/140.119/159271
|
| Title: | 表情符號與文字的情緒知覺交互作用
The Interaction on the Emotional Perception between Emojis and Texts |
| Authors: | 楊詠晴
Yang, Yung-Ching |
| Contributors: | 張葶葶
黃淑麗
Chang, Ting-Ting
Huang, Shwu-Lih
楊詠晴
Yang, Yung-Ching |
| Keywords: | 表情符號
情緒知覺
情緒效價一致性
喚起度
功能性磁振造影
電腦中介溝通
emoji
emotional perception
valence congruency
arousal
fMRI
computer-mediated communication |
| Date: | 2025 |
| Issue Date: | 2025-09-01 16:12:40 (UTC+8) |
| Abstract: | 表情符號已在數位溝通中被廣泛使用，能夠強化文字訊息的情緒表達。過去研究指出，當表情符號與文字的情緒效價一致時，有助於情緒理解；相反的，效價不一致的組合則可能使情緒判斷變得困難。然而，有關此類互動背後的神經機制，以及文字喚起度的調節作用，仍未被充分討論。本研究運用具生態效度且經過預先驗證的訊息材料，模擬日常聊天情境，並系統性操弄文字效價、文字喚起度與表情符號效價。三十三位參與者於功能性磁振造影掃描期間，依據2（文字效價）x 2（文字喚起度）x 2（表情符號效價）的重複量數設計，評估訊息發送者的情緒狀態。行為資料結果顯示，文字與表情符號一致的組合能引發更一致的情緒知覺，而不一致的組合則導致情緒知覺判斷較為模糊。文字喚起度進一步調節了這些效果：高喚起度的正向文字能減弱負向表情符號帶來的負面效果，而低喚起度的負向文字則更容易受到表情符號的詮釋影響。神經影像分析結果顯示，不一致刺激引發了語意衝突與情感整合相關腦區的顯著活化，包括前腦島、外側眶額葉皮質、輔助運動區及尾狀核。此外，高喚起文字亦涉及顳極、下顳回與內側額葉皮質，反映了注意力分配與情感處理的增強。綜合行為與神經層面的結果，本研究提供了一致證據，支持情緒效價與喚起度在多模態情感溝通中的動態交互作用，並凸顯大腦在自然情境下的電腦中介溝通中，對情感一致性與強度的敏感性。
Emojis have become pervasive in digital communication, enhancing emotional expression in text-based messages. Prior research has demonstrated that text-emoji congruency facilitates emotional interpretation, whereas incongruent pairings introduce ambiguity. However, the neural mechanisms underlying these interactions and the modulation of text arousal remain unclear. The present study addressed these gaps by employing ecologically valid, pre-validated message stimuli resembling everyday chat, systematically varying text valence, text arousal, and emoji valence. Thirty-three participants evaluated the sender’s emotional state while undergoing fMRI scanning in a 2 (text valence) x 2 (text arousal) x 2 (emoji valence) repeated-measures design. Behavioral results revealed that emotionally congruent text-emoji pairings elicited clearer emotional perception, whereas incongruent pairings increased ambiguity. Text arousal modulated these effects: high-arousal positive texts attenuated the negative texts were more susceptible to reinterpretation via emoji cues. Neuroimaging analyses demonstrated that incongruent stimuli elicited heightened activation in regions implicated in semantic conflict and emotional integration, including the anterior insula, lateral orbitofrontal cortex, supplementary motor area, and caudate. High arousal texts additionally engaged the temporal pole, inferior temporal gyrus, and medial frontal cortex, reflecting increased attentional and affective processing. These findings provide converging behavioral and neural evidence for the dynamic interaction between valence and arousal in multimodal emotional communication, highlighting the brain’s sensitivity to emotional congruency and intensity in naturalistic computer-mediated interactions. |
| Reference: | 李仁豪, & 鍾芯瑜. (2020). 中文版簡式 [五大人格量表] BFI 的發展. 測驗學刊 , 67 (4), 271-299.
Aldunate, N., Villena-Gonzalez, M., Rojas-Thomas, F., Lopez, V., & Bosman, C. A. (2018). Mood Detection in Ambiguous Messages: The Interaction Between Text and Emoticons. Front Psychol, 9, 423. https://doi.org/10.3389/fpsyg.2018.00423
Bai, Q., Dan, Q., Mu, Z., & Yang, M. (2019). A systematic review of emoji: Current research and future perspectives. Frontiers in psychology, 10, 2221.
Barrett, L. F. (2006). Are emotions natural kinds? Perspectives on psychological science, 1(1), 28-58.
Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological review, 108(3), 624.
Boutet, I., LeBlanc, M., Chamberland, J. A., & Collin, C. A. (2021). Emojis influence emotional communication, social attributions, and information processing. Computers in Human Behavior, 119. https://doi.org/10.1016/j.chb.2021.106722
Bradley, M. M., Codispoti, M., Sabatinelli, D., & Lang, P. J. (2001). Emotion and motivation II: sex differences in picture processing. Emotion, 1(3), 300.
Bradley, M. M., & Lang, P. J. (1999). Affective norms for English words (ANEW): Instruction manual and affective ratings.
Burrell, A., & Beard, R. (2023). Investigating playful punctuation in children’s narrative and persuasive writing. The Australian Journal of Language and Literacy, 46(2), 161-182.
Chatzichristos, C., Morante, M., Andreadis, N., Kofidis, E., Kopsinis, Y., & Theodoridis, S. (2020). Emojis influence autobiographical memory retrieval from reading words: An fMRI-based study. PLoS One, 15(7), e0234104. https://doi.org/10.1371/journal.pone.0234104
Citron, F. M. (2012). Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies. Brain and Language, 122(3), 211-226.
Cox, R. W. (1996). AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical research, 29(3), 162-173.
Craig, A. D. (2009). How do you feel—now? The anterior insula and human awareness. Nature reviews neuroscience, 10(1), 59-70.
Critchley, H. D., Wiens, S., Rotshtein, P., Öhman, A., & Dolan, R. J. (2004). Neural systems supporting interoceptive awareness. Nature neuroscience, 7(2), 189-195.
Daniel, T. A., & Camp, A. L. (2020). Emojis affect processing fluency on social media. Psychology of Popular Media, 9(2), 208.
Derks, D., Bos, A. E. R., & von Grumbkow, J. (2007). Emoticons and Online Message Interpretation. Social Science Computer Review, 26(3), 379-388. https://doi.org/10.1177/0894439307311611
Ekman, P. (1992). Facial expressions of emotion: New findings, new questions. In: SAGE Publications Sage CA: Los Angeles, CA.
Etkin, A., Egner, T., & Kalisch, R. (2011). Emotional processing in anterior cingulate and medial prefrontal cortex. Trends in cognitive sciences, 15(2), 85-93.
Ferré, P., Haro, J., Pérez-Sánchez, M. Á., Moreno, I., & Hinojosa, J. A. (2023). Emoji-SP, the Spanish emoji database: Visual complexity, familiarity, frequency of use, clarity, and emotional valence and arousal norms for 1031 emojis. Behavior Research Methods, 55(4), 1715-1733.
Filik, R., Ţurcan, A., Ralph-Nearman, C., & Pitiot, A. (2019). What is the difference between irony and sarcasm? An fMRI study. cortex, 115, 112-122.
Frith, C. D., & Frith, U. (2006). The neural basis of mentalizing. Neuron, 50(4), 531-534.
Ganster, T., Eimler, S. C., & Krämer, N. C. (2012). Same same but different!? The differential influence of smilies and emoticons on person perception. Cyberpsychology, Behavior, and Social Networking, 15(4), 226-230.
Grahn, J. A., Parkinson, J. A., & Owen, A. M. (2008). The cognitive functions of the caudate nucleus. Progress in neurobiology, 86(3), 141-155.
Hinojosa, J. A., Mercado, F., Albert, J., Barjola, P., Peláez, I., Villalba-García, C., & Carretié, L. (2015). Neural correlates of an early attentional capture by positive distractor words. Frontiers in psychology, 6, 24.
Jaeger, S. R., Roigard, C. M., Jin, D., Vidal, L., & Ares, G. (2019). Valence, arousal and sentiment meanings of 33 facial emoji: Insights for the use of emoji in consumer research. Food Research International, 119, 895-907.
Janssen, J. H., Ijsselsteijn, W. A., & Westerink, J. H. (2014). How affective technologies can influence intimate interactions and improve social connectedness. International Journal of Human-Computer Studies, 72(1), 33-43.
John, O. P., Donahue, E. M., & Kentle, R. L. (1991). The big five inventory—versions 4a and 54. In: Berkeley, CA: University of California, Berkeley, Institute of Personality ….
John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big Five trait taxonomy: History, measurement, and conceptual issues.
Kanske, P., & Kotz, S. A. (2011). Emotion speeds up conflict resolution: a new role for the ventral anterior cingulate cortex? Cerebral cortex, 21(4), 911-919.
Kaye, L. K., Rodriguez-Cuadrado, S., Jones, B. R., Malone, S. A., & Wall, H. J. (2020). Do emoji enhance emotional processing of written language?
Kensinger, E. A., & Corkin, S. (2004). Two routes to emotional memory: Distinct neural processes for valence and arousal. Proceedings of the National Academy of Sciences, 101(9), 3310-3315.
Kralj Novak, P., Smailović, J., Sluban, B., & Mozetič, I. (2015). Sentiment of emojis. PloS one, 10(12), e0144296.
Kringelbach, M. L., & Rolls, E. T. (2004). The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Progress in neurobiology, 72(5), 341-372.
Lang, P. J., Greenwald, M. K., Bradley, M. M., & Hamm, A. O. (1993). Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30(3), 261-273.
Lee, L.-H., Li, J.-H., & Yu, L.-C. (2022). Chinese EmoBank: Building valence-arousal resources for dimensional sentiment analysis. Transactions on Asian and Low-Resource Language Information Processing, 21(4), 1-18.
Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., & Barrett, L. F. (2012). The brain basis of emotion: a meta-analytic review. Behavioral and brain sciences, 35(3), 121-143.
Lithari, C., Frantzidis, C., Papadelis, C., Vivas, A. B., Klados, M., Kourtidou-Papadeli, C., Pappas, C., Ioannides, A., & Bamidis, P. (2010). Are females more responsive to emotional stimuli? A neurophysiological study across arousal and valence dimensions. Brain topography, 23(1), 27-40.
Lo, S. K. (2008). The nonverbal communication functions of emoticons in computer-mediated communication. Cyberpsychol Behav, 11(5), 595-597. https://doi.org/10.1089/cpb.2007.0132
Lundqvist, L.-O., & Dimberg, U. (1995). Facial expressions are contagious. Journal of psychophysiology, 9, 203-203.
Manganari, E. E. (2021). Emoji Use in Computer-Mediated Communication. The International Technology Management Review, 10(1). https://doi.org/10.2991/itmr.k.210105.001
Mar, R. A., Oatley, K., Djikic, M., & Mullin, J. (2011). Emotion and narrative fiction: Interactive influences before, during, and after reading. Cognition & Emotion, 25(5), 818-833.
Menon, V., & Uddin, L. Q. (2010). Saliency, switching, attention and control: a network model of insula function. Brain structure and function, 214, 655-667.
Miller, H., Thebault-Spieker, J., Chang, S., Johnson, I., Terveen, L., & Hecht, B. (2016). “Blissfully happy” or “ready tofight”: Varying interpretations of emoji. Proceedings of the international AAAI conference on web and social media,
Nachev, P., Kennard, C., & Husain, M. (2008). Functional role of the supplementary and pre-supplementary motor areas. Nature reviews neuroscience, 9(11), 856-869.
Ochsner, K. N., Hughes, B., Robertson, E. R., Cooper, J. C., & Gabrieli, J. D. (2009). Neural systems supporting the control of affective and cognitive conflicts. Journal of cognitive neuroscience, 21(9), 1841-1854.
Olson, I. R., Plotzker, A., & Ezzyat, Y. (2007). The enigmatic temporal pole: a review of findings on social and emotional processing. Brain, 130(7), 1718-1731.
Park, T. W., Kim, S.-J., & Lee, G. (2014). A study of emoticon use in instant messaging from smartphone. International Conference on Human-Computer Interaction,
Pfeifer, V. A., Armstrong, E. L., & Lai, V. T. (2022). Do all facial emojis communicate emotion? The impact of facial emojis on perceived sender emotion and text processing. Computers in Human Behavior, 126. https://doi.org/10.1016/j.chb.2021.107016
Picard, N., & Strick, P. L. (2001). Imaging the premotor areas. Current opinion in neurobiology, 11(6), 663-672.
Prada, M., Rodrigues, D. L., Garrido, M. V., Lopes, D., Cavalheiro, B., & Gaspar, R. (2018). Motives, frequency and attitudes toward emoji and emoticon use. Telematics and Informatics, 35(7), 1925-1934. https://doi.org/10.1016/j.tele.2018.06.005
Recio, G., Conrad, M., Hansen, L. B., & Jacobs, A. M. (2014). On pleasure and thrill: The interplay between arousal and valence during visual word recognition. Brain and Language, 134, 34-43.
Robus, C. M., Hand, C. J., Filik, R., & Pitchford, M. (2020). Investigating effects of emoji on neutral narrative text: Evidence from eye movements and perceived emotional valence. Computers in Human Behavior, 109. https://doi.org/10.1016/j.chb.2020.106361
Rodrigues, D., Prada, M., Gaspar, R., Garrido, M. V., & Lopes, D. (2018). Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions. Behav Res Methods, 50(1), 392-405. https://doi.org/10.3758/s13428-017-0878-6
Rolls, E. T. (2004). The functions of the orbitofrontal cortex. Brain and cognition, 55(1), 11-29.
Rozin, P., & Royzman, E. B. (2001). Negativity bias, negativity dominance, and contagion. Personality and social psychology review, 5(4), 296-320.
Russell, J. A. (1980). A circumplex model of affect. Journal of personality and social psychology, 39(6), 1161.
Sander, D., Grafman, J., & Zalla, T. (2003). The human amygdala: an evolved system for relevance detection. Reviews in the Neurosciences, 14(4), 303-316.
Scheffler, T., & Nenchev, I. (2024). Affective, semantic, frequency, and descriptive norms for 107 face emojis. Behavior Research Methods, 56(8), 8159-8180.
Scherr, S. A., Polst, S., Müller, L., Holl, K., & Elberzhager, F. (2019). The Perception of Emojis for Analyzing App Feedback. International Journal of Interactive Mobile Technologies (iJIM), 13(02). https://doi.org/10.3991/ijim.v13i02.8492
Schmahmann, J. D. (2019). The cerebellum and cognition. Neuroscience letters, 688, 62-75.
Seeley, W. W., Menon, V., Schatzberg, A. F., Keller, J., Glover, G. H., Kenna, H., Reiss, A. L., & Greicius, M. D. (2007). Dissociable intrinsic connectivity networks for salience processing and executive control. Journal of neuroscience, 27(9), 2349-2356.
Tang, Y., & Hew, K. F. (2019). Emoticon, emoji, and sticker use in computer-mediated communication: A review of theories and research findings. International Journal of Communication, 13, 27.
Tso, R. V.-y., & To, M. W.-h. (2020b). Ambiguity in Text Messages:“I Hate You for Using Emojis Inconsistently With Your Text in WhatsApp”. Proceedings of the Annual Meeting of the Cognitive Science Society,
Van Rijn, S., Aleman, A., Van Diessen, E., Berckmoes, C., Vingerhoets, G., & Kahn, R. S. (2005). What is said or how it is said makes a difference: role of the right fronto‐parietal operculum in emotional prosody as revealed by repetitive TMS. European Journal of Neuroscience, 21(11), 3195-3200.
Walther, J. B., & D’addario, K. P. (2001). The impacts of emoticons on message interpretation in computer-mediated communication. Social Science Computer Review, 19(3), 324-347.
Warriner, A. B., Kuperman, V., & Brysbaert, M. (2013). Norms of valence, arousal, and dominance for 13,915 English lemmas. Behavior Research Methods, 45, 1191-1207.
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of personality and social psychology, 54(6), 1063.
Weissman, B., & Tanner, D. (2018). A strong wink between verbal and emoji-based irony: How the brain processes ironic emojis during language comprehension. PLoS One, 13(8), e0201727.
Yang, J., Yang, Y., Xiu, L., & Yu, G. (2021). Effect of emoji prime on the understanding of emotional words – evidence from ERPs. Behaviour & Information Technology, 1-10. https://doi.org/10.1080/0144929x.2021.1874050
Yuasa, M., Saito, K., & Mukawa, N. (2011). Brain activity when reading sentences and emoticons: an fMRI study of verbal and nonverbal communication. Electronics and Communications in Japan, 94(5), 17-24. https://doi.org/10.1002/ecj.10311 |
| Description: | 碩士
國立政治大學
心理學系
108752010 |
| Source URI: | http://thesis.lib.nccu.edu.tw/record/#G0108752010 |
| Data Type: | thesis |
| Appears in Collections: | [心理學系] 學位論文
|
Files in This Item:
| File |
Size | Format | |
|---|
| 201001.pdf | 11849Kb | Adobe PDF | 0 | View/Open |
|
All items in 政大典藏 are protected by copyright, with all rights reserved.
|
