政大機構典藏-National Chengchi University Institutional Repository(NCCUR):Item 140.119/152934

政大典藏 > College of Communication > Master`s Program in Digital Content and Technologies > Theses > Item 140.119/152934

Please use this identifier to cite or link to this item: https://nccur.lib.nccu.edu.tw/handle/140.119/152934

Title:	以跨模態可塑性建構色彩感知之可行性研究 Exploring the Feasibility of Enhancing Color Perception through Cross-modal Plasticity
Authors:	連彥筑 Lien, Yen-Chu
Contributors:	鄭霈絨廖峻鋒 Cheng, Pei-Jung Liao, Chun-Feng 連彥筑 Lien, Yen-Chu
Keywords:	色彩認知色彩學習經驗跨模態可塑性實體使用者介面 color cognition color learning experience cross-modal plasticity tangible user interface
Date:	2024
Issue Date:	2024-08-05 14:53:45 (UTC+8)
Abstract:	本研究旨在了解人們在喪失視覺的情況下，是否能透過跨模態可塑性(Cross- modal Plasticity) 而產生感官間的交互、共感與補償等方式來接收色彩資訊，並進一􏰂認知與感受色彩。因􏰀，本研究參考「聲音—色彩」對應關係的研究，製作一套具備實體化使用者介面概念的色彩體驗輔具，讓使用者能透過聲音裝置反饋色卡上所對應的色彩，進而鼓勵他們主動探索並在互動的過程中認知與感受每一張色卡上的色彩。本研究分別邀請 10 位「􏰁常視力者」矇眼與 12 位「視覺障礙者」進行色彩體驗實驗，來探究跨模態可塑性應用在喪失視覺狀態的可行性。本研究於實驗前、後進行半結構式訪談，並以質性分析方法探討兩組受測者在色彩體驗實驗後，其色彩認知、跨模態可塑性與學習經驗上的差異。研究結果顯示:(1)無論是視力力􏰁常者或視覺障礙者，在喪失視覺感官時，均能夠透過跨模態的可塑性，以聽覺來接收色彩資訊;(2)他們在實際操作色彩體驗實驗輔具前均能建立「聲音-色彩」之對應概念，並在多次操作輔具後，能夠自主判斷不同色卡上的色彩差異;(3)實體使用者介面之立即反饋特性，能夠讓受測者快速比較不同色卡的聲音差異來認知色彩;(4)無論是視力力􏰁常者或視覺障礙者，在操作色彩體驗實驗輔具後都增加了使用「比較詞」的詞彙數量來描述色彩;(5)部分視覺障礙者認為透過色彩體驗實驗之輔具自主學習色彩，能夠幫助自己進行更廣泛的溝通，並能進一􏰂運用色彩來抒發心情。 This study aims to understand whether, in the condition of vision absence, people can receive color information through cross-modal plasticity, which involves sensory interaction, synesthesia, and compensation. By referencing research on the 'sound- color' correspondence, this study developed a color experience assistive device with a tangible user interface concept. This device allows users to receive feedback on the corresponding colors of color cards through a sound device, encouraging them to actively explore and interactively perceive and experience the colors on each card. The study invited 10 'sighted' individuals with blindfolds and 12 'visually impaired' individuals to participate in color experience experiments to explore the feasibility of applying cross-modal plasticity in the condition of vision absence. Semi- structured interviews were conducted before and after the experiment, and qualitative analysis methods were used to explore the differences in color perception, cross-modal plasticity, and learning experiences between the two groups of participants after the color experience experiment. The research results show that: (1) Both sighted individuals and visually impaired individuals can receive color information through auditory perception via cross-modal plasticity when they lose their visual sense; (2) They can establish a 'sound-color' correspondence concept before using the color experience assistive device and, after multiple uses, can independently recognize the color differences on different color cards; (3) The immediate feedback characteristic of the tangible user interface allows participants to quickly compare the sound differences of different color cards to recognize colors; (4) Both sighted and visually impaired individuals increased the use of 'comparative adjectives' to describe colors after using the color experience assistive device; (5) Some visually impaired individuals believe that independently learning colors through the color experience assistive device can help them communicate more broadly and further use colors to express their emotions.
Reference:	中文部分 Philip G. Zimbardo（1990）。心理學（游恆山譯），五南。山中俊夫（2003）。色彩學的基礎（黃書倩譯），六合出版社。（原著出版年：1997）王寶祥（2014）。探討視聽共感覺－以音樂節奏與色彩配色為例（未出版之碩士論文）。崑山科技大學視覺傳達設計研究所。宋誌凱、鄭霈絨、郭晉谷、陳立杰（2022）。擴增實境教材與平面教材對於幼兒認知物體特徵的影響。數位學習科技期刊，14(3)，29-56。李宜蓁（2021）。繪圖工具對國小學童之學習動機與繪畫表現的影響（未出版之碩士論文）。國立政治大學數位內容碩士學位學程。杞昭安（2014）。視覺障礙學生色彩聯想之研究。障礙者理解半年刊 13(1)，21-31。林昆範（2008）。色彩的視覺與應用。科技發展期刊，428(8)，62-69。林書堯（1977）。色彩認識論。三民書局。林素淳（2013）。色彩的共感覺應用於兒童無字圖畫書創作研究－以交響樂「彼得與狼」為例（未出版之碩士論文）。國立台灣藝術大學圖文傳播藝術學系碩士班。林演慶、伊彬（2001）。色彩與樂音色聽共感覺之認知差異研究。2001色彩研討會—色彩設計，應用科學論文集。國立台灣藝術教育館。胡惠君（2007）。具象與抽象之間－保羅克利的繪畫表現形式研究（未出版之碩士論文）。國立新竹教育大學美術教育研究所。財團法人愛盲基金會（2023）。〈認識視障朋友〉。取自： https://www.tfb.org.tw/web/news/about_qa.jsp，取用日期：2023年6月19日。高慶珍（2001）。地圖設計之色彩應用探討。華岡理科學報，18(200105)，111-123。許天治（1986）。藝術溝通。台北省立博物館。郭冠英（2000）。異端影音煉金術。唐山出版社。野村順一（1998）。色彩的秘密－最新色彩學入門。東京：文藝春秋出版社。陳佳安、周遵儒（2018）。運用資料探勘於自動化色彩語意分析之研究。設計研究學報， 11 (201810) ，17-36。陳姿瑀、林芳穗（2019）。情緒表情符號的色彩認知之研究。2019ICWVCD視覺傳達設計國際研討會暨工作營論文集， 2019 (201911) ，41-50。陳韻文、歐聖榮（2018）。聽覺與視覺間的韻律關係及其共感覺之初探。中興大學園藝學系。43(2)，105-117。黃淑雅（2000）。音樂與形色關係之研究。2000年色彩應用與色彩科學研討會論文集。國立台灣藝術教育館。新北勞動雲（2022年4月18日）。〈視覺障礙介紹〉。取自：https://ilabor.ntpc.gov.tw/page/visually-impaired，取用日期：2023年6月18日。葉豐輝、洪錫銘、陳如音、王冠婓（1998）。視覺障礙者的色彩概念與學習經驗研究。「色彩與人生」學術研討會論文集（下），273-296。劉亦岑、林廷宜（2001）。聲音與色彩的轉換之研究。亞細亞基礎造型聯合學會之韓國大會。韓國：漢城。劉珮茹（2011）。Dollus：一個利用實體使用者介面的社交網路服務（未出版之碩士論文）。國立臺北科技大學資訊工程系研究所。潘亨利（2016）。色彩情感與色彩調和之應用研究 - 以手機應用程式介面設計為例（未出版之碩士論文）。國立臺灣科技大學色彩與照明科技研究所。鄭國裕、林磐聳（1990）。色彩計畫。藝風堂出版社。魏傲雪（2016）。淺析視覺傳達設計中色彩的功能性。青春歲月，7，140。蘇文清、嚴貞、李傳房（2006）。聲音與色彩意象之共感覺研究－以中國氣鳴樂器吹孔類（笛與簫）為例。人文暨社會科學期刊，2(2)，13-23。英文部分 Adria E. N, Hoover, Laurence R. Harris, & Jennifer K. E. Steeves (2011). Sensory compensation in sound localization in people with one eye. Experimental Brain Research, 216, 565–574. https://doi.org/10.1007/s00221-011-2960-0 Alary F, Duquette M, Goldstein R, Elaine Chapman C, Voss P, La Buissonnière-Ariza V,& Lepore F (2009). Tactile acuity in the blind: a closer look reveals superiority over the sighted in some but not all cutaneous tasks. Neuropsychologia, 47(10):2037-43. doi: 10.1016/j.neuropsychologia.2009.03.014 Amedi A, Raz N, Pianka P, Malach R, & Zohary E. (2003). Early ‘visual’ cortex activation correlates with superior verbal memory performance in the blind. Nat Neurosci, 6, 758–766 . https://doi.org/10.1038/nn1072 Anupkumar Palsokar & C. S. Warnekar (2016) A RGB-HSI Conversion Based Model to Map the Colour Perception into Audio Equivalent to Assist Visually Impaired Persons. 2016 IEEE 6th International Conference on Advanced Computing (IACC), Bhimavaram, 484-487, doi: 10.1109/IACC.2016.96. Bavelier, D., & Neville, H. (2002). Cross-modal plasticity: where and how?. Nat Rev Neurosci, 3, 443–452. https://doi.org/10.1038/nrn848 Birren & Faber (1961). Colour Psychology & Colour Therapy. Secaucus, N. J: The Citadel Press. Burton H, Snyder AZ, Conturo TE, Akbadak E, Ollinger JM, & Raichle ME (2002). Adaptive changes in early and late blind: A fMRI study of Braille reading. J Neurophysio, 87(1), 589–607. https://doi.org/10.1152/jn.00285.2001 Chung-Heon Lee, Muhammad Shahid Jabbar, & Jun-Dong Cho (2020). ColorWatch: Color-Tactile Interpretation to Improve Color Perception and Accessibility for People with Visual Impairments. 2020 International Conference on Information and Communication Technology Convergence (ICTC), 2020, 1632-1637, doi: 10.1109/ICTC49870.2020.9289427. Cook, J. L., & Cook, G. (2005). Child Development : Principles and perspectives. Pearson Education New Zealand. Cook, A. M. & Hussey, Susan M. (2000).《Assistive Technologies: Principles and Practice》. Sacramento California : Mosby Daphne Bavelier & Helen J Neville (2002). Cross-modal plasticity: where and how? Nat Rev Neurosci . 2002 Jun;3(6):443-52. doi: 10.1038/nrn848. Ericsson, K. A., & Simon, H. A.,(1996). Protocol Analysis: Using Verbal Reports as Data Second Printing, Oxford University Press, Cambrdge, M A. Hawellek DJ, Schepers IM, Roeder B, Engel AK, Siegel M,& Hipp JF (2013). Altered intrinsic neuronal interactions in the visual cortex of the blind. J Neurosci, 33(43):17072-80. doi: 10.1523/JNEUROSCI.1625-13.2013. Hiroshi Ishii, & Brygg Ulmer (1997). Tangible bits: towards seamless interfaces between people, bits and atoms. CHI '97: Proceedings of the ACM SIGCHI Conference on Human factors in computing systems, March 1997, 234–241. https://doi.org/10.1145/258549.258715 Hye-Young Park(2019). A Convergence Study on Music-color Association Responses of People with Visual Impairment Mediated by Emotion. Journal of the Korea Convergence Society, ISSN 2233-4890 10(5), 313-321 https://doi.org/10.15207/JKCS.2019.10.5.313 Ithai Rabinowitch, & Jihong Bai (2016). The foundations of cross-modal plasticity. Communicative & Integrative Biology, 9(2). https://doi.org/10.1080/19420889.2016.1158378 Jacob S. & Nakshian (1964). The Effects of Red and Green Surroundings on Behavior. The Journal of General Psycholog , 70(1), 143–161. . https://doi.org/10.1080/00221309.1964.9920584 Jundong Cho (2021). Multi-Sensory Interaction for Blind and Visually Impaired People.Electronics 2021, 10(24), 3170. https://doi.org/10.3390/electronics10243170 Karwoski, T. F., H. S. Odbert, & C. E. Osgood. (1942). Studies in synesthetic thinking : II. The role of form in visual responses to music. The Journal of General Psychology, 26(2), 199-222, DOI: 10.1080/00221309.1942.10545166 Langfeld, H. S. (1993). The historical development of response psychology. New Series, 77(1993), 243-250. Lazzouni L,& Lepore F (2014). Compensatory plasticity: time matters. Front Hum Neurosci. 2014 Jun 12;8, 340. doi: 10.3389/fnhum.2014.00340 Leclerc C, Saint-Amour D, Lavoie ME, Lassonde M, & Lepore F (2000) Brain functional reorganization in early blind humans revealed by auditory event-related potentials. Neuroreport, 11(3), 545-550. Lessard N, Paré M, Lepore F,& Lassonde M (1998). Early-blind human subjects localize sound sources better than sighted subjects. Nature. 1998 Sep 17;395(6699), 278-80. doi: 10.1038/26228 Liotti, M., Ryder, K., & Woldorff, M. G. (1998). Auditory attention in the congenitally blind: Where, when and what gets reorganized? Neuroreport: An International Journal for the Rapid Communication of Research in Neuroscience, 9(6), 1007–1012. https://doi.org/10.1097/00001756-199804200-00010 Markova, M. S., Wilson, S., & Stumpf, S. (2012). Tangible user interfaces for learning. International Journal of Technology Enhanced Learning, 4(3-4), 139-155. Martin Pielot, Niels Henze, Wilko Heuten, & Susanne Boll(2007). Tangible User Interface for the Exploration of Auditory City Maps. HAID 2007: Haptic and Audio Interaction Design, 86–97. https://doi.org/10.1007/978-3-540-76702-2_10 Michel Peeters, Carl Megens, Elise van den Hoven, Caroline Hummels, & Aarnout Brombacher (2013). Social Stairs: Taking the Piano Staircase towards Long-Term Behavioral Chang. International Conference on Persuasive Technology, PERSUASIVE 2013, 174–179. https://doi.org/10.1007/978-3-642-37157-8_21 Minichiello V., Aroni R., Timewell E. & Alexander L. (1995) In-depth Interviewing, Second Edition. South Melbourne: Longman. Mónica Carreño-León, J. Andrés Sandoval-Bringas, Teresita Alvarez-Robles, Rafael Cosio-Castro, Italia Estrada Cota, & Alejandro Leyva Carrillo(2020). Designing a Tangible User Interface for Braille Teaching. HCII 2020: HCI International 2020 – Late Breaking Papers: Universal Access and Inclusive Design, 197–207. https://doi.org/10.1007/978-3-030-60149-2_16 Neville HJ, & Lawson D (1987). Attention to central and peripheral visual space in a movement detection task. III. Separate effects of auditory deprivation and acquisition of a visual language. Brain Res. 1987 Mar 10;405(2):284-94. doi: 10.1016/0006-8993(87)90297-6 Norman, D. (2004). Emotional design : Why we love (or hate) everyday things. New York, Basic Books. O Collignon , M Davare, E Olivier, & A G De Volder (2009). Reorganisation of the right occipito-parietal stream for auditory spatial processing in early blind humans. A transcranial magnetic stimulation study. Brain Topogr . 2009 May;21(3-4), 232-40. doi: 10.1007/s10548-009-0075-8 Ptito M, Matteau I, Zhi Wang A, Paulson OB, Siebner HR,& Kupers R (2012). Crossmodal recruitment of the ventral visual stream in congenital blindness. Neural Plast, 2012:304045. doi: 10.1155/2012/304045 Rauschecker JP (1995). Compensatory plasticity and sensory substitution in the cerebral cortex. Trends Neurosci. 1995 Jan;18(1):36-43. Doi: 10.1016/0166-2236(95)93948-w Robert Holford Macdowall Bosanquet (1876). An Elementary Treatise On Musical Intervals And Temperament. an enharmonic organ exhibited to the Musical association of London. Röder, B., Teder-Sälejärvi, W., Sterr, A. et al. (1999). Improved auditory spatial tuning in blind humans. Nature, 400, 162–166. https://doi.org/10.1038/22106 Röder B, Stock O, Bien S, Neville H, & Rösler F. (2002). Speech processing activates visual cortex in congenitally blind humans. Eur J Neurosci, 16(5), 930–936. https://doi.org/10.1046/j.1460-9568.2002.02147.x Sofia Cavacoa, J. Tomás Henriquesb, Michele Menguccia, Nuno Correiaa, & Francisco Medeirosc (2013). Color sonification for the visually impaired. Procedia Technology 9, 1048-1057. https://doi.org/10.1016/j.protcy.2013.12.117 Theresa G. Mowad, Aimee E. Willett, Mani Mahmoudian, Mikhail Lipin1, Armin Heinecke, Albert M. Maguire, Jean Bennett1, & Manzar Ashtari. (2020). Compensatory Cross-Modal Plasticity Persists After Sight Restoration. Front Neurosci, 2020 May 12, 14, 291. doi: 10.3389/fnins.2020.00291 Veraart C, De Volder AG, Wanet-Defalque MC, Bol A, Michel C,& Goffinet AM (1990). Glucose utilization in human visual cortex is abnormally elevated in blindness of early onset but decreased in blindness of late onset. Brain Res ,510(1):115-21. doi: 10.1016/0006-8993(90)90735-t Voss, P. & Zatorre, R. J. (2012). Occipital cortical thickness predicts performance on pitch and musical tasks in blind individuals. Cerebral Cortex, 22(11), 2455–2465. https://doi.org/10.1093/cercor/bhr311 Weaver KE, Richards TL, Saenz M, Petropoulos H,& Fine I (2013). Neurochemical changes within human early blind occipital cortex. Neuroscience, 252:222-33. doi: 10.1016/j.neuroscience.2013.08.004 Weeks R, Horwitz B, Aziz-Sultan A, Tian B, Wessinger CM, Cohen LG, Hallett M, & Rauschecker JP(2000). A Positron emission tomographic study of auditory localization in the congenitally blind. Journal of Neuroscience, 20(7), 2664-2672. https://doi.org/10.1523/JNEUROSCI.20-07-02664.2000 Wittenberg GF, Werhahn KJ, Wassermann EM, Herscovitch P,& Cohen LG (2004). Functional connectivity between somatosensory and visual cortex in early blind humans. Eur J Neurosci, 20(7):1923-7. doi: 10.1111/j.1460-9568.2004.03630.x Yong Liu, Chunshui Yu, Meng Liang, Jun Li, Lixia Tian, Yuan Zhou, Wen Qin, Kuncheng Li, & Tianzi Jiang (2007). Whole brain functional connectivity in the early blind. Brain, 130(8), 2085–2096. https://doi.org/10.1093/brain/awm121
Description:	碩士國立政治大學數位內容碩士學位學程 110462010
Source URI:	http://thesis.lib.nccu.edu.tw/record/#G0110462010
Data Type:	thesis
Appears in Collections:	[Master`s Program in Digital Content and Technologies] Theses

Files in This Item:

File	Description	Size	Format
201001.pdf		4264Kb	Adobe PDF	0	View/Open

社群 sharing

Loading...