Your browser does not support the PubReader view.
Go to this page to see a list of supporting browsers.
Korean Society For Cognitive and Biological Psychology
[ Article ]
The Korean Journal of Cognitve & Biological Psychology - Vol. 30, No. 2, pp.113-139
ISSN: 1226-9654 (Print)
Print publication date 30 Apr 2018
Received 27 Feb 2018 Revised 24 Apr 2018 Accepted 24 Apr 2018
DOI: https://doi.org/10.22172/cogbio.2018.30.2.003

얼굴이모티콘 처리에 대한 역전효과: ERP 연구

박태진† ; 양예은 ; 김정희
전남대학교 심리학과
Inversion Effects on Face Emoticon Processing: An ERP Study
Taejin Park† ; Yaeeun Yang ; Junghee Kim
Department of Psychology, Chonnam National University

Correspondence to: †박태진, 전남대학교 심리학과, E-mail : tpark@jnu.ac.kr

초록

이모티콘은 온라인과 오프라인 소통에서 폭넓게 사용되고 있다. 얼굴이모티콘의 지각적 부호화가 얼굴-특수 구성적 처리에 의존하는지 밝히기 위해 자극 역전이 ERP성분 N170과 P1의 진폭과 정점 잠재기에 미치는 영향을 조사하였는데, N170은 얼굴에 민감하고 정위상 바른 얼굴보다 역전된 얼굴에 대해 진폭이 더 크고 잠재기가 더 지연되지만(N170-얼굴역전효과) P1은 저수준 시각적 속성에 민감한 것으로 알려져 있다. 얼굴이모티콘, 얼굴사진, 그리고 집아이콘을 정위상 바르게 또는 역전시켜 제시하고서 자극 윤곽선상 두 개 틈의 상대적 높이를 판단하도록 참가자에게 요구했다. N170과 P1의 평균진폭과 정점 잠재기를 분석한 결과는 다음과 같다. N170 진폭에 있어 얼굴이모티콘은 얼굴사진과 차이가 없었고, 두 얼굴유형 모두 집아이콘보다 더 부적이었으며(얼굴-민감 N170효과), 역전 정위와 바른 정위의 차이(역전효과)가 모든 자극유형에서 관찰되지 않았다. N170 정점 잠재기에 있어 얼굴이모티콘은 얼굴사진보다 더 짧았고 집아이콘과 차이가 없었는데, 이러한 잠재기상 차이는 역전 정위에서만 관찰되었다. N170 정점 잠재기와 관련된 역전효과가 두 얼굴유형 모두에서 관찰되었고(N170-얼굴역전효과) 집아이콘에서는 관찰되지 않았지만, 역전효과의 크기에 있어서는 얼굴사진이 얼굴이모티콘보다 더 컸고 얼굴이모티콘은 집아이콘과 차이가 없었다. P1의 진폭과 정점 잠재기는 얼굴-민감효과나 얼굴역전효과를 보이지 않았으며, 단지 자극들간 저수준 시각적 차이의 효과만을 보였다. 이러한 결과는 얼굴이모티콘의 지각적 부호화가 얼굴-민감 구성적 처리기전에 다소 의존하지만, 구성적 처리가 방해받는 역전 정위의 경우에는 집아이콘과 같이 사물-민감 지각기전에 주로 의존한다는 것을 시사한다.

Abstract

Emoticons are widely used for various offline and online communication. To investigate whether the perceptual encoding of face emoticon relies on the face-specific configural processing, we examined how stimulus inversion affects the amplitude and peak latency of face-sensitive ERP component N170 which is known to be larger and delayed in response to inverted than to upright human face (N170-face inversion effect; N170-FIE) as well as ERP component P1 which is known to be sensitive to low-level visual features. ERPs were recorded to upright and inverted face emoticons, face photos, and house icons which were surrounded by oval-shaped outline. Participants had to judge the relative height of two gaps on the outline. N170 was enhanced for face emoticons and face photos relative to house icons (face-sensitive N170 effect), and showed no amplitude difference between face emoticons and face photos. N170 amplitude was not affected by inversion for all types of experimental stimuli. N170 was delayed for face photos relative to face emoticons as well as house icons, and showed no latency difference between face emoticons and house icons. The aforesaid latency difference among experimental stimuli were found only for inverted stimuli. For face emoticons and face photos, N170 was delayed for inverted relative to upright faces (N170-FIE), but, no N170 peak latency-related inversion effect was found for house icons. However, the magnitude of inversion effect was largest for face photos, and showed no difference between face emoticons and house icons. The amplitude and peak latency of P1 showed neither face-sensitive effect nor FIE, and only showed the effect of low-level visual differences among experimental stimuli. These findings show that perceptual encoding of upright face emoticons can rely on face-sensitive configural processing mechanisms to a less degree than face photos, but perceptual encoding of inverted face emoticons can rely on object-sensitive perceptual mechanisms like house icons.

Keywords:

face emoticon, face inversion effect (FIE), face-sensitive effect, N170, P1

키워드:

얼굴이모티콘, 얼굴역전효과, 얼굴-민감효과, N170, P1

Acknowledgments

이 논문은 2014년 정부(교육부)의 재원으로 한국연구재단의 지원을 받아 수행된 연구임 (NRF-2014S1A5A2A01016925).

유익한 지적과 제언을 해주신 심사위원들, 그리고 ERP 데이터 수집과정에 기여한 강문희 양에게 감사를 표합니다.

References

  • Allison, T., Puce, A., Spencer, D. D., & McCarthy, G. (1999). Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cerebral Cortex, 9(5), 415-430. [https://doi.org/10.1093/cercor/9.5.415]
  • Bentin, S., Allison, T., Puce, A., Perez, E., & McCarthy, G. (1996). Electrophysiological studies of face perception in humans. Journal of Cognitive Neuroscience, 8(6), 551-565. [https://doi.org/10.1162/jocn.1996.8.6.551]
  • Bentin, S., Taylor, M. J., Rousselet, G. A., Itier, R. J., Caldara, R., Schyns, P. G., Jacques, C., & Rossion, B. (2007). Controlling interstimulus perceptual variance does not abolish N170 face sensitivity. Nature Neuroscience, 10, 801-802; author reply 802-803. [https://doi.org/10.1038/nn0707-801]
  • Boehm, S. G., Dering, B., & Thierry, G. (2011). Category-sensitivity in the N170 range: a question of topography and inversion, not one of amplitude. Neuropsychologia, 49(7), 2082-2089. [https://doi.org/10.1016/j.neuropsychologia.2011.03.039]
  • Bötzel, K., Schulze, S., & Stodieck, S. R. G. (1995). Scalp topography and analysis of intracranial sources of face-evoked potentials. Experimental Brain Research, 104, 135-143. [https://doi.org/10.1007/BF00229863]
  • Carmel, D., & Bentin, S. (2002). Domain specificity versus expertise: factors influencing distinct processing of faces. Cognition, 83(1), 1-29. [https://doi.org/10.1016/S0010-0277(01)00162-7]
  • Cauquil, A. S., Edmonds, G. E., & Taylor, M. J. (2000). Is the face-sensitive N170 the only ERP not affected by selective attention? Neuroreport, 11(10), 2167-2171. [https://doi.org/10.1097/00001756-200007140-00021]
  • Churches, O., Nicholls, M., Thiessen, M., Kohler, M., & Keage, H. (2014). Emoticons in mind: An event-related potential study. Social Neuroscience, 9(2), 196-202. [https://doi.org/10.1080/17470919.2013.873737]
  • Dering, B., Martin, C. D., Moro, S., Pegna, A. J., & Thierry, G. (2011). Face-sensitive processes one hundred milliseconds after picture onset. Frontiers in Human Neuroscience, 5:93. doi: 10.3389/fnhum.2011.00093. [https://doi.org/10.3389/fnhum.2011.00093]
  • Eimer, M. (2000). The face-specific N170 component reflects late stages in the structural encoding of faces. Neuroreport, 11(10), 2319-2324. [https://doi.org/10.1097/00001756-200007140-00050]
  • Eimer, M. (2011). The face-sensitive N170 component of the event-related brain potential. In The Oxford Handbook of Face Perception (pp. 329-344). Oxford: Oxford University Press. [https://doi.org/10.1093/oxfordhb/9780199559053.013.0017]
  • Eimer, M., & Holmes, A. (2002). An ERP study on the time course of emotional face processing. Neuroreport, 13(4), 427-431. [https://doi.org/10.1097/00001756-200203250-00013]
  • Gauthier, I., Curran, T., Curby, K. M., & Collins, D. (2003). Perceptual interference supports a nonmodular account of face processing. Nature Neuroscience, 6, 428-432. [https://doi.org/10.1038/nn1029]
  • Gratton, G., Coles, M. G., & Donchin, E. (1983). A new method for offline removal of ocular artifact. Electroencephalography and Clinical Neurophysiology, 55(4), 468-484. [https://doi.org/10.1016/0013-4694(83)90135-9]
  • Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4(6), 223-233. [https://doi.org/10.1016/S1364-6613(00)01482-0]
  • Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2002). Human neural systems for face recognition and social communication. Biological Psychiatry, 51(1), 59-67. [https://doi.org/10.1016/S0006-3223(01)01330-0]
  • Henson, R. N., Goshen-Gottstein, Y., Ganel, T., Otten, L. J., Quayle, A., & Rugg, M. D. (2003). Electrophysiological and haemodynamic correlates of face perception, recognition and priming. Cerebral Cortex, 13(7), 793-805. [https://doi.org/10.1093/cercor/13.7.793]
  • Herrmann, M. J., Ehlis, A. C., Ellgring, H., & Fallgatter, A. J. (2005). Early stages (P100) of face perception in humans as measured with event-related potentials (ERPs). Journal of Neural Transmission. 112, 1073-1081. [https://doi.org/10.1007/s00702-004-0250-8]
  • Itier, R. J., & Taylor, M. J. (2004). N170 or N1? Spatiotemporal differences between object and face processing using ERPs. Cerebral Cortex, 14(2), 132-142. [https://doi.org/10.1093/cercor/bhg111]
  • Itier, R. J., Alain, C., Sedore, K., & McIntosh, A. R. (2007). Early face processing specificity: It’s in the eyes! Journal of Cognitive Neuroscience, 19, 1815-1826. [https://doi.org/10.1162/jocn.2007.19.11.1815]
  • Itier, R. J., Latinus, M., & Taylor, M. J. (2006). Face, eye and object early processing: What is the face specificity? NeuroImage, 29, 667-676. [https://doi.org/10.1016/j.neuroimage.2005.07.041]
  • Kanwisher, N., McDermott, J., & Chun, M. M. (1997). The fusiform face area: a module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17(11), 4302-4311. [https://doi.org/10.1523/JNEUROSCI.17-11-04302.1997]
  • Kappenman, E. S., & Luck, S. J. (2012). The Oxford Handbook of Event-Related Potential Components. Oxford University Press.
  • Kendall, L. N., Raffaelli, Q., Kingstone, A., & Todd, R. M. (2016). Iconic faces are not real faces: enhanced emotion detection and altered neural processing as faces become more iconic. Cognitive Research: Principles and Implications, 1:19. doi: 10.1186/s41235-016-0021-8. [https://doi.org/10.1186/s41235-016-0021-8]
  • Krombholz, A, Schaefer, F, & Boucsein, W. (2007). Modification of N170 by different emotional expression of schematic faces. Biological Psychology, 76, 156-162. [https://doi.org/10.1016/j.biopsycho.2007.07.004]
  • Kuefner, D., deHeering, A., Jacques, C., Palmero-Soler, E., & Rossion, B. (2010). Early visually evoked electrophysiological responses over the human brain (P1, N170) show stable patterns of face-sensitivity from 4 years to adulthood. Frontiers in Human Neuroscience, 3:67. doi: 10.3389/neuro.09.067.2009. [https://doi.org/10.3389/neuro.09.067.2009]
  • McCarthy, G., Puce, A. Belger, A., & Allison, T. (1999). Electrophysiological studies of human face perception. II: Response properties of face-specific potentials generated in occipitotemporal cortex. Cerebral Cortex, 9, 431-444. [https://doi.org/10.1093/cercor/9.5.431]
  • Nakashima, T., Kaneko, K., Goto, Y., Abe, T., Mitsudo, T., Ogata, K, Makinouchi, A., & Tobimatsu, S. (2008). Early ERP components differentially extract facial features: Evidence for spatial frequency-and-contrast detectors. Neuroscience Research, 62, 225-235. [https://doi.org/10.1016/j.neures.2008.08.009]
  • Oken, B. S., Chiappa, K. H., & Gill, E. (1987). Normal temporal variability of the P100. Electroencephalography and Clinical Neurophysiology/ Evoked Potentials, 68(2), 153-156. [https://doi.org/10.1016/0168-5597(87)90042-6]
  • Picton, T. W., Bentin, S., Berg, P., Donchin, E., Hillyard, S. A., Johnson, R. Jr., Miller, G. A., Ritter, W., Ruchkin, D. S., Rugg, M. D., & Taylor, M. J. (2000). Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. Psychophysiology, 37, 27-152. [https://doi.org/10.1111/1469-8986.3720127]
  • Rakover, S. S.　（2013). Explaining the face-inversion effect: the face-scheme incompatibility (FSI) model. Psychonomic Bulletin, 20, 665-692. [https://doi.org/10.3758/s13423-013-0388-1]
  • Rhodes, G., Brake, S., & Atkinson, A. P. (1993). What’s lost in inverted faces. Cognition, 47, 25-57. [https://doi.org/10.1016/0010-0277(93)90061-Y]
  • Rosburg, T., Ludowig, E., Dümpelmann, M., Alba-Ferrara, L., Urbach, H., & Elger, C. E. (2010). The effect of face inversion on intracranial and scalp recordings of event-related potentials. Psychophysiology, 47, 147-157. [https://doi.org/10.1111/j.1469-8986.2009.00881.x]
  • Rossion, B., & Jacques, C. (2008). Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170. NeuroImage, 39(4), 1959-1979. [https://doi.org/10.1016/j.neuroimage.2007.10.011]
  • Rossion, B., Delvenne, J. F., Debatisse, D., Goffaux, V., Bruyer, R., Crommelinck, M., & Guerit, J. M. (1999). Spatio-temporal localization of the face inversion effect: An event-related potentials study. Biological Psychology, 50, 173-189. [https://doi.org/10.1016/S0301-0511(99)00013-7]
  • Rossion, B., Gauthier, I., Tarr, M. J., Despland, P., Bruyer, R., Linotte, S., et al. (2000). The N170 occipito-temporal component is delayed and enhanced to inverted faces but not to inverted objects: An electrophysiological account of face specific processes in the human brain. NeuroReport, 11, 69-74. [https://doi.org/10.1097/00001756-200001170-00014]
  • Rossion, B., Joyce, C. A., Cottrell, G. W., & Tarr, M. J. (2003). Early lateralization and orientation tuning for face, word, and object processing in the visual cortex. Neuroimage, 20, 1609-1624. [https://doi.org/10.1016/j.neuroimage.2003.07.010]
  • Rossion, B., Kung, C. C., Tarr, M. J. (2004). Visual expertise with nonface objects leads to competition with the early perceptual processing of faces in the human occipitotemporal cortex. Proceedings Of The National Academy Of Sciences Of The United States Of America, 101(40), 14521-14526. [https://doi.org/10.1073/pnas.0405613101]
  • Sadeh, B., & Yovel, G. (2010). Why is the N170 enhanced for inverted faces? An ERP competition experiment. Neuroimage, 53, 782-789. [https://doi.org/10.1016/j.neuroimage.2010.06.029]
  • Sagiv, N., & Bentin, S. (2001). Structural encoding of human and schematic faces: Holistic and part-based processes. Journal of Cognitive Neuroscience, 13, 937-951. [https://doi.org/10.1162/089892901753165854]
  • Suzuki, M., & Noguchi, Y. (2013). Reversal of the face-inversion effect in N170 under unconscious visual processing. Neuropsychologia, 51, 400-409. [https://doi.org/10.1016/j.neuropsychologia.2012.11.021]
  • Taylor, M. J., Edmonds, G. E., McCarthy, G., & Allison, T. (2001). Eyes first! Eye processing develops before face processing in children. Neuroreport, 12(8), 1671-1676. [https://doi.org/10.1097/00001756-200106130-00031]
  • Tecce, J. J. (1972). Contingent negative variation (CNV) and psychological processes in man. Psychological Bulletin, 77, 73-108. [https://doi.org/10.1037/h0032177]
  • Thierry, G., Martin, C. D., Downing, P., & Pegna, A. J. (2007). Controlling for interstimulus perceptual variance abolishes N170 face selectivity. Nature Neuroscience. 10, 505-511. [https://doi.org/10.1038/nn1864]
  • Van Belle, G., De Graef, P., Verfaillie, K., Rossion, B., & Lefèvre, P. (2010). Face inversion impairs holistic perception: Evidence from gaze-contingent stimulation. Journal of Vision, 10(5), 1-13. [https://doi.org/10.1167/10.5.10]
  • van Rijn, H., Kononowicz, T. W., Meck, W. H., Ng, K. K., & Penney, T. B. (2011). Contingent negative variation and its relation to time estimation: a theoretical evaluation. Frontiers in Integrative Neuroscience, 5:91. doi: 10.3389/fnint.2011.00091. [https://doi.org/10.3389/fnint.2011.00091]
  • Walter, W. G., Cooper, R., Aldridge, V. J., McCallum, W. C., & Winter, A. L. (1964). Contingent negative variation: An electric sign of sensorimotor association and expectancy in the human brain. Nature, 203, 380-384. [https://doi.org/10.1038/203380a0]
  • Wang, M. Y., Kuo, B. C., & Cheng, S. K. (2011). Chinese characters elicit face-like N170 inversion effects. Brain & Cognition. 77, 419-431. [https://doi.org/10.1016/j.bandc.2011.08.016]
  • Woodman, G. F. (2010). A brief introduction to the use of event-related potentials (ERPs) in studies of perception and attention. Attention and Perceptual Psychophysiology, 72(8), 1-29. [https://doi.org/10.3758/BF03196680]
  • Woodman, G. F. (2010). A brief introduction to the use of event-related potentials (ERPs) in studies of perception and attention. Attention, Perception, & Psychophysics, 72(8), 2031-2046. [https://doi.org/10.3758/BF03196680]
  • Young, A. W,, Hellawell, D., & Hay, D. C. (1987). Configurational information in face perception. Perception. 16(6), 747-59. [https://doi.org/10.1068/p160747]
  • Yovel, G. & Kanwisher, N. (2005). The neural basis of the face-inversion effect. Current Biology, 15, 2256-2262. [https://doi.org/10.1016/j.cub.2005.10.072]