Public smiling in photographs probably started in the 1920s. Photography just took too long for people to hold a smile in the early years of photography. So, they sat still instead of sitting happy. Then photos got faster and people started to smile for those photos. But, probably most if not all of us suspect people actually did smile prior to 1920. We just don’t have photo-documentation. And way long ago, George Washington probably didn’t smile for his portrait because his ivory-tooth dentures hurt.
Dr. David Cook eloquently pondered smiles on Facebook recently saying “The stunning smile lowers perception as it raises pulse; the beautiful smile inspires as it lifts spirits. One smile owns you; one frees you. One you see; one sees you. One absorbs; one reflects. One is of the flesh; one, of the heart. The stunning smile too quickly fades; the beautiful smile shines on and on.”1
Ya gotta love a good smile. That assumes you can recognize a smile. Can everyone tell the difference between a wry smile suggesting some deeper internal knowledge and a big grin?
Ayn Rand described faces at length in her writings. In The Fountainhead, Rand describes Dominique Francon: “She did not smile, but her face had the lovely serenity that can become a smile without transition.” Or, in describing what Dagny Taggart saw upon opening her eyes after crashing at Galt’s Gulch in Atlas Shrugged: “It was a face that had nothing to hide or to escape, a face with no fear of being seen or of seeing, so that the first thing she grasped about him was the intense perceptiveness of his eyes—he looked as if his faculty of sight were his best-loved tool and its exercise were a limitless, joyous adventure, as if his eyes imparted a superlative value to himself and to the world—to himself for his ability to see, to the world for being a place so eagerly worth seeing.” 2
What wonderful language to describe smiles, eyes and faces and the significance of faces. Even without the language skills to describe a smile to others with that mastery of imagery, can everyone identify that level of nuance in a smile or other facial expression? What does it suggest if you can’t? Are you too shy or not interested in others? Maybe you share attributes with some syndrome like Aspergers. Maybe you slide a little further up the autism spectrum scale than some of the rest of us.3,4 Or, maybe, possibly, something interfered with specific visual face-identifying ability development.
The philosopher Emmanuel Levinas thought human relationship and responsibility to the other person both spring from insight occurring primarily in face-to-face encounters. In that face, we find another person’s vulnerabilities and receive commands to not harm. It is in the face that class distinctions fade, and from which the Word of God can emanate. It is very difficult to dispose of a person who we have seen face-to-face. In that face-to-face contact, relationship, and actually humanity, starts and is maintained. 5 The vision science expresses the same thoughts less eloquently when it notes that faces convey fundamental social cues such as social intentions using direction of gaze and emotional states in expressions.6
Face-identification ability is specific.7,8,9,10 Humans have a specific face identification area of the brain, known in research as the FFA: the Fusiform Face Area.7,8,11 The FFA is in the right hemisphere of the brain. Prior to the age of two, the two hemispheres don’t communicate through the corpus callosum as completely as they will later.7 The left eye early on, then, provides the vast majority of the visual input to the right hemisphere. Later on communication between the hemispheres increases.
Visual neurology – all neurology – requires the correct or appropriate input to develop. Block the proper stimulus that would drive neural development of specific areas at a time of rapid neural growth, and development of the neural network involved is impaired. The FFA is no different. If the input from the left eye very early in development is impaired, as in congenital cataract, development of the FFA can be impaired.7,8,9,10,12 Even though the cataract is removed as early as medically feasible or recommended (not the case in some third-world situations), since infant brains are actively wiring, input to the FFA can be impaired, and therefore its functions impaired.
Recognizing faces develops over time in normal humans.9 The basics are wired in early: Newborns detect and respond to eyes-nose-mouth. That limited face schematic of the newborn develops into fairly adult face processing, if we view faces as a whole – a Gestalt – by six years of age.13,14 That Gestalt – the gluing of individual features together into a solid whole – is different from recognizing nuance. Nuance is recognizing subtle changes in position and spacing of the disparate parts of the whole.8,9,13,14,15,16,17,18,19
Nuance takes time. Adult face recognition is completed sometime after 14 years of age. When are the really active periods of neural development? We don’t know, other than very general statements like the changes are probably rapid early and slow down maybe in the teens.7
The vision science analogizes how we detect faces by describing the human face as a horizontal bar code.20,21 So, just for the moment, imagine checking out at the grocery store with half of each bar code covered. Before losing that visual, let’s look at the neurological development of the ability to detect and discriminate faces and the nuance of the wry smile.
The face discrimination timeline
Eyes, nose, mouth, maybe eyebrows and chin are wired in at birth and infants respond to that combination. At 5 months, infants can detect exaggerations in changes in face detail spacing.22 Maybe that’s why we all think we need to exaggerate our expressions in “talking” to an infant. Blocking input to the FFA with a congenital cataract up to 2 to 6 months of age range interferes with recognizing changes in spacing of facial features – so maybe the change in the corner of the mouth in smiling, but not in recognizing external facial contours. Delaying visual input by as little as 2 months results in permanent deficits.22
The classic way in which we describe how we see – visual acuity; 20/20, etc – is unrelated to that loss of detecting nuance, and 9 more years of development after cataract surgery doesn’t fix it.7 Being able to detect differences between pairs of faces (shown experimentally to early cataract sufferers) will continue to improve to adult levels, but maybe not the detail spacing in a single face. Differentiating face versus non-face is not affected by several years of early cataract blindness, taking just a few weeks of visual experience to develop after the cataracts are removed.7
Again, the very basics are wired in. Maybe not so much the nuance shown on a single face and maybe not the emotions represented by facial expression. For example, infant-cataract sufferers, having had cataracts removed appropriately, are worse at lip reading than age-matched people who did not have early cataracts, but not worse at other visual tasks tested. Higher order face processing, probably carrying nuance, only develops if right hemisphere development is initiated in early infancy.23
Around 6 years of age, that gluing together of parts of faces into a whole – the Gestalt – is coming to adult levels, and that is important in distinguishing individual faces. Detecting external contours and sets of features is almost at adult levels, paralleling the maturation of visual sensitivities such as contrast sensitivity and peripheral vision. But, those extra sets of features also suffer distraction from paraphernalia such as glasses and hats.22 Different points of view, clothing and lighting influence recognition, and 6-year-olds rely on external features such as hair for recognizing faces as familiar faces. However, face perception is driven by inner facial features, especially the eyes and mouth.13
Rapid changes in development occur between 7 and 11 years of age; that is, the elementary school years.14 The brain regions involved in face detection are actually smaller than in adults but are developing. General perception of spacing of details in objects is developing and at 8 years old, with unlimited time to observe, accuracy of detecting nuance is pretty good. Between 9 and 11 years old, the switch from relying on external features (face contour, hair, head shape) to relying on recognizing internal features occurs. And, recognizing spacing nuance of features is becoming more adult-like. That recognition of nuance is still not at adult levels at 14 years old, though.22
Fear expressed in an observed face seems to be an exception to some of this. Fearful facial expressions are thought to project more directly to the amygdala, the area of the brain at least in part responsible for detecting fearful stimuli or perhaps separating fearful from non-fearful stimuli. Historically the amygdala has been associated with the “fight or flight” reflex. The amygdala employs more coarse visual data (lower spatial frequencies than the FFA) and emotion-attached memories in determining appropriate response.21 This perhaps suggests this fearful-expression pathway is a sort-of early warning pathway passing on perception of a fearful situation from a parent to a child; maybe, “We’re in trouble, pay attention!”
Adult expectations and injury
As an adult, the expectation is that nuance in the spacing of face features in addition to relying on processing of contours and features will provide reliable recognition of faces, including from different angles, with different lighting, and changes in some of the paraphernalia (new hair style). And recognizing the wry smile, of course.
Damage to the occipitotemporal region (the FFA) of the right hemisphere of the brain can selectively remove the ability to recognize faces. The inability to recognize faces is termed prosopagnosia. In a 20+ year-old patient, known as LG, who suffers from developmental prosopagnosia, laboratory perceptual learning therapies could not improve face detection, and only slightly improved object recognition.24 Taken as a whole, if something interferes with development of the FFA, or if injury happens, full function in its role as the face recognition center may not be developable or may not be recoverable at our current understanding of neurological therapies.
Special cases – Autism
Autism provides a special case in looking at face recognition.3,4 As tested at around 8 to 9 years of age, autism biases the process of recognizing faces away from holistic – whole face Gestalt – processing. Debate continues as to whether that problem with holistic face processing represents a shift in processing, or perhaps reflects less motivation to develop expertise in face detection. That reduced motivation would be from a lack of reward from social interaction.
So, which comes first? Is it a neurological bias away from normal FFA processing, or does altered ability to achieve meaningful reward in social interaction change how faces are perceived? If it is the latter, does that suggest risk in altering social interaction in children? In high-functioning autistic adults, the research is unsettled as to whether holistic face processing is slowed, or whether reaction times in a laboratory test situation are just slower.
Implications for life with public health mandates affecting children
In June, 1964, the Declaration of Helsinki was put together to address principles to be used in human experimentation. The Helsinki Declaration declared the individual right to self-determination and to make informed decisions regarding participation in research. With children, the parents are first in line for informed consent, and then children must also express assent to any research. Individual welfare must always take precedence over the interests of society (and science). 25
In research language, the face has been described as a horizontal bar code. As with scanning at the grocery store, if that bar code is crushed together or otherwise distorted perpendicular to the bars, the poor checker will have to manually enter the numbers corresponding to the item with the bar code. What happens if half the code is missing? What happens if the majority of faces seen by a child are half-faces, faces missing the bottom half of the facial bar code?
When we surround children with mask-wearers for a year at a time, are we impairing their face barcode recognition during a period of hot neural development, thus putting full development of the FFA at risk? Does the demand for separation from others, reducing social interaction, add to the potential consequences as it might in autism? When can we be sure that we won’t interfere with visual input to the face recognition visual neurology so we don’t interfere with brain development? How much time with stimulus interference can we allow without consequences? Those are all questions currently without answers; we don’t know. Unfortunately, the science implies that if we mess up brain development for faces, we may not currently have therapies to undo everything we’ve done.
The question in the development of face recognition is: What could long-term mask mandates on children do? Another way to phrase the question is, given the development of abilities to discriminate faces and nuances in faces and emotions that show in faces, based on specific face-discrimination neurology in a specific area of the brain, what year-long (and growing) period of time do you want to take the risk of impairing by surrounding children with masked faces while limiting social interaction?
Further, are mask mandates human experimentation without opportunity for informed consent by the adults and assent by the children?
When will we know? It could be years. Should we anticipate a generation of children who display some sort of impaired face-detection ability suggestive of autism, maybe without actual autism? Perhaps. And what if the one facial detection ability that seems to survive unimpaired is the detection of fear, directly projecting to the amygdala? Do we breed a generation of children who first and foremost see fear in faces, perhaps inappropriately? We hope not.
The wry smile. That subtle twist of the corner of the mouth, perhaps with some change in the distance between eyes and brows suggesting “I get it. I know you. I understand the situation. It’s OK with me,” and maybe there’s an edge of humor. Not the belly laugh. The dry humor. The “Let me wait a moment until you get the joke” look. That look that says we’re comfortable together and enjoying each other.
Were we knowledgeable in putting neural development at risk? Much of that is unknowable since we can only speculate on what might have been. How sad it would be if even a part of a generation saw faces as Ayn Rand described hopeless people at the end of Atlas Shrugged: “Empty, hopeless, unfocused faces…but no one could read their meaning.”
References
1) Cook D. accessed 1/7/2021 https///www.facebook.com/photo.php?fbid=5273831262642140&set=a.2073018439390121&type=3
2) Excerpt From: Ayn Rand. “Ayn Rand Novel Collection.” Apple Books. https://books.apple.com/us/book/ayn-rand-novel-collection/id453567861
3) Watson TL. *Implications of holistic face processing in autism and schizophrenia Frontiers in Psychology | Perception Science July 2013 | Volume 4 | Article 414 | 10 doi: 10.3389/fpsyg.2013.00414 www.frontiersin.org
4) Nishimura M, Rutherford MD, Daphne Maurer D. Converging evidence of configural processing of faces in high-functioning adults with autism spectrum disorders VISUAL COGNITION, 2008, 16 (7), 859-891
5) Gunderman R, Masking Humanity: Emmanuel Levinas and the Pandemic, https://lawliberty.org/masking-humanity-emmanuel-levinas-and-the-pandemic/ last accessed 3/18/2021
6) Goffaux, V., van Zon, J., & Schiltz, C. (2011). The horizontal tuning of face perception relies on the processing of intermediate and high spatial frequencies. Journal of Vision, 11(10):1, 1–9, http://www.journalofvision.org/content/11/10/1, doi:10.1167/11.10.1.
7) LeGrande R, Mondlach CJ, Maurer D, Brent HP Expert face processing requires visual input to the right hemisphere during infancy
8) Cheryl L. Grady, Catherine J. Mondloch, Terri L. Lewis, Daphne Maurer Early visual deprivation from congenital cataracts disrupts activity and functional connectivity in the face network Neuropsychologia 57 (2014) 122–139
9) Catherine J. Mondloch, Richard Le Grand and Daphne Maurer EARLY VISUAL EXPERIENCE IS NECESSARY FOR THE DEVELOPMENT OF SOME-BUT NOT ALL ASPECTS OF FACE PROCESSING In: The Development of Face Processing in Infancy and Early Childhood ISBN 1-59033-696-8 Editors: Olivier Pascalis and Alan Slater, pp. 99·117 © 2003 Nova Science Publishers, Inc. Chapter 8
10) Brigitte Röder, Pia Ley, Bhamy H. Shenoy, Ramesh Kekunnaya, and Davide Bottari Sensitive periods for the functional specialization of the neural system for human face processing PNAS | October 15, 2013 | vol. 110 | no. 42 16760–16765 www.pnas.org/cgi/doi/10.1073/pnas.1309963110
11) Nancy Kanwisher, Josh McDermott, and Marvin M. Chun The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception The Journal of Neuroscience, June 1, 1997, 17(11):4302–4311.
12) Tapan K. Gandhi, Amy Kalia Singh, Piyush Swami, Suma Ganesh, and Pawan Sinha Emergence of categorical face perception after extended early-onset blindness PNAS | June 6, 2017 | vol. 114 | no. 23 | 6139–6143 www.pnas.org/cgi/doi/10.1073/pnas.1616050114
13) Catherine J Mondloch, Richard Le Grand, Daphne Maure Configural face processing develops more slowly than featural face processing Perception, 2002, volume 31, pages 553 – 566 DOI:10.1068/p3339
14) Catherine J. Mondloch Anishka Leis and Daphne Maurer Recognizing the Face of Johnny, Suzy, and Me: Insensitivity to the Spacing Among Features at 4 Years of Age Child Development, January/February 2006, Volume 77, Number 1, Pages 234 – 243
15) Catherine J Mondloch Rachel Robbins1⁄2, Daphne Maurer Discrimination of facial features by adults, 10-year-olds, and cataract-reversal patients Perception, 2010, volume 39, pages 184 -194 doi:10.1068/p6153
16) Daniel W. Piepers, Rachel A. Robbins A review and clarification of the terms “holistic,” “configural,” and “relational” in the face perception literature Frontiers in Psychology | Perception Science December 2012 | Volume 3 | Article 559 | 2 published: 17 December 2012 doi: 10.3389/fpsyg.2012.00559
17) Rachel A. Robbins, Yaadwinder Shergill, Daphne Maurer, Terri L. Lewis Development of sensitivity to spacing versus feature changes in pictures of houses: Evidence for slow development of a general spacing detection mechanism? Journal of Experimental Child Psychology 109 (2011) 371–382
18) Richard Le Grand*, Catherine J. Mondloch*, Daphne Maurer*†, Henry P. Brent† Early visual experience and face processing NATURE | VOL 410 | 19 APRIL 2001 | www.nature.com p890
19) Catherine J Mondloch Rachel Robbins1⁄2, Daphne Maurer Discrimination of facial features by adults, 10-year-olds, and cataract-reversal patients Perception, 2010, volume 39, pages 184 -194 doi:10.1068/p6153
20) Spence, M. L., Storrs, K. R., & Arnold, D. H. (2014). Why the long face? The importance of vertical image structure for biological ‘‘barcodes’’ underlying face recognition. Journal of Vision, 14(8):25, 1–12. http://www.journalofvision.org/content/14/ 8/25, doi: 10.1167/14.8.25
21) Dakin, S. C., & Watt, R. J. (2009). Biological “bar codes” in human faces. Journal of Vision, 9(4):2, 1–10, http://journalofvision.org/9/4/2/, doi:10.1167/9.4.2.
22) Catherine J. Mondloch, Kate S. Dobson, Julie Parsons, Daphne Maurer Why 8-year-olds cannot tell the difference between Steve Martin and Paul Newman: Factors contributing to the slow development of sensitivity to the spacing of facial features Experimental Child Psychology 89 (2004) 159–181
23) Lisa Putzar, Ines Goerendt, Tobias Heed, Gisbert Richard, Christian Büchel, Brigitte Rödera. The neural basis of lip-reading capabilities is altered by early visual deprivation – abstract – Neuropsychologia Volume 48, Issue 7, June 2010, Pages 2158-2166 https://doi.org/10.1016/j.neuropsychologia.2010.04.007
24) Lev M, Gilaie-Dotan S, Gotthilf-Nezri D, Yehezkel O, Brooks JL, Perry A, Bentin S, Bonneh Y, Polat U. Training-induced recovery of low-level vision followed by mid-level perceptual improvements in developmental object and face agnosia. Developmental Science (2014), 1-15. DOI: 10.1111/desc.12178
25) Declaration of Helsinki, June 1964 https://en.wikipedia.org/wiki/Declaration_of_Helsinki last accessed 4/5/2021
Hussey is President of the Optometric Extension Program Foundation (an educational foundation), Chair of the organizing committee for the International Congress of Behavioral Optometry 2024, Chair of the Northwest Congress of Optometry, all under the umbrella of the Optometric Extension Program Foundation. Member of the American Optometric Association and Optometric Physicians of Washington.
Reprinted with permission from Brownstone Institute.
