









Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Community
Ask the community for help and clear up your study doubts
Discover the best universities in your country according to Docsity users
Free resources
Download our free guides on studying techniques, anxiety management strategies, and thesis advice from Docsity tutors
The impact of neglect on manual and oculomotor behavior, specifically in relation to visual search tasks. The study examines the performance of patients with right and left hemisphere damage in feature and conjunction search tasks, and the influence of display size, subgroup, and field defects on search performance. The document also explores the idea of competitive effects between more ipsilateral versus contralateral stimuli.
Typology: Study notes
1 / 17
This page cannot be seen from the preview
Don't miss anything!
Visual search paradigms, in which individuals search for a pre-defined target in a display containing multiple items, have been used extensively over the last decade or so in an attempt to characterize the neurobehavioral disorder termed “hemispatial neglect” (or “neglect” for short). Neglect is a disorder in which individuals, following an acquired brain lesion, fail to notice or report information on the side of space opposite the lesion, despite intact sensory and motor processes (Bisiach and Vallar, 2000; Bartolomeo and Chokron, 2001). Thus, for example, patients with a right hemisphere lesion fail to copy features on the right of a display while incorporating the corresponding features on the ipsilesional left. The same individual may eat from only the right side of their plate or dress only the right side of their body. The deficit may affect all sensory modalities, including contralateral visual, auditory, somatosensory and olfactory inputs. The presence of neglect may also adversely affect manual and oculomotor behavior in that these patients are often impaired at directing their eyes and/or hand to the
contralateral side, even in the absence of visual input (Behrmann et al., 2001; Gore et al., 2001/2002; Hornak, 1992; Mattingley et al., 1998). Finally, neglect can affect the contralateral side of an internal representation in the absence of sensory input, and can be reflected in mental imagery, as so elegantly demonstrated in the seminal work by Bisiach and Luzzatti (1978). The deficit that gives rise to hemispatial neglect is often attributed to the failure to construct an appropriate representation of space as a consequence of an attentional bias, which favors the processing of ipsilesional stimuli. Interestingly, patients with neglect may orient to highly salient contralesional stimuli but, left to their own devices, do not volitionally direct their attention to that side of space (Làdavas et al., 1994). Given that visual search tasks have been used extensively over the last several decades to examine patterns of visual attention in normal subjects (Bricolo et al., 2002; Neisser, 1964; Treisman and Gelade, 1980; Wolfe, 1998), the use of such measures may be particularly useful in elucidating the nature of the attentional biases in patients with hemispatial neglect. Despite the robustness of this experimental approach in normal subjects, the findings from visual search studies with neglect patients to date remain controversial. We start by describing briefly the paradigms employed in visual search studies with normal subjects, pointing out the central assumptions and major results. We then review the existing data obtained in individuals with hemispatial neglect. Following this, we report the
Cortex, (2004) 40, 247-
Marlene Behrmann^1 , Patricia Ebert 2,3^ and Sandra E. Black 2, (^1 Dept. of Psychology, Carnegie Mellon University, Pittsburgh, PA, USA; 2 Cognitive Neurology Unit, Department of Medicine and the Ontario Heart and Stroke Foundation Centre for Stroke Recovery, Sunnybrook and Women’s College Health Sciences Centre, University of Toronto; 3 Institute of Medical Sciences, University of Toronto, Toronto, ON, Canada)
ABSTRACT
Visual search tasks have standardly been divided into two categories: those in which the target is detected through a serial, attention-driven search and those in which the target is detected rapidly in parallel and, apparently, without attentional processing. Several studies have examined this distinction in patients with hemispatial neglect with the clear prediction that the former, but not the latter, should be impaired. These studies, however, have proved inconclusive. We have addressed this issue in a large sample of patients with unilateral hemispheric infarcts to the left or right hemisphere. In addition to measuring the patients’ performance on both types of visual search tasks, we documented the presence and severity of neglect and of visual field defects in these same individuals. Patients with brain-damage with or without accompanying neglect were impaired at searching for the contralateral target on both forms of visual search, relative to normal control subjects, although this deficit was magnified in individuals with neglect and was also exacerbated by the presence of hemianopia. This pattern was also more pronounced in individuals with right- than with left-hemisphere lesions. The findings not only clarify the contradictory neuropsychological data but also provide clear evidence for the involvement of attentional processing in all forms of visual search.
Key words: hemispatial neglect, attentional deficit, visual search
SPECIAL NOTE The authors pay special tribute to Dr Edoardo Bisiach who has been one of the primary researchers in the study of hemispatial neglect and whose seminal contribution is widely recognized. Two of the three authors of this paper (MB and SEB) met Dr Bisiach for the first time in 1986 when he visited the University of Toronto. His visit had a significant impact on us and our future work. In addition, over the years, Dr Bisiach has commented on some of our papers and has been very helpful on several other occasions. His input and collegiality are much appreciated.
findings we have obtained in a very large group of patients, who have sustained a unilateral hemispheric stroke to either the left or right hemisphere, using a well-established visual search paradigm, and we indicate ways in which these data can shed light on the mechanisms giving rise to the neglect deficit.
Visual Search as an Experimental Paradigm in Normal Subjects
Visual search studies are well-suited as a proxy for real-world attentional requirements, as features of the natural environment such as object clutter are captured while a controlled stimulus environment is maintained. A particularly prolific subset of these studies focuses on the conditions under which the reaction time (RT) and accuracy to locate the target are affected by the number of distractors appearing in the display (Geng and Behrmann, 2002b; Behrmann and Haimson, 1999; Treisman, 1999; Yantis, 2000). Cases in which the time to detect a target is largely unaffected by increasing the number of distractors (e.g., 5 msec/distractor item) are labeled as “feature search” or “disjunctive”, whereas cases in which detection time is significantly slowed by the increasing number of distractors (e.g., 50msec/item) are labeled “conjunctive”. These different search functions have also been referred to as “parallel” vs. “serial” or “simple” vs. “difficult”. The critical distinction is that visual search for targets distinguished by a single feature is scarcely affected by the number of distractors present whereas targets distinguished by feature conjunctions appear to be affected linearly by the number of distractors present. The interpretation of this distinction is that feature search can be executed effortlessly and preattentively (without attention); because search can be conducted in parallel across the entire display and the target “pops out” in this form of search, there is no increase in target detection time with increasing number of items in the display. In contrast, in the conjunctive search task, each item must be sequentially examined to determine whether it is a target. This process requires the allocation of attention, and the serial search results in the monotonic increase in detection time as a function of display size (see, for example, Bricolo et al., 2002). The effect of display size is a critical indicator and is taken to be the primary assay for the involvement of attention (Bundesen, 1990; Duncan and Humphreys, 1989).
Visual Search Tasks in Patients with Neglect
The assumptions derived from the visual search studies with normal subjects lead to a number of critical predictions with regard to neglect. If unilateral neglect does arise from a deficit of
attention, then, in the feature search (preattentive) task, performance in individuals with hemispatial neglect should not differ from that of normal individuals and should be unaffected by the size of the display. In addition, feature search should be identical for targets on the contralateral and ipsilateral sides. In contrast, performance should be impaired, relative to normal controls, for conjunction search when the target appears on the contralateral side and this should be exaggerated as the display size increases. Whether search for an ipsilateral target should be normal is not entirely clear, but patients should be differentially impaired for contralateral versus ipsilateral targets in conjunction search. Unfortunately, despite the abundance of studies, there is no clear consensus on the visual search performance of individuals with neglect, as will be apparent from the review of the literature below, and many questions remain unanswered. In addition to this lack of agreement, there are a number of other outstanding and controversial issues which affect the existing findings and we return to these after we have laid out the major studies and their results. In one of the earliest studies examining visual search with neglect patients, Riddoch and Humphreys (1987) presented a series of cards with displays to three patients with left-sided neglect. The patients were required to search for a target, which was present on half the trials, and accuracy and reaction time (RT) were recorded. In the feature search task, the display contained a red circle among green circle distractors whereas, in the conjunction search task, the display contained an inverted “T” among upright “T” distractors. In the feature search task, RT was unaffected by the number of distractors even when the target appeared on the contralateral side, consistent with parallel search. Note, however, that, even in this condition, there was a high error rate for contralateral targets, suggesting that feature search was not totally intact in these patients. As expected, detection was poor both in accuracy and RT for targets on the contralateral side in the conjunction search task. A subsequent study by Eglin and colleagues (Eglin et al., 1989), using a red dot among blue and yellow dots (feature search) or a red dot among split blue and intact red dots (conjunction search) and varying array size, distractor number, and location of stimuli, confirmed the impairment in contralateral feature search in six patients with right hemisphere damage (RHD) and in one patient with left hemisphere damage (LHD). In contrast with the control subjects who showed only a linear slope in the conjunctive search task, there was a significant increase in the time taken to detect contralateral targets for neglect patients in both the feature and conjunction search task. Consistent with this is the finding from a related study by the same authors in which patients were required
248 Marlene Behrmann and Others
nonsignificantly reduced N1 evoked potential. These findings suggest that visual information may be processed by posterior and early parts of the visual system and that this might correspond to preattentive processing. However, in the absence of coupling with dorsal frontal and parietal areas (perhaps mediating attentional processing), conscious awareness is precluded and this may be consistent with attentive processing (but see Marzi et al., 2000, for a different result). As is evident from this overview, there are clearly a number of discrepant findings especially with regard to the preservation of contralateral feature search in neglect and the extent to which contralateral information can be processed by these patients. This lack of agreement may arise for several different reasons. One obvious possibility is that the methods adopted in the different studies vary quite substantially, including the number of subjects tested (with very small numbers in some cases), the nature of the search task (colour discrimination, letter detection, pointing or cancellation), and the reliance on a single or on multiple dependent measures (accuracy and/or RT). Of course, the qualitative and quantitative differences between the different subject samples can also contribute to the different outcomes; this heterogeneity in lesion size and site is exacerbated when the subject sample is small and, indeed, there is well-documented variability across patients. In addition to these obvious reasons, a number of other factors could potentially complicate the results and these confounding factors are not necessarily addressed or controlled in the various studies. Firstly, we do not know whether any apparent deficit that is observed in the neglect patients is a function of a hemispheric lesion per se or whether the deficit is solely a consequence of hemispatial neglect. Because many studies compare the performance of the neglect patients to the performance of a group of normal, healthy control subjects and do not include a group of brain- damaged individuals without neglect, it is not possible to know whether the deficit is attributable to neglect per se or to brain damage more generally. Secondly, related to this, we do not know whether the apparent deficit is correlated with the severity of neglect, as one might predict if the deficit is truly attentional in nature. Because the number of subjects is small in some studies, or in those studies in which there are a large number of subjects, patients are simply assigned to a presence/absence of neglect dichotomy, it has not been possible to examine the correlation between severity of neglect and visual search behavior in detail. Thirdly, we do not know to what extent the presence of a visual field defect affects performance. This has recently become a rather substantial issue in understanding hemispatial neglect; whereas Doricchi and Angelelli (1999) and Toth and Kirk (2002) have shown that neglect
patients with hemianopias make greater ipsilesional bisection errors in line bisection tasks then neglect patients without hemianopias, Ferber and Karnath (1999) have found otherwise. To the extent that the presence of a field defect has been taken into account in studies of visual search, the results have proven contradictory. As mentioned above, Esterman et al. (2000) find that only patients with hemispatial neglect accompanied by a field defect are impaired at feature search whereas Aglioti et al. (1997) report no difference as a function of the presence/absence of field defects in reaction time (RT). Note that Aglioti et al. (1997) do find an increased number of errors but this is so in all individuals with field defects and is not restricted to those patients with neglect. The final issue concerns differences between individuals with left hemisphere lesions and those with right hemisphere lesions. Neglect is notoriously associated with RHD more often than with LHD, although the extent of this relationship is also somewhat controversial (Ogden, 1987). Studies using transcranial magnetic stimulation and functional magnetic resonance imaging have pointed to differences between the two hemispheres in their relative involvement in attentional processing (Ashbridge et al., 1997; Corbetta et al., 1995, 1998) and suggest greater involvement of the right hemisphere in attentional tasks such as conjunction search. To the extent that this issue has been considered, the data remain contradictory. Gainotti et al. (1986), for example, have argued for no difference between LHD and RHD patients in visual search tasks whereas others (for example, Halligan et al., 1992; Weintraub and Mesulam, 1987) do find differences between these groups. Because the number of subjects in these studies is typically small, and because patients with LHD with neglect tend to have milder forms of neglect than their RHD counterparts, a clear comparison between hemispheric groups with severity of neglect and presence of hemianopia equated, is very difficult. It remains to be determined, therefore, whether there are hemispheric differences in visual search in patients with neglect when these other factors are taken into account. In light of the controversial findings and the many remaining outstanding questions, we have undertaken a study of the visual search performance of a large group of patients, consecutively admitted to a university teaching hospital stroke care unit, who suffered a stroke to either the left or right hemisphere. We have included not only individuals with no neurological deficits to serve as controls but also individuals who have suffered a hemispheric lesion but who do not exhibit neglect to serve as an additional control group. In addition to completing a bedside battery used to diagnose neglect and to document its severity, we had subjects complete a computerized version of feature and conjunction search performance for targets presented to the
250 Marlene Behrmann and Others
contralateral or ipsilateral side and we measured accuracy and RT. Subjects also underwent clinical visual field testing, and the extent of a visual field defect was documented. Finally, because of the large patient sample, we have been able to compare RHD and LHD with neglect where the severity of the neglect (and presence of hemianopia) is equated in the two groups. With this data set, we will first attempt to replicate the finding of impaired contralateral search in patients with neglect. We will then examine detection of ipsilateral targets in conjunction search. But perhaps most relevant is that we will determine whether feature search is normal in individuals with neglect. Lastly, we will explore whether the visual search performance of the patients is influenced by the presence and/or severity of neglect, the side of the lesion and/or the presence of hemianopia.
Subjects
Individuals with and without brain damage consented to participate in this study. The non-brain- damaged control group consisted of volunteers, age- and education-matched to the patients, living independently in the community served by Sunnybrook and Women’s College Health Sciences Centre. These control subjects were screened for neurological and serious medical illness and were excluded if such diseases were present. The brain-damaged group was recruited from a consecutive series of patients with stroke admitted to the Sunnybrook and Women’s Stroke Care Unit. All brain-damaged participants were right-handed with corrected visual acuity of at least 20/40. All patients met the following criteria: age between 20-85 years, clinical and radiological evidence of a single, unilateral lesion, no other neurological/mental illness (i.e., dementia, epilepsy, previous stroke), no other serious concomitant illness (e.g., cancer), and no history of substance abuse. All stroke patients were tested within three
months of stroke onset. They were recruited as soon after the stroke as they were able to sit up and undergo computerized testing. Those who could not understand test directions because of severe aphasia were excluded (n = 4). Although an attempt was made to perform the computerized visual search task and neglect testing on the same day, this was not always possible for logistical reasons. Patients tested within the first 2 weeks post-onset were allowed a maximum of 4 days between different components of the testing since neglect can improve substantially in the first 2 weeks after a stroke. If the patient was unable to be tested in the first two weeks, an interval of 9 days was allowed. If performance on the neglect battery was within normal limits, a longer testing interval was allowed if the patient remained neurologically stable, since it was unlikely that performance would change in that interval. In total, 48 left hemisphere-damaged (LHD) and 56 right hemisphere-damaged (RHD) individuals consented to participate in this study along with 34 elderly non-neurological control subjects, for a total sample of 138 subjects. The overall demographics and clinical characteristics of the different groups are given in Table I. The etiology of the lesion was similar in RHD and LHD groups, with infarcts of the middle cerebral artery being the most frequent. The control subjects and stroke patients did not differ with respect to age (t = 0.82, p = .41), education (t = – 1.91, p = 0.06), or gender distribution (χ^2 = 2.67, p = 0.10). Neglect is generally not that easy to diagnose and, depending on the nature of the subtests used in a screening battery, the diagnosis can vary (Halligan and Marshall, 1992). To maximize the reliability of the diagnosis, the presence of hemispatial neglect was assessed using the Sunnybrook Neglect Battery, a comprehensive evaluation of neglect, consisting of four different sub-tests: a shape cancellation task published by Mesulam (1985), spontaneous drawing and copying of a clock and daisy, line bisection, and a line cancellation task. Performance is scored out of 100 (Black et al., 1990; Leibovitch et al., 1998). In this
Visual search in hemispatial neglect 251
TABLE I Overall Demographic Information for the Stroke and Control Participants Stroke participants Controls participants
Number of (^104 ) participants
Hemisphere damaged RHD = 56 LHD = 48 — Average age 70.1 years 69.7 years 68.6 ± 6. Average education 13.03 years 12.72 years 12.9 ± 4. Sex Males = 33 Males = 24 Males = 14 Females = 23 Females = 24 Females = 20
Handedness All Right Handed All Right Handed Neglect None = 30 (53%) None = 39 (82%) Mild = 14 (25%) Mild = 9 (18%) Severe = 12 (22)%
necessary, to provide a measure of search efficiency and to summarize the RT data for a single subject. This index is well-established as a summary statistic and the slope sizes for various search paradigms have been well documented (Treisman and Gormican, 1988). A further measure which has been shown to be useful in characterizing performance is the ratio between the slope for targets present and target absent with a 2:1 ratio, indicating self-terminating search since, on average, it takes half the time to find the target as it would to determine that no target is present (Treisman and Gelade, 1980; Treisman and Souther, 1985). We conduct analyses of variance (ANOVA) to compare the patient groups against each other as well as against the non-neurological control subjects. Before doing so, however, we wanted to ensure that there was no difference within the healthy controls when responses were made with the left versus the right hand. To do this, we performed an ANOVA on the control data with response hand (left/right) as a between-subject variable and array size (1, 6, 12), search task (feature, conjunction) and target location (left/right) as within-subject variables. There was no significant effect of response hand for the normal control subjects, nor an interaction between response hand and any of the other factors, (all F < 1). Hence, the control data are collapsed across the variable of response hand for all future analyses. For all the remaining analyses, we plot data for left and right targets separately and compare these to the data from target absent trials. Initially, we compare the performance of normal control subjects separately with left brain-damaged patients and then with right brain-damaged patients with and without neglect. Then, we directly compare the performance of brain-damaged patients with neglect following left versus right hemisphere damage when the severity of neglect is equated.
All the initial analyses are done using data obtained only from those patients who do not have field defects. Thereafter, we examine whether the presence of a field defect makes any additional contribution to search performance over and above that of neglect. In all cases, post hoc comparisons are conducted with p < .01 (a rather more conservative value given the number of pairwise comparisons). Only the major results and significant findings are reported.
To address the questions of concern, we start by analysing the data from the LHD and RHD groups separately, using the control data as the benchmark for comparison.
Left Hemisphere Damage
To examine whether there is a deficit in visual search in patients with LHD and whether this differs depending on the presence of neglect, we separated the brain-damaged patients without field defects into those with neglect (LHD N+; N = 4) and those without neglect (LHD N–; N = 25). In addition to this between-subjects variable, we included three within-subjects variables: search type (feature, conjunction), side of target (left, right, target absent) and display size (1, 6, 12). In the RT analysis, all main effects and interactions were significant. Many of these effects are also present in the analyses of accuracy. Because detection time is the metric used most often for visual search (and indeed, in our paradigm, accuracy is a rather limited dependent measure given the relatively restricted number of trials per cell and the unlimited exposure duration of a trial), we focus more specifically on RT and only make some brief statements about accuracy of performance.
Visual search in hemispatial neglect 253
Fig. 1 – The pop-out and serial visual search tasks. The search tasks are similar to those published by Treisman and Souther (1985). In the pop-out task, the target is defined by the presence of a vertical line on the circle. In the serial search task, the target lacked the vertical line present on the distractors.
I. Pop-out Task. Target defined by a distinctive feature: specifically, an intersecting line.
II. Serial Task. Target defined by the lack of a distinctive feature.
The RT data are plotted separately for feature (left hand panels) and conjunction (right hand panels) search and for each of the three subgroups in Figure 2. Note that we maintain the same y-axis for all subgroups in this figure and we use the same axis in subsequent figures for ease of comparison. The normal control subjects detect targets significantly faster than either the LHD N– or LHD N+ group by about 400-500 ms, F (2,
RT. Feature search is 319 ms faster than conjunction search, F (1, 60) = 185.4, p < .001, although this difference varies across the three subgroups, F (2, 60) = 12.2, p < .0001 (222 for controls, 382 for LHD N–, 581 for LHD N+). RT increases as a function of display size, F (2, 120) = 35.9, p < .0001, and this too varies across subgroups, F (4, 120) = 8.2, p < .0001, with slopes of 22.6, 35.8 and 42.4 for the controls, LHD N– and LHD N+ subgroups, respectively. The increase in RT with display size is greater for conjunction
254 Marlene Behrmann and Others
Fig. 2 – Mean of median reaction time for (A) non-neurological control subjects, (B) patients with LHD but no neglect and (C) patients with LHD and accompanying neglect on feature and conjunction search as a function of display size and presence (left/right) or absence of target.
(RHD N–, RHD N+, and RHD N++) and the reader is referred to Figure 2 (top panel) for the corresponding control data. The overall RT for each group follows the expected ordering of detection time with greater slowing as neglect severity increases, F (3, 54) = 23.9, p < .0001 (normal controls 937 ms, RHD N- 1249 ms, RHD N+ 2091 ms, RHD N++ 3011 ms). There is also a significant main effect of search type, F (1, 54) = 87.5, p < .0001, with a 309 ms advantage for feature over conjunction search. Also, as expected, there is a main effect of display size, with RTs incrementing as display size increases, F (2,
256 Marlene Behrmann and Others
Fig. 3 – Mean of median reaction time for (A) patients with RHD and no neglect (B) patients with RHD and mild neglect and (C) patients with RHD and more severe neglect on feature and conjunction search as a function of display size and presence (left/right) or absence of target.
feature and conjunction search, respectively, and 123 ms and 684 ms for left trials over absent trials in feature and conjunction search, respectively. There is also an interaction of display size × side of target, F (4, 216) = 17.9, p < .0001, but this is qualified in the three-way interaction of search type × display size × side of target, F (4, 216) = 9.4, p < .0001; whereas the slope was 16.8 ms, 7.8 ms and 13.7 ms for left, right and absent targets in feature search, the corresponding values for conjunction search were 16.1 ms, 35.8 ms, and 65.3 ms. But the most pertinent analyses involve the factor of subgroup. There are two-way interactions between search × subgroup, F (1, 54) = 6.6, p < .001, display size × subgroup, F (6, 108) = 17.1, p < .0001, and side × subgroup, F (6, 108) = 15.7, p < .0001. The three-way interaction of search type × display size × subgroup, F (6, 152) = 8.8, p < .0001, is significant, as is search type × side × subgroup, F (6, 108) = 12.5, p < .0001, and display size × side of target × subgroup, F (12, 216) = 11.9, p < .0001. To facilitate comparisons across the subgroups, Table IV contains the slope of the RT function in ms, calculated over display size, for the two types of search task for each of the four subgroups separately for left, right and absent target trials. We should note at the outset that there is one strange data point in the feature search, display size 1, target absent trials in both the RHD N+ and RHD N++ subgroups (see Figure 3 middle and bottom left panels; also to some extent in RHD N++ conjunction search). Target absent on search size 1 is notoriously complicated (Treisman and Gormican, 1988). Also, given that we have rather few subjects in these cells, the variability on this point is high. Aside from this oddity, the remaining data follow a relatively clear pattern. Relative to the non-neurological control subjects, all three RHD subgroups show steeper slopes in the feature search task and the slope increments over presence and severity of neglect. Moreover, this increase in slope is greater for contralateral left over ipsilateral right targets, as seen in Table IV. A similar pattern is observed in the conjunction search task in which, relative to the non-neurological controls, all brain-damaged subgroups are impaired, including the RHD N– patients, in detecting targets on the left. However, the patients with neglect all search more slowly on the left than those without neglect but there is no difference between RHD N+ and RHD N++. With
regard to ipsilateral right targets, there is a trend towards a reverse effect in that the most severe group, RHD N++, shows somewhat faster search and shallower slopes across display size (29.6 ms), relative to the other groups, and no difference between ipsilateral targets in feature and conjunction search. Also, in the most severe neglect group, the slopes for the target absent trials do not necessarily reflect the self-terminating 2:1 ratio, suggesting that search may be terminated early, or that, when a target is present on the contralateral side, the patients may continue to search for a long time until they acquire it, reducing the difference between target present and target absent search times. Support for this latter claim comes from the finding that patients with right parietal lesions and neglect show abnormally long RTs to the absence of a target (Mijovic-Prelec et al., 1998); because of their lowered confidence, they spend an inordinately long time verifying the absence of the target. The same analysis using accuracy as a dependent measure yields almost identical results. The four-way interaction is significant, F (12, 224) = 2.3, p < .01. All main effects are significant and there are a number of significant two-way and three-way interactions. The pattern yielded by the interaction is roughly the same as that of the RT data. Some small differences do emerge, likely because accuracy is not as telling a dependent measure as RT in this paradigm, but, for the most part, the findings support those obtained from RT. Taken together, the results are fairly clear. All patients, including those with RHD but no neglect are impaired relative to the control subjects for targets on the left to a greater degree than targets on the right, and this asymmetry is exaggerated in the conjunction search in comparison with the feature search task. Patients with neglect, however, show steeper slopes than those without neglect. Importantly, this increase in slope for contralateral targets is evident in both forms of search and to a greater degree on the left than right. There is also a scaling of the deficit such that the increased contralateral slope is less evident in subjects with no neglect (RHD N–) compared with those with neglect (RHD N+ and N++). The two neglect groups differ from each other in two ways: on contralateral targets, the RHD N++ group is more severely affected by display size than the RHD N+ group but mostly this is true in feature search, and, for ipsilateral targets, the RHD N++ group is
Visual search in hemispatial neglect 257
TABLE IV Slope of RT (in ms) for Feature and Conjunction Tasks for Four Subgroups of Participants
Group Feature search Conjunction search
Target left Target right No target Target left Target right No target
Normals 5.3 8.9 17.3 22.9 30.4 34 RHD N– 18.6 13.7 210.3 59.3 33.5 118. RHD N+ 64.2 23.7 31.8 146 46.3 181 RHD N++ 135.9 34.2 – 120.3 155 29.6 56.
display size. Note that patients are classified in a binary fashion for presence/absence of field defect rather than by severity in order to be able to cross this factor with side of damage and presence of neglect, and to maintain enough subjects in each cell for the ANOVA. We do not include subjects for whom we do not have definitive information about the status of their visual fields. The most important finding is that there is a marginally significant five-way interaction of field defect, side of lesion and presence of neglect (coded as a single factor) and the three search variables, F (12, 472) = 1.7, p = .06. Patients with field defects are, on average, 599 ms slower than those without field defects, F (1, 118) = 5.9, p < .02, especially as display size increases, F (2, 236) = 14.2, p < .0001 (absence of field defect 37.4 ms, presence of field defect 72.8 ms). This pattern, however, is magnified in the conjunction over feature search but is also disproportionately affected by the side of lesion (right worse than left) and presence of neglect (presence of neglect worse than absence), F (6, 236) = 2.2, p < .05. Table VI summarizes the slopes for the normal control subjects and patients with and without field defects on the two types of search for left versus right targets, reflecting the data making up the five-way interaction. What is apparent from the table is that patients without field defects have shallower slopes than their counterparts with field defects, especially in conjunction search. It is the case, however, that the presence of a field defect appears to influence the performance of LHD N–, LHD N+ and RHD N– to a greater degree than RHD N+, possibly because this last group is already so slow that the presence of a field defect does not have much additional impact. We also note that the patients with a field defect show increased slopes for both ipsilateral and contralateral targets although this is so to a slightly greater degree for contralateral targets.
The aim of this study was to examine in a systematic fashion, using visual search paradigms,
the nature of the attentional deficit in a large group of individuals who had sustained unilateral hemispheric lesions following cerebral infarction. After confirming the decrement in performance for contralateral over ipsilateral targets in conjunction search, we were interested in measuring the detection time for ipsilateral targets in patients relative to control subjects. But perhaps, of more relevance is the status of the feature search performance of the patients compared with the control subjects. These analyses took into account the hemisphere affected (left or right), the presence of neglect and its severity and the presence of hemianopia. To address these issues, we obtained data from 48 left-hemisphere damaged patients, 56 right- hemisphere damaged patients and a group of non- neurological control subjects on a standard neglect battery. We also documented the presence of a visual field defect in the patients on confrontation testing. Finally, all subjects completed a computerized experiment consisting of a well- established visual search task with two components; the first component involved search for a target which is typically acquired rapidly and independently of the number of distractors by normal subjects (feature search) and the second component involved search for a target which is acquired more slowly and is significantly affected by the number of distractors in the array (conjunction search). Although studies of this type have been conducted in the past, the findings remain controversial. The first major result is that following a lesion to either hemisphere, individuals without neglect are impaired relative to intact normal subjects. However, individuals with a lesion and with concurrent neglect are even more impaired than their non-neglect counterparts. Interestingly, both patient groups, with and without neglect, show incrementally slower search in both feature and conjunction searches as display size increases and this is so to a greater extent for contralateral than ipsilateral targets. Because of the graded severity of neglect among the RHD group, we could also evaluate whether this pattern was affected by the extent of the neglect. There was no significant
Visual search in hemispatial neglect 259
TABLE VI Slopes (in ms) of RT Over Display Size for Patients with Left and Right Hemisphere Lesions and with/without Neglect and Field Defects Without field defect With field defect Feature Conjunction Feature Conjunction Left Right Left Right Left Right Feature Conjunct
Normal 5.3 22.9 8.9 30.4 – – – – subjects Contra Ipsi Contra Ipsi Contra Ipsi Contra Ipsi LHD N– 27 21 68.4 26.1 43.8 11.1 99.8 43. LHD N+ 19.1 3.9 65.9 16.2 68.4 13.2 108.6 72 RHD N– 18.6 13.7 59.3 33.5 31.5 19 112 80. RHD N+ 64.2 23.7 146 46.3 72.6 20.9 160.2 48.
difference as a function of severity of neglect and RHD N+ and RHD N++ show roughly similar magnitudes of deficit on contralateral search. Interestingly, the more severe group showed a shallower slope for ipsilateral targets in the conjunction task, reflecting the competition between items on the left and right and the advantage for the ipsilateral items. A hint of this competitive advantage for ipsilateral targets was also seen after LHD in individuals with neglect. A comparison of the patients’ performance as a function of side of hemispheric lesion shows that, even when we equated for the presence and extent of neglect in the two groups, RHD patients are more impaired at contralateral conjunction search as display size increases than their LHD counterparts. This difference is magnified by the presence of neglect so that the greater impairment for RHD N– than LHD N– is magnified when comparing RHD N+ and their LHD N+ counterparts. The presence of a field defect also contributes to the impairment in search performance although, once the difference between presence/absence of neglect is taken into account, the additional contribution of a field defect is not that large. Also, to the extent that it exists, the presence of hemianopia does not appear to be specific and seems to slow search down for both ipsilateral and contralateral targets. These findings have provided some clear answers. Our results are consistent with the other studies that find a deficit in contralateral feature search (Riddoch and Humphreys, 1983; Eglin et al., 1989; Pavlovskaya et al., 2002). Interestingly, the magnitude of the deficit we have observed is also comparable to that obtained in these other studies. In light of this, our data challenge those studies, which claim that feature search is preserved in hemispatial neglect. As laid out above, a number of possible factors can account for the discrepant findings across the different studies. In our case, given the large patient sample and the heterogeneity of our subjects, we have been able to control a range of variables, which might have influenced the previous results. In addition to addressing the controversial findings and to exploring the factors that might have confounded these previous studies, our data have also highlighted some other interesting effects that have not received much discussion to date. Patients with severe neglect, counterintuitively, show a speed up on ipsilateral conjunction search. In contrast, patients with no or mild neglect are slow on conjunction search for ipsilateral and contralateral search. These observations are compatible with a view in which there is competition for attention. If the attentional bias is strong ipsilesionally, targets will be quickly detected but this might have adverse consequences for contralateral detection. If, however, the
ipsilesional bias is less strong, search might be slow for both ipsilesional targets and for contralesional targets. Some studies have also reported poorer ipsilesional performance for patients compared with controls (Eglin et al., 1989; 1996; Geng and Behrmann, 2002a) and others have found that the search patterns of neglect patients are equally poor in the contralesional and ipsilesional visual field (Chatterjee et al., 1992; Halligan et al., 1992). The claim that there are no hemifield differences also finds support in studies that do not use visual search; for example, using partial and whole report procedures, Duncan and colleagues document the presence of poor visual processing in both hemifields in neglect patients (Duncan et al., 1999). One possible explanation for the range of results concerns the severity of neglect. We only see an ipsilesional advantage for the severe neglect patients whereas for those with less severe neglect (and even for those with no neglect), we find decrements in performance in both hemifields but somewhat greater in the contralateral than ipsilateral space. Before going on to examine the theoretical implications of these findings, we need to rule out an alternative interpretation of our results. One possible reason that we find poorer feature search in the neglect patients, relative to the controls, might be that the patients have additional brain damage to earlier visual areas and it is this damage, rather than the neglect per se , that might contribute to impaired parallel search and preattentive processing. In a detailed analysis of the lesion sites of all patients, done by identification of the lesion location/s on the CT scans in reference to the 24 best fitting slices from the Talairach and Tournox stereotactical anatomical reference system (Talairach and Tournox, 1998), only 8 of the RHD patients (14%) and only 8 of the LHD patients (17%) have damage to occipital cortex (Ebert, 1998). There are several obvious reasons from the data to indicate that the impaired feature search is not solely attributable to this additional damage to early visual areas. Firstly, only a small proportion of the groups have patients with damage to this area and this sample size is not large enough to carry the statistical effects of the whole group. Secondly, because some of these patients have field defects, and make many contralateral errors, their data are not included in the RTs and so, the slopes are calculated without their data. Finally, we note that when we examine the performance of individuals with versus those without field defects, we still observe an impairment in feature search in those subjects who do not have field defects. Taken together, these findings suggest that the increased slope in RTs for feature search as a function of array size is not simply attributable to the additional presence of occipital lobe damage.
260 Marlene Behrmann and Others
work, and Nancy Blair, Jane Collins and Jay Bondar for their help with data collection and patient testing. We also thank Dr D. Stuss and Dr R. McIntosh who served as members of the thesis committee for PE. This research was completed in partial fulfillment of PE’s Master’s Thesis at the University of Toronto.
REFERENCES
AGLIOTI S, S MANIA N, BARBIERI C and CORBETTA M. Influence of stimulus salience and attentional demands on visual search patterns in hemispatial neglect. Brain and Cognition, 34: 388- 403, 1997. ARGUIN M, JOANETTE Y and CAVANAGH P. Visual search for feature and conjunction targets with an attention deficit. Journal of Cognitive Neuroscience, 5: 436-452, 1993. ASHBRIDGE E, WALSH V and COWEY A. Temporal aspects of visual search studies by transcranial magnetic stimulation. Neuropsychologia, 35: 1121-1131, 1997. B ARTOLOMEO P and C HOKRON S. Levels of impairment in unilateral neglect. In F Boller and J Grafman (Eds), Handbook of Neuropsychology. North-Holland: Elsevier Science, 2001, pp. 67-98. B EHRMANN M, B ARTON JJS, WATT S and B LACK SE. Impaired visual search in patients with unilateral neglect: An oculographic analysis. Neuropsychologia, 35: 1445-1458,
B EHRMANN M, G HISELLI -C RIPPA T and D IMATTEO I. Impaired initiation but not execution of leftward saccades to left targets in hemispatial neglect. Behavioral Neurology, 13: 39-60, 2001. B EHRMANN M and H AIMSON C. The cognitive neuroscience of visual attention. Current Opinion in Neurobiology, 9: 158- 163, 1999. B EHRMANN M, M OSCOVITCH M, B LACK SE and M OZER MC. Perceptual and conceptual factors in neglect dyslexia: Two contrasting case studies. Brain 113, 4: 1163-1883, 1990. B ISIACH E and L UZZATTI C. Unilateral neglect of representational space. Cortex, 14: 129-133, 1978. B ISIACH E and VALLAR G. Unilateral neglect in humans. In F Boller and J Grafman (Eds), Handbook of Neuropsychology. North-Holland, Amsterdam: Elsevier Science, 2000, pp. 459-
B LACK SE, V U B, M ARTIN D and S ZALAI JP. Evaluation of a bedside battery for hemispatial neglect in acute stroke. Journal of Clinical and Experimental Neuropsychology, 12: 102 (abstract), 1990. B OUTSEN L and H UMPHREYS GW. Axis-based grouping reduces visual extinction. Neuropsychologia, 38: 896-905, 2000. B RICOLO E, GIANESINI T, FANINI A, BUNDESEN C and CHELAZZI L. Serial attention mechanisms in visual search: A direct behavioral demonstration. Journal of Cognitive Neuroscience , 14: 980-993, 2002. B UB D and GUM T. Psychlab. McGill University: Neurolinguistics Department, 1991. B UNDESEN C. A theory of visual attention. Psychological Review, 97: 523-547, 1990. C ATE A and B EHRMANN M. Spatial and temporal influences on extinction in parietal patients. Neuropsychologia , 40: 2206- 2225, 2002. C HATTERJEE A, M ENNEMEIER M and H EILMAN KM. A stimulus- response relationship in unilateral neglect: The power function. Neuropsychologia, 30: 1101-1108, 1992. C ORBETTA M, A KBUDAK E, C ONTURO TE, S NYDER AZ, O LLINGER JM, D RURY HA, L INENWEBER MR, P ETERSEN SE, R AICHLE ME, VAN ESSEN DC and SHULMAN GL. A common network of functional areas for attention and eye movements. Neuron, 21: 761-773, 1998. C ORBETTA M, S HULMAN GL, M IEZEN FM and P ETERSEN SE. Superior parietal cortex activation during spatial attention shifts and visual feature conjunction. Science, 270: 802-805,
DESIMONE R and DUNCAN J. Neural mechanisms of selective visual attention. Annual Review of Neuroscience, 18: 193-222, 1995. D ORICCHI F and A NGELELLI P. Misrepresentation of horizontal space in left unilateral neglect: Role of hemianopia. Neurology, 52: 1845-1852, 1999. D RIVER J, B AYLIS GC and R AFAL RD. Preserved figure-ground segregation and symmetry perception in visual neglect. Nature, 360: 73-75, 1992. DRIVER J and HALLIGAN PW. Can visual neglect operate in object- centered coordinates: An affirmative study. Cognitive Neuropsychology, 8: 475-496, 1991.
D UNCAN J, B UNDESEN C, O LSON A, H UMPHREYS GW, C HAVDA S and S HIBUYA H. Systematic analysis of deficits in visual attention. Journal of Experimental Psychology: General, 128: 450-478, 1999. D UNCAN J and H UMPHREYS GW. Visual search and stimulus similarity. Psychological Review, 96 : 433-458, 1989. DUNCAN J, HUMPHREYS G and WARD R. Competitive brain activity in visual attention. Current Opinion in Neurobiology, 7: 255- 261, 1997. E GLIN M, R OBERTSON LC and K NIGHT RT. Visual search performance in the neglect syndrome. Journal of Cognitive Neuroscience, 1: 372-385, 1989. E GLIN M, R OBERTSON LC and K NIGHT RT. Cortical substrates supporting visual search in humans. Cerebral Cortex, 1 : 262- 272, 1991. E GLIN M, R OBERTSON LC, K NIGHT RT and B RUGGER P. Search deficits in neglect patients are dependent on size of the visual scene. Neuropsychology, 8: 451-463, 1994. E GLIN M, R OBERTSON L, K NIGHT RT and B RUGGER P. Search deficits in neglect patients are dependent on size of the visual scene. Neuropsychologia, 8 : 451-463, 1996. E STERMAN M, M C G LINCHEY-B ERROTH R and M ILBERG W. Preattentive and attentive visual search in individuals with hemispatial neglect. Neuropsychology, 14 : 599-611, 2000. FARAH MJ, WALLACE M and VECERA SP. “What’’ and “Where’’ in visual attention: Evidence from the neglect syndrome. In IH Robertson and JC Marshall (Eds), Unilateral Neglect: Clinical and Experimental Studies. Hove, UK: Lawrence Erlbaum Associates, 1993, pp. 123-138. FERBER S and KARNATH HO. Parietal and occipital contributions to perception of straight ahead orientation. Journal of Neurology, Neurosurgery and Psychiatry , 67 : 572-578, 1999. G AINOTTI G, D’E RME P, M ONTELEONE D and S ILVERI MC. Mechanisms of unilateral neglect in relation to laterality of cerebral lesions. Brain, 109: 599-612, 1986. G ENG JJ and B EHRMANN M. Probability cueing of target location facilitates visual search implicitly in normal participants and patients with hemispatial neglect. Psychological Science, 13: 520-525, 2002a. G ENG JJ and B EHRMANN M. Selective visual attention and visual search: Behavioral and neural mechanisms. In B Ross and D Irwin (Eds), The Psychology of Learning and Motivation. Vol. 42. New York: Academic Press, 2002b, pp. 157-191. G ILCHRIST ID, H UMPHREYS GW and R IDDOCH MJ. Grouping and extinction: Evidence for low-level modulation of visual selection. Cognitive Neuropsychology, 13: 1223-1249, 1996. G ORE CL, R ODRIGUEZ DP and B AYLIS GC. Deficits of motor intention following parietal lesions. Behavioral Neurology, 13 : 29-37, 2001/2002. H ALLIGAN PW, B URN JP, M ARSHALL JC and WADE DT. Visuo- spatial neglect: Qualitative differences and laterality of cerebral lesion. Journal of Neurology, Neurosurgery and Psychiatry, 55 : 1060-1068, 1992. H ALLIGAN PW and M ARSHALL JC. Left visuospatial neglect: A meaningless entity? Cortex, 28: 525-535, 1992. H ALLIGAN PW and M ARSHALL JC. Primary sensory deficits after right brain-damage-an attentional disorder by any other name? In HO Karnath, AD Milner and G Vallar (Eds), The Cognitive and Neural Bases of Spatial Neglect. Oxford, UK: Oxford University Press, 2002, pp. 327-340. HORNAK J. Ocular exploration in the dark by patients with visual neglect. Neuropsychologia, 30: 547-552, 1992. HUMPHREYS GW. Binding in vision as a multi-stage process. In R Kimchi, M Behrmann and C Olson (Eds), Perceptual organization: Behavioral and Neural Perspectives. Hillsdale, NJ: Erlbaum Associates, 2003, pp. 377-399. H UMPHREYS GW and R IDDOCH MJ. Detection by action: Neuropsychological evidence for action-defined templates in search. Nature Neuroscience, 4 : 84-88, 2001. H UMPHREYS GW and R IDDOCH MJ. Knowing what you need but not what you want: Affordances and action-defined templates in neglect. Behavioral Neurology, 13 : 75-87, 2001/2002. J OSEPH JS, CHUN M and NAKAYAMA K. Attentional requirements in a ‘preattentive’ feature search task. Nature, 387: 805-807,
K ASTNER S, P INSK MA, D E W EERED P, D ESIMONE R and U NGERLEIDER LG. Increased activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron , 22: 751-761, 1999. K UMADA T and H UMPHREYS GW. Lexical recovery from extinction: Interactions between visual form and stored knowledge modulate visual selection. Cognitive Neuropsychology, 18 : 465-478, 2001.
262 Marlene Behrmann and Others
L ÀDAVAS E, C ARLETTI M and G ORI G. Automatic and voluntary orienting of attention in patients with visual neglect: Horizontal and vertical dimensions. Neuropsychologia, 32: 1195-1208, 1994. LÀDAVAS E, P ETRONIO A and UMILTÀ C. The deployment of visual attention in the intact field of hemineglect patients. Cortex, 26: 307-317, 1990. LEIBOVITCH FS, BLACK SE, C ALDWELL CB, EBERT PL, EHRLICH LE and SZALAI JP. Brain-behavior correlations in left hemispatial neglect using CT and SPECT imaging: The Sunnybrook stroke study. Neurology, 50: 901-908, 1998. M ARZI , C, G IRELLI M, M INIUSSI C, S MANIA N and M ARAVITA A. Electrophysiological correlates of conscious vision: Evidence from unilateral extinction. Journal of Cognitive Neuroscience , 12: 869-877, 2000. MATTINGLEY JB, DAVID G and DRIVER J. Preattentive filling in of visual surfaces in parietal extinction. Science, 275: 671-674,
MATTINGLEY JB, HUSAIN M, RORDEN C, KENNARD C and DRIVER J. Motor role of human inferior parietal lobe revealed in unilateral neglect patients. Nature, 392: 179-182, 1998. M ESULAM MM. Principles of Behavioral Neurology. USA: F. A. Davis, 1985. M IJOVIC -P RELEC D, C HABRIS CF, S HIN LM, K OSSLYN SM and W RAY SH. The judgment of absence in neglect. Neuropsychologia, 36: 797-802, 1998. N EISSER U. Visual search. Scientific American, 210: 94-102,
N OESSELT T, H ILLYARD SA, W OLDORFF MG, S CHOENFELD A, H AGNER T, J ÄNCKE L, T EMPELMANN C, H INRICHS H and Heinze HJ. Delayed striate cortical activation during spatial attention. Neuron , 35: 575-587, 2002. O’C ONNOR DH, F UKUI MM, P INSK MA and K ASTNER S. Attention modulates responses in the human lateral geniculate nucleus. Nature Neuroscience , 5: 1203-1209, 2002. OGDEN J. The “neglected” left hemisphere and its contribution to visuospatial neglect. In M Jeannerod (Ed), Neurophysiological and Neuropsychological Aspects of Spatial Neglect. Amsterdam: North Holland, 1987, pp. 215-233. PAVLOVSKAYA M, R ING H, G ROSSWASSER Z and H OCHSTEIN S. Searching with unilateral neglect. Journal of Cognitive Neuroscience, 14: 745-756, 2002. RAPCSAK SZ, VERFAELLIE M, F LEET S and HEILMAN KM. Selective attention in hemispatial neglect. Archives of Neurology, 46: 178-182, 1989. R IDDOCH MJ and H UMPHREYS GW. Perceptual and action systems in unilateral visual neglect. In M Jeannerod (Ed), Neurophysiological and Neuropsychological Aspects of Spatial Neglect. New York: Elsevier, 1987, pp. 151-181.
R IDDOCH MJ and H UMPHREYS GW. The effect of cueing on unilateral neglect. Neuropsychologia, 21: 589-599, 1983. R ORDEN C, M ATTINGLEY JB, K ARNATH H-O and D RIVER J. Visual extinction and prior entry: Impaired perception of temporal order with intact motion perception after unilateral parietal damage. Neuropsychologia, 35: 421-433, 1997. SOMERS DC, DALE AM, S EIFFERT AE and TOOTELL RB. Functional MRI reveals spatially specific attentional modulation in human primary visual cortex. Proceedings of the National Academy of Sciences of the United States of America , 96: 1663-1668, 1999. TALAIRACH J and TOURNOUX P. Co-planar Stenotaxic Atlas of the Human Brain. Stuttgart: Georg Thieme, 1988. T OTH C and K IRK A. Representational bias does not affect bisection of lines with a pictorially or semantically defined top by patients with left hemispatial neglect. Brain and Cognition , 50: 161-177, 2002. T REISMAN A. Feature binding, attention and object perception. In GW Humphreys, J Duncan and A Treisman. (Eds), Attention, Space and Action. Oxford: Oxford University Press, 1999, pp. 91-111. T REISMAN A and G ELADE G. A feature-integration theory of attention. Cognitive Psychology, 12: 97-136, 1980. T REISMAN A and G ORMICAN S. Feature analysis in early vision: Evidence from search asymmetries. Psychological Review, 95: 15-48, 1988. T REISMAN A and S OUTHER J. Search asymmetry: A diagnostic for preattentive processing of separable features. Journal of Experimental Psychology: General, 114 : 285-310, 1985. V UILLEUMIER P, S AGIV N, H AZELTINE E, P OLDRACK RA, S WICK D and G ABRIELI JDE. Neural fate of seen and unseen faces in visuospatial neglect; A combined event-related functional MRI and event-related potential study. Proceedings of the National Academy of Sciences, 98: 3495-3500, 2000. WARD R, G OODRICH S and D RIVER J. Grouping reduces visual extinction: Neuropsychological evidence for weight-linkage in visual selection. Visual Cognition, 1: 101-129, 1994. W EINTRAUB S and M ESULAM MM. Right cerebral dominance in spatial attention: Further evidence based on ipsilateral neglect. Archives of Neurology, 44 : 621-625, 1987. WOLFE JM. What can 1 million trials tell us about visual search? Psychological Science, 9: 33-39, 1998. YANTIS S. Goal-directed and stimulus-driven determinants of attentional control. In S Monsell and J Driver (Eds), Attention and Performance XVIII. Cambridge, MA: MIT Press, 2000, pp. 73-103.
Marlene Behrmann, Department of Psychology, Carnegie Mellon University, Pittsburgh, PA 15213-3890, USA. e-mail: behrmann+@cmu.edu.
Visual search in hemispatial neglect 263