Skip to main content
Advertisement
  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Specialty Sites
    • COVID-19
    • Practice Current
    • Practice Buzz
    • Without Borders
    • Equity, Diversity and Inclusion
    • Innovations in Care Delivery
  • Collections
    • Topics A-Z
    • Residents & Fellows
    • Infographics
    • Patient Pages
    • Null Hypothesis
    • Translations
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit a Manuscript
    • Author Center

Advanced Search

Main menu

  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Specialty Sites
    • COVID-19
    • Practice Current
    • Practice Buzz
    • Without Borders
    • Equity, Diversity and Inclusion
    • Innovations in Care Delivery
  • Collections
    • Topics A-Z
    • Residents & Fellows
    • Infographics
    • Patient Pages
    • Null Hypothesis
    • Translations
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit a Manuscript
    • Author Center
  • Home
  • Latest Articles
  • Current Issue
  • Past Issues
  • Residents & Fellows

User menu

  • Subscribe
  • My Alerts
  • Log in
  • Log out

Search

  • Advanced search
Neurology
Home
The most widely read and highly cited peer-reviewed neurology journal
  • Subscribe
  • My Alerts
  • Log in
  • Log out
Site Logo
  • Home
  • Latest Articles
  • Current Issue
  • Past Issues
  • Residents & Fellows

Share

February 24, 2004; 62 (4) Articles

Comparison of different MRI brain atrophy rate measures with clinical disease progression in AD

C. R. Jack, M. M. Shiung, J. L. Gunter, P. C. O’Brien, S. D. Weigand, D. S. Knopman, B. F. Boeve, R. J. Ivnik, G. E. Smith, R. H. Cha, E. G. Tangalos, R. C. Petersen
First published February 23, 2004, DOI: https://doi.org/10.1212/01.WNL.0000110315.26026.EF
C. R. Jack Jr.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
M. M. Shiung
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
J. L. Gunter
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
P. C. O’Brien
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
S. D. Weigand
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
D. S. Knopman
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
B. F. Boeve
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
R. J. Ivnik
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
G. E. Smith
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
R. H. Cha
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
E. G. Tangalos
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
R. C. Petersen
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Full PDF
Citation
Comparison of different MRI brain atrophy rate measures with clinical disease progression in AD
C. R. Jack, M. M. Shiung, J. L. Gunter, P. C. O’Brien, S. D. Weigand, D. S. Knopman, B. F. Boeve, R. J. Ivnik, G. E. Smith, R. H. Cha, E. G. Tangalos, R. C. Petersen
Neurology Feb 2004, 62 (4) 591-600; DOI: 10.1212/01.WNL.0000110315.26026.EF

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Permissions

Make Comment

See Comments

Downloads
1950

Share

  • Article
  • Figures & Data
  • Info & Disclosures
Loading

Abstract

Objective: To correlate different methods of measuring rates of brain atrophy from serial MRI with corresponding clinical change in normal elderly subjects, patients with mild cognitive impairment (MCI), and patients with probable Alzheimer disease (AD).

Methods: One hundred sixty subjects were recruited from the Mayo Clinic Alzheimer’s Disease Research Center and Alzheimer’s Disease Patient Registry Studies. At baseline, 55 subjects were cognitively normal, 41 met criteria for MCI, and 64 met criteria for AD. Each subject underwent an MRI examination of the brain at the time of the baseline clinical assessment and then again at the time of a follow-up clinical assessment, 1 to 5 years later. The annualized changes in volume of four structures were measured from the serial MRI studies: hippocampus, entorhinal cortex, whole brain, and ventricle. Rates of change on several cognitive tests/rating scales were also assessed. Subjects who were classified as normal or MCI at baseline could either remain stable or convert to a lower-functioning group. AD subjects were dichotomized into slow vs fast progressors.

Results: All four atrophy rates were greater among normal subjects who converted to MCI or AD than among those who remained stable, greater among MCI subjects who converted to AD than among those who remained stable, and greater among fast than slow AD progressors. In general, atrophy on MRI was detected more consistently than decline on specific cognitive tests/rating scales. With one exception, no differences were found among the four MRI rate measures in the strength of the correlation with clinical deterioration at different stages of the disease.

Conclusions: These data support the use of rates of change from serial MRI studies in addition to standard clinical/psychometric measures as surrogate markers of disease progression in AD. Estimated sample sizes required to power a therapeutic trial in MCI were an order of magnitude less for MRI than for change measures based on cognitive tests/rating scales.

Psychometric tests and severity rating scales are the de facto gold standard for assessing disease progression in Alzheimer disease (AD). Change measures from serial imaging studies have been proposed as an adjunctive surrogate marker of disease progression in AD with the expectation that imaging may provide better sensitivity and precision than standard clinical and psychometric measures.1–4⇓⇓⇓ Various serial imaging approaches have been proposed, including different structural MRI atrophy rate measures and also serial measures of glucose metabolism with PET.1–3,5–9⇓⇓⇓⇓⇓⇓⇓ The fact that different serial imaging approaches have been proposed for largely the same objective raises obvious questions. Which imaging approach is best? Do some imaging measures of progression perform better than others at different stages of the disease?

The objectives of this study were to 1) establish atrophy rates for several MRI measurement techniques in different clinical stages of AD, 2) test the hypothesis that rates of atrophy correlate with clinical measures of disease progression, 3) test the hypothesis (separately among normal subjects and those with mild cognitive impairment [MCI] and AD) that the strength of the association between clinical progression and atrophy rates varies among different MRI measures, and 4) estimate sample sizes required to power a therapeutic trial in MCI. All subjects were classified as cognitively normal, MCI, or AD at baseline. Clinical progression was assessed in two ways: 1) among normal and MCI subjects, clinical conversion to a lower-functioning group over time, and among AD, slow vs fast progression; and 2) change in performance on specific cognitive tests and rating scales. Changes in volume of four brain structures over time were measured. Two were medial temporal lobe structures (hippocampus and entorhinal cortex [ERC]), and two were hemispheric measures (whole brain and ventricle). The four MRI measurements that we evaluated have received high levels of attention in the recent literature. We did not intend to conduct an exhaustive analysis of all possible imaging techniques.10–13⇓⇓⇓

Methods.

Recruitment and clinical characterization.

Patients and control subjects were recruited from the Mayo Alzheimer’s Disease Patient Registry (ADPR) and Alzheimer’s Disease Research Center (ADRC).14 These longitudinal studies of aging and dementia provide an ongoing mechanism for identification, enrollment, and longitudinal clinical characterization of both community and referral patients. Both the ADPR and the ADRC include MRI studies. These studies were performed with Mayo Institutional Review Board approval and informed consent of the subject or an appropriate proxy. At both baseline and follow-up assessments, the subjects must have been classified into one of three clinical groups: cognitively normal, MCI, or probable AD. Potential subjects who had cognitive symptoms that were clinically felt to be unrelated to AD were excluded. For example, subjects who experienced a stroke or who developed depression before or during the follow-up period were excluded. Study participants were assigned to diagnostic group categories during ADPR/ADRC Consensus Committee meetings consisting of a geriatrician, neurologist, neuropsychologist, psychometrist, and nurses who had seen the patient. The same Consensus Committee members assigned diagnostic group categories to patients at both the first and the second clinical follow-up point.

Categorization into diagnostic groups represented a clinical judgment that was based on the combined results of medical history, clinical exam, and psychometrics. Criteria for the diagnosis of normal cognition were as follows: 1) no active neurologic or psychiatric disorders, 2) any ongoing medical problems or their treatments did not interfere with cognitive function, 3) a normal neurologic exam, 4) no psychoactive medications, 5) independently functioning community dwellers. Criteria for the diagnosis of MCI were as follows: 1) memory complaint documented by the patient and collateral source, 2) normal general cognition, 3) normal activities of daily living, 4) no dementia (Diagnostic and Statistical Manual of Mental Disorders [3rd rev. ed.; DSM-IIIR]), 5) memory impairment for age and education.15 The diagnosis of MCI was a clinical categorization of individuals who displayed a memory impairment with relative preservation of other cognitive functions, that is, amnestic MCI.15–18⇓⇓⇓ The diagnosis of probable AD was made according to the DSM-IIIR criteria for dementia and National Institute of Neurologic and Communicative Disorders and Stroke/Alzheimer’s Disease and Related Disorders Association criteria for AD.19,20⇓

Clinical transition analysis.

In addition to the baseline diagnostic group assignment, each normal and MCI subject was further classified as either stable or converter. Subjects were designated as stable if their clinical classification assigned by the ADPR/ADRC Consensus Committee did not change; that is, normal subjects remained normal, and MCI subjects remained classified as MCI. Subjects were designated as converters if their clinical classification changed; that is, normal subjects converted to MCI or AD, or MCI subjects converted to AD. The AD group was dichotomized into slow progressor or fast progressor groups. A slow progressor was defined as an individual who did not decline on the Clinical Dementia Rating Scale (CDR) summary score.21 A fast AD progressor was defined as an individual who did decline on the CDR summary score. For the clinical transition analyses, therefore, each subject was assigned to one of six possible groups: normal stable, normal converter, MCI stable, MCI converter, AD slow progressor, or AD fast progressor.

All subjects in the ADPR/ADRC are followed with approximately annual clinical assessments. The interval between first and last MRI scans varied by baseline clinical group. The follow-up interval range for subjects who were classified as normal at baseline was 2.2 to 5.2 years; for subjects classified as MCI at baseline, 1.2 to 4.8 years; and for subjects classified as AD at baseline, 0.9 to 2.4 years.

MRI methods.

All MR studies were performed within 4 months of the matching clinical/psychometric assessment. The maximum interval between MRI and linked clinical assessment was 2 months in 131 subjects, 3 months in 22 subjects, and 4 months in 7 subjects. Results of the MRI studies were used clinically only to identify treatable causes of dementia. The numeric data on brain atrophy rates were produced for research purposes only, were unknown to the Consensus Committee throughout the study, and were not employed in the clinical classification process.

All patients were imaged at 1.5 T (Signa; General Electric Medical Systems, Milwaukee, WI) using a standardized imaging protocol. All volume measurements were derived from a T1-weighted three-dimensional volumetric spoiled gradient-recalled echo sequence with 124 continuous partitions, 1.6-mm slice thickness, a 22 × 16.5–cm field of view, 192 views, and 25° flip angle.

All image processing was performed by the same research associate who was blinded to all clinical information (e.g., age, gender, and clinical status). The date of each MR scan was masked in the image header file so that the imaging measures were done without knowledge of the chronologic ordering of the scans in each scan pair. The rates of atrophy for each of the four MR measures were expressed as percentage change in volume divided by the interval between the scans in years.

Hippocampal and ERC measurements were performed by manual tracing after several image-preprocessing steps had been performed.22 The three-dimensional image data set of the second scan was spatially registered with that of the first scan. The image data of both scans were then interpolated in-plane to the equivalent of a 512 × 512 matrix and magnified by 2. The images of the whole brain were then subvolumed to include the temporal lobes. An intensity inhomogeneity correction algorithm developed in-house was then applied to both MR scans. Tracing of the paired scans for each subject was performed side by side. After hippocampal and ERC boundaries had been delineated on each anatomic slice, the number of voxels was calculated automatically with a summing region-of-interest function. These were multiplied by voxel volume to give a numeric value in cubic millimeters.

The borders of the right and left hippocampi were manually traced for each slice sequentially from posterior to anterior. In-plane hippocampal anatomic boundaries were defined to include the CA1 through CA4 sectors of the hippocampus proper, the dentate gyrus, and subiculum.23 The posterior boundary of the hippocampus was determined by the oblique coronal anatomic section on which the crura of the fornices were identified in full profile.

We employed slight modifications of criteria published by Insausti et al. and Killiany et al. for determining boundaries of the ERC on MRI.24–26⇓⇓ Its inferolateral boundary was defined by the medial edge of the collateral sulcus posteriorly and by the rhinal sulcus anteriorly. In some cases, the sulcus was bi- or multilobed. In these sections, the more medially located sulcus was used as the border. The medial boundary was CSF in the crural cistern. The ERC was demarcated from the overlying subiculum by a medial extension of the horizontal line defined by the gray–white subicular interface. The posterior boundary of the ERC was defined as the first imaging section containing the intralimbic gyrus when progressing from posterior to anterior. In-plane boundaries were measured from this slice forward on six consecutive sections bilaterally.

Rates of change of the whole brain and ventricle were made using a home-built software algorithm, described in detail elsewhere.27 Inputs for this algorithm are two or more three-dimensional volumetric MRI scans obtained at different times. The algorithm begins with a series of data-preprocessing steps including extracting the brain from the overlying skull and scalp, creating binary masks of brain and ventricle, correcting B1 field nonuniformity, spatial alignment of the two image volumes, scaling correction, and intensity normalization. The preprocessed brain volumes are then entered into a module that computes change in brain and ventricular volume from baseline to follow-up MRI exam. This volume change computation method was modified from the SIENA28 software package (University of Colorado, Boulder). Volume change is determined at the brain–CSF interface over the entire three-dimensional surface of the registered brain volumes. Computation of volume change is conceptually very similar to the boundary shift integral method of Freeborough and Fox29 except that volume change is derived from a measure of the intensity gradient perpendicular to the brain–CSF interface in the registered MR volumes rather than from the absolute intensity difference.

Psychometric assessment.

Psychometric assessments within 4 months of MRI scans were obtained for 89% of normal, 98% of MCI, and 100% of AD subjects. We selected a limited number of tests from a more extensive testing battery for MRI–cognitive correlation analyses to appropriately avoid floor and ceiling effects. The Mini-Mental State Examination (MMSE)30 and Dementia Rating Scale (DRS) were employed for all subjects—normal, MCI, and AD—to provide continuity across all subjects in the study. The MMSE, although somewhat insensitive to change at the upper end of the cognitive range, was selected because it is widely used in the field. The DRS, although less widely used, has a greater dynamic range than the MMSE. The CDR was originally designed to stage disease severity in dementia, and we performed the correlations with the Sum of Boxes score only in the MCI and AD groups. For memory assessment, we employed the Auditory Verbal Learning Test (AVLT)–Delayed Recall and the percentage retention on the Logical Memory II Subtest of the Wechsler Memory Scale–Revised (LM II [%]).31,32⇓ The AVLT–Delayed Recall is a relatively difficult test, and therefore AVLT–MRI correlations were performed only in the cognitively normal baseline cohort. The LM II (%) is less difficult than the AVLT and was used to provide a memory measure common to the normal and MCI groups. The change from baseline to follow-up performance was measured in each subject and annualized.

Statistical methods.

The use of different intervals between baseline and follow-up for individuals in each of the three baseline clinical groups was an intentional feature of the study design. Rates of clinical transition are an order of magnitude greater for individuals with MCI vs cognitively normal subjects: 12 to 15%/year of individuals with MCI will decline to AD, whereas only 1 to 2%/year of normal subjects will decline to MCI.16,33⇓ To observe a comparable number of conversion events, either the number of normal subjects enrolled would have to be an order of magnitude greater than the number of MCI subjects or the follow-up interval would have to be greater for normal vs MCI subjects. We chose the latter approach. We did ensure, however, that the follow-up interval was approximately the same between control vs stable members of the normal and MCI cohorts and between fast- vs slow-progressing AD subjects.34 The rate comparisons of interest were within members of the three baseline clinical groups.

The distributions of many of the MRI and psychometric variables were skewed. Therefore, for the sake of consistency, all summary statistics for quantitative variables are reported as median values and variability as interquartile range (IQR). All tests for significance were performed using nonparametric methods and were two sided. For both MRI and cognitive measures, tests for differences in rates of change between stable vs converter normal and MCI subjects and between fast vs slow AD progressor subjects were performed using rank sum tests. Correlations between change in MRI volumes and change in cognitive scores were tested for significance using Spearman correlations.

To test whether the strength of the association between rate of atrophy and clinical transition status (stable vs converter, fast vs slow for AD) differed among the four MR measurements, we used the basic approach proposed by Choi35 separately for each cohort (normal, MCI, AD). To illustrate using the normal cohort, the dependent variable was defined as 1 if stable and 0 if converter. Four independent variables (x1, x2, x3, and x4) were defined, one for each MR rate measurement, as the ranks of the volumes in the pooled (stable plus converter) cohort. Defining z1 = x1 − x2, z2 = x1 + x2 − 2x3, and z3 = x1 + x2 + x3 − 3x4, we tested that clinical transition status was unrelated to the three z variables using logistic regression. This is equivalent to testing that the association between clinical transition status and rate of atrophy is the same among the four MRI measurements.35 To compare the associations between only two atrophy measurement techniques, only z1 is defined, and a rank sum test was used to compare z1 values between stable and converter subgroups. This approach tests the null hypothesis that the distribution overlap between the two subgroups (stable vs converter, e.g.) is the same for each MRI rate measurement.

The ability of longitudinal change in volume to distinguish between stable vs converter (or fast vs slow AD) subgroups depends on the overlap between the two subgroups, and this in turn depends on both the differences in the medians and the variability in the data. It is desirable to have an index measuring the overlap between groups for each MRI rate measurement. For this purpose, we performed a logistic regression discriminating between the two subgroups for each MRI measurement. Overlap may be measured by the odds ratio (OR) from the logistic regression. The independent variable was defined as the percentile of the annual percentage change (APC) in the pooled (stable plus converter subgroups) data set. The resulting OR per decile measures the overlap between stable vs converter (or fast vs slow AD) subgroups.

Recognizing general interest in sample size estimates for therapeutic trials using imaging, we provided power calculations for 25 and 50% treatment effect sizes in the MCI group. Effect size represents a 25 or 50% reduction in the median transformed rates of MRI atrophy or change in cognitive test/rating scale performance. For a given MRI or cognitive measure, we calculated the median observed value among all MCI subjects as well as the median we would expect to see under a 50 or 25% improvement in the rate of decline. We next found a transformation that would make the observed data approximately normal and applied this transformation to the observed median and the improvement median. The difference between these two values became the effect size we sought to detect with 90% power using an unpaired two-sided t-test. To estimate the population standard deviation on the scale used for the t-test, we calculated the sample standard deviation of the transformed data. The transformations used were of the form y = (x + c)p. Here, x is the observed rate of change, c is the smallest integer ≥0 such that x + c is positive for all x, and p = 1/2 when the data were right skewed or p = 2 when the data were left skewed. As the MMSE measurements were approximately normal, observed means were used rather than medians to calculate effect size, and no transformation was performed.

An understanding of the precision of the four different MR measurements is helpful in interpreting the results. Most of the published data on this topic address the precision of repeated measures of the volume of a particular brain structure (e.g., hippocampal volume), which is not the issue here. We are interested in the test–retest reproducibility of measurements of change (i.e., reproducibility of Δ measurements). To provide these data, three subjects were randomly selected from each of the six clinical groups in this study. These 18 subjects had all MR measurements repeated 1 year later by same research associate, who was blinded to results of the first measurements. The difference in APC as measured initially minus the APC as measured 1 year later was calculated. We refer to these differences as Δ values. Precision was measured two ways. First, we computed the difference (Δ) between the two APC values for each subject and the corresponding IQR for each of the four MRI measures. To test for differences among MRI measures, we performed the Friedman two-way analysis of variance on the ranks of the absolute values of the differences. Pairwise comparisons were performed using signed rank tests on the absolute differences. With the second approach, we calculated intraclass correlations (ICC) based on the ranks of the 18 original + 18 retest = 36 APC. This nonparametric ICC represents the proportion of total variability in the ordering of the measurements that is due to person-to-person variability: (1 − ICC) is the proportion of total variability due to test–retest variability.

Each subject’s baseline MRI volumes served an as internal control for intersubject variation in head size. Therefore, there was no need to perform brain volume normalization when comparing rates among different subjects.34

Results.

Descriptive information is found in table 1. Of the 55 subjects who were cognitively normal at baseline, 13 converted to MCI and 2 to AD during follow-up. For the most part, therefore, data pertaining to normal converters in this study represent conversion to MCI. Of the 41 subjects who entered the study as MCI, 26 converted to AD. Of the 64 AD subjects at baseline, 31 were classified as slow progressors and 33 as fast progressors. The number of women exceeded the number of men in most of the clinical subgroups, as would be expected in this age range. The proportion of APOE4 carriers was fewer in the normal stable group than in the five other groups, as would be expected. At the time of entry into the study, the ages of the subjects ranged from 52 to 94 years. The median age at entry into the study did not vary significantly across the three baseline clinical groups.

View this table:
  • View inline
  • View popup

Table 1 Descriptive information

APC in volume by clinical group and by MRI measurement technique are found in table 2. Rates of atrophy were greater in converter than stable normal subjects, greater in converter than stable MCI subjects, and greater in fast- vs slow-progressing AD subjects. These pairwise differences in atrophy rates were significant for each of the four MRI measurements with three exceptions (see table 2). The variability (IQR) in change was also consistently greater in the converter/fast progressor groups vs the stable/slow progressor groups.

View this table:
  • View inline
  • View popup

Table 2 Annualized rates of change by clinical group and MRI measurement technique

The relative strength of the association between rate of atrophy and clinical transition (or fast- vs slow-progressing AD) among the four MRI measures can be envisioned as vertical comparisons within the columns of table 2. The strength of these associations, using an index of OR and 95% CI for a 1-decile decline in atrophy rate, is shown in figure 1. To illustrate, the OR for the hippocampus in normal subjects was 1.65. This means that among the pooled group of normal subjects, the risk of being a converter is 1.65 times higher with a hippocampal atrophy rate at the 70th percentile than for a subject with an atrophy rate at the 60th percentile. There was no difference in the relative associations among the four MRI rate measurements in the normal (p = 0.226) or AD (p = 0.279) cohorts (Choi test). The difference was significant in the MCI cohort (p = 0.007), where in pairwise comparisons, the only significant difference was between the whole brain and ventricle (p = 0.003).

Figure1
  • Download figure
  • Open in new tab
  • Download powerpoint

Figure 1. Comparing associations across MRI measurements within baseline clinical group. Shown are estimated odds ratios and 95% CI for clinical conversion among normal or mild cognitive impairment (MCI) (or fast progression in Alzheimer disease [AD]), given a 1-decile increase in annual percentage MRI rate (e.g., from the 60th to the 70th percentile).

Annualized change in cognitive test performance by group is found in table 3. Rates of decline on cognitive test performance were greater among converter than stable normal subjects, greater among converter than stable MCI subjects, and greater among fast- vs slow-progressing AD subjects. These pairwise differences in annual change in cognitive test performance were significant for each of the cognitive tests/rating scales assessed, with three exceptions (see table 3).

View this table:
  • View inline
  • View popup

Table 3 Annualized change in cognitive test performance by group

Table 4 depicts the proportion of each of the six cohorts that declined over time on MRI and cognitive tests/rating scales. In general, a greater proportion of subjects in each clinical group declined on imaging compared with cognitive tests/rating scales.

View this table:
  • View inline
  • View popup

Table 4 Percentage of subjects declining by group for each MRI and cognitive measure

Table 5 lists estimated sample sizes needed per group to detect a 25 or 50% reduction in the four MRI rate measures as well as the MMSE and CDR–Sum of Boxes. The sample sizes required are markedly less for MRI than for the cognitive/rating scale measures.

View this table:
  • View inline
  • View popup

Table 5 Sample size estimates needed per group to detect differences equaling 50 or 25% of observed median* rate of change among MCI patients

Among normal subjects, correlations between change in MRI and change in cognitive performance were evaluated for four cognitive tests: MMSE, DRS, LM II (%), and AVLT–Delayed Recall (table 6). There were no significant correlations for any of the change scores on cognitive tests with the hippocampal or ERC rate measure. Both the whole-brain and the ventricular rate measures were correlated with all cognitive test change scores except LM II (%) (figure 2).

View this table:
  • View inline
  • View popup

Table 6 Correlation between change in MRI and change in cognitive test performance among normal subjects

Figure2
  • Download figure
  • Open in new tab
  • Download powerpoint

Figure 2. Correlation between annual change in Dementia Rating Scale (DRS) score and annual percentage change in whole-brain volume. Normal subjects (A) and subject with mild cognitive impairment (B) and Alzheimer disease (C) are presented.

Among MCI subjects, correlations were calculated between change in MRI and change in performance on four cognitive tests/rating scales: MMSE, DRS, LM II (%), and CDR–Sum of Boxes (table 7). Significant correlations were seen for the hippocampal rate only with the change in DRS and for the ERC rate only with the change in CDR–Sum of Boxes. With one exception, both the whole-brain and the ventricular rate measures were correlated with the change on all cognitive tests/rating scales (see figure 2).

View this table:
  • View inline
  • View popup

Table 7 Correlation between change in MRI and change in cognitive test/rating scale performance among MCI subjects

Among AD subjects, correlations were performed with MMSE, DRS, and CDR–Sum of Boxes (table 8). For both the hippocampus and the ERC, only the correlation with change on the MMSE was significant. Both the whole-brain and the ventricular rate measures were correlated with change on all cognitive tests/rating scales (see figure 2).

View this table:
  • View inline
  • View popup

Table 8 Correlation between change in MRI and change in cognitive test/rating scale performance among AD subjects

Figure 3 shows the APC in the four MRI measures as measured initially minus the APC as measured 1 year later. We refer to these differences in measured APC as the Δ values. The plots do not suggest systematic differences between the first and second APC measurements (i.e., values are centered at 0) but do indicate that reproducibility varies by MRI measurement technique. To quantify these results, we computed median and IQR of the Δ. The medians of the Δ were not different from 0 for any of the four MRI measures. The IQR in units of APC × 10−3 were 0.76 for whole brain, 1.84 for ventricle, 2.30 for hippocampus, and 13.71 for ERC. The absolute magnitude of the Δ values differed among MRI measures (p < 0.001). Pairwise tests indicate that ERC rate measurements were less precise than ventricle (p = 0.001), hippocampus (p = 0.005), and whole brain (p < 0.001). Whole-brain rate measurements were more precise than hippocampal (p = 0.005) and ventricle (p = 0.018) measurements. No difference in precision was found between ventricle and hippocampal rate measurements. Nonparametric ICC for the test–retest reproducibility of the rate measurements were as follows: ventricle 0.91, hippocampus 0.91, whole brain 0.89, and ERC 0.47.

Figure3
  • Download figure
  • Open in new tab
  • Download powerpoint

Figure 3. Differences in annual percentage change (APC) in volume measured initially and 1 year later. HP = hippocampus; ERC = entorhinal cortex; WB = whole brain; VENT = ventricle.

Discussion.

In this study, we examined associations between change in several structural MRI measures over time with clinical measures of disease progression in normal, MCI, and AD subjects. Clinical progression was defined in two ways. We dichotomized clinical progression within each baseline cohort, and we also measured change over time on specific cognitive tests/rating scales.

In general, each of the four MRI rate measurements was significantly associated with dichotomized indexes of clinical progression, and the associations were consistently in the expected direction: Rates of atrophy in normal or MCI subjects who converted to a lower-functioning group (or fast progression in the case of AD) were greater than atrophy rates in normal or MCI subjects who were stable (or slow progression in AD) (see table 2). Also, the rates of normal and MCI converter subjects were similar to those of AD, whereas stable MCI rates were similar to those of stable normal subjects, indicating that the MRI change measures correlate much more closely with disease progression than with disease stage at baseline.

At the outset, we expected to find that medial temporal lobe rate measures, hippocampus and ERC, would be more strongly associated with the conversion from normal to MCI and measures of hemispheric atrophy rates, whole brain and ventricle, would be more strongly associated with clinical progression at later stages of the disease, specifically among AD subjects. This expectation was based on the known topographic progression of neurofibrillary pathology in AD from medial temporal lobe limbic areas early in the disease to neocortical association areas later.36 Most of the normal subjects who converted became MCI. This clinical transition is characterized pathologically by disease progression predominantly in medial temporal limbic cortex. Hippocampal and ERC measures directly measure the rate of change in only these structures. Conversely, individuals who started the study as AD, by definition, already had extensive neocortical pathology at baseline. The whole-brain and ventricular measures, although not region specific, are certainly dominated by tissue loss that is occurring in a widespread manner throughout the brain, not just the medial temporal lobe. It seemed reasonable a priori to expect that a measurement of global brain atrophy ought to be more sensitive to change at the stage in the disease when pathology was spreading throughout the brain. We did not find the anticipated differences among the four MRI rate measures in the strength of the correlation with clinical transition at different stages of the disease. However, in some instances, there is the possibility that differences may exist that we were unable to detect owing to sample size limitations, and this possibility is reflected in the 95% CI in figure 1.

The correlations observed between the four MR measures and change in specific cognitive tests/rating scales were also unexpected in some ways (see tables 6 to 8⇑⇑). We expected that the most consistent MR–cognitive correlation in normal subjects would be between changes in memory (AVLT and LM II [%]) and medial temporal lobe MR rate measures (hippocampus and entorhinal cortex). Instead, the most consistent correlations were seen with the hemispheric rate measures for all cognitive tests/rating scales, in all three baseline clinical groups: normal, MCI, and AD. One partial explanation for this is found in the MRI rate measurement precision data (see figure 3). ERC rate measurements were substantially less precise than all other measurements, and the precision of the whole-brain rate measure was better than in the hippocampus. However, the measurement precision data cannot explain the greater cognitive test/rating scale correlations with the ventricle vs the hippocampus, because the reproducibility of these two MRI rate measurements was roughly equal.

Cognitive test/rating scale changes generally had the expected associations with clinical conversion or lack thereof (or slow vs fast progression in AD) (see table 3). Of interest is the fact that there were “improvements” in cognitive performance among some members of every clinical group, for every cognitive test/rating scale evaluated. Some subjects also had a positive change in brain volume (or correspondingly a negative change in ventricular volume); however, this was distinctly uncommon. And among subjects who ought to show decline (i.e., most MCI and all AD subjects), the proportion that declined was usually significantly greater on MRI than cognitive tests/rating scales (see table 4). Although they both relate to the brain, cognitive tests are obviously different from volumetrics. The former reflect function; the latter reflect structure. Different factors contribute to a person’s ability to complete tests well than contribute to the accurate measurement of brain volume. A person’s cognitive functioning at any single point in time is only partially determined by his/her true cognitive endowment (i.e., the “ability” that the test attempts to measure). Motivation and effort, experiences relating to and comfort with testing, general health, medications used, emotional distress, fatigue, etc., all contribute to cognitive test and rating scale variability, but none of these affects volumetric measures. If a person’s brain volume increases from time 1 to time 2, that “increase” is most likely due to measurement error. However, if a person’s cognitive performance improves from time 1 to time 2, that improvement is not necessarily measurement error—even in AD patients. Nonetheless, these data raise questions about which is a more reliable measure of disease progression in AD: tests that fluctuate in response to many factors that are unrelated to underlying disease progression or MRI measures, which seem inherently more stable. It is also possible that combining structural MRI and cognitive testing would produce more meaningful measures of disease progression than either alone.

Assuming a common standard of a 25 or 50% reduction in the rate of deterioration over 1 year for all measures, the sample sizes required for clinical trials in MCI should be substantially smaller for the MRI measures vs the cognitive tests/rating scales evaluated. In practice, attrition would have to be built into sample size estimates. In addition, one could argue that the annual rate of change observed for each individual measure in stable normal subjects should be subtracted from the rate in MCI patients to assess the rate of change due specifically to disease progression and thus “available for therapeutic modification.” We did not build either of these effects into the sample size calculations. However, the purpose of the analysis was to compare the measures head to head using common criteria in the same group of MCI patents, and in these data, the MRI measures outperformed the cognitive tests/rating scales evaluated.

We do not interpret the results of this study to indicate that medial temporal lobe measures have no clinical utility. Cross-sectional medial temporal lobe MRI measures have proven value in the early diagnosis of AD and prediction of future development of AD.37–41⇓⇓⇓⇓ Further evidence for the utility of medial temporal lobe measures as a sensitive early marker of disease comes from a recent serial MRI study, in which changes in medial temporal lobe volumes of subjects destined to develop familial AD diverged from the trajectory of normally aging subjects earlier than hemispheric measures.42 The data from our study address a different question: Which MRI measures track with clinical change during (not before) clinical transitions?

The data from this study have implications for the use of imaging as surrogate marker of disease progression in therapeutic trials for AD. First, there was no apparent advantage of medial temporal over hemispheric rate measures for sensitivity to clinical conversion early in the disease process, that is, within the normal and MCI groups. In addition, a trend was present suggesting better correlation between change on MRI and change on cognitive test/rating scale performance for hemispheric atrophy rates (whole brain and ventricle) compared with medial temporal lobe atrophy rates (hippocampus and ERC). Therefore, the more automated and less labor-intensive hemispheric method might be preferable as a measure of disease progression in certain clinical trials. Second, unreliable assessment of disease progression was significantly more frequent with cognitive tests/rating scales than with the MRI measures. The greater precision of MRI translates into much smaller estimated sample size requirements for clinical trials in MCI. These data support the use of imaging in addition to standard clinical/psychometric measures as surrogate markers of disease progression in AD therapeutic trials. A distinction should be made between validation of a surrogate measure of therapeutic efficacy and validation of a surrogate marker of disease progression. In the absence of a positive disease-modifying therapeutic trial (which has yet to occur) that included imaging, one cannot claim to have validated imaging as a surrogate marker of therapeutic efficacy. However, one can claim to validate an imaging marker of disease progression in a natural history study such as this where the data indicate clear-cut and reproducible correlations between multiple measures of clinical disease progression and measures of change on structural MRI.

Acknowledgments

Supported by the National Institute on Aging (AG11378, AG06786, AG16574).

  • Received March 10, 2003.
  • Accepted October 28, 2003.

References

  1. ↵
    Fox NC, Freeborough PA. Brain atrophy progression measured from registered serial MRI: validation and application to Alzheimer’s disease. J Magn Res Imag. 1997; 7: 1069–1075.
    OpenUrlPubMed
  2. ↵
    Fox NC, Cousens S, Scahill R, et al. Using serial registered brain magnetic resonance imaging to measure disease progression in Alzheimer disease. Arch Neurol. 2000; 57: 339–443.
    OpenUrlCrossRefPubMed
  3. ↵
    Reiman EM, Caselli RJ, Chen K, et al. Declining brain activity in cognitively normal apolipoprotein E E4 heterozygotes: a foundation for using positron emission tomography to efficiently test treatments to prevent Alzheimer’s disease. Proc Natl Acad Sci USA. 2001; 98: 3334–3339.
    OpenUrlAbstract/FREE Full Text
  4. ↵
    Jack CRJ, Slomkowski M, Gracon S, et al. MRI as a biomarker of disease progression in a therapeutic trial of Milameline for Alzheimer’s. Neurology. 2003; 60: 253–260.
    OpenUrlAbstract/FREE Full Text
  5. ↵
    Fox NC, Scahill RI, Crum WR, et al. Correlation between rates of brain atrophy and cognitive decline in AD. Neurology. 1999; 52: 1687–1689.
    OpenUrlAbstract/FREE Full Text
  6. ↵
    de Leon MJ, Convit A, Wolf OT, et al. Prediction of cognitive decline in normal elderly subjects with 2-[18F]fluoro-2-deoxy-d-glucose/positron-emission tomography (FDG/PET). Proc Natl Acad Sci USA. 2001; 98: 10966–10971.
    OpenUrlAbstract/FREE Full Text
  7. ↵
    Jack CR Jr, Petersen RC, Xu YC, et al. Hippocampal atrophy and apolipoprotein E genotype are independently associated with Alzheimer’s disease. Ann Neurol. 1998; 43: 303–310.
    OpenUrlCrossRefPubMed
  8. ↵
    Small GW, Ercoli LM, Silverman DH, et al. Cerebral metabolic and cognitive decline in persons at genetic risk for Alzheimer’s disease. Proc Natl Acad Sci USA. 2000; 87: 6037–6042.
    OpenUrl
  9. ↵
    Du AT, Schuff N, Zhu XP, et al. Atrophy rates of entorhinal cortex in AD and normal aging. Neurology. 2003; 60: 481–486.
    OpenUrlAbstract/FREE Full Text
  10. ↵
    Rombouts SA, Barkhof F, Witter MP, et al. Unbiased whole-brain analysis of gray matter loss in Alzheimer’s disease. Neurosci Lett. 2000; 285: 231–233.
    OpenUrlCrossRefPubMed
  11. ↵
    Karas GB, Burton EJ, Rombouts SARB, et al. A comprehensive study of gray matter loss in patients with Alzheimer’s disease using optimized voxel-based morphometry. Neuroimage. 2003; 18: 895–907.
    OpenUrlCrossRefPubMed
  12. ↵
    Studholme C, Cardenas V, Schuff N, et al. Detecting spatially consistent structural differences in Alzheimer’s and frontotemporal dementia using deformation morphometry. In: MICCAI 4th International Conference, 2001. Utrecht: Springer, 2001: 41–48.
  13. ↵
    Chetelat G, Desgranges B, de la Sayette V, et al. Mapping gray matter loss with voxel-based morphometry in mild cognitive impairment. Brain Imag. 2002; 13: 1939.
    OpenUrl
  14. ↵
    Petersen RC, Kokmen E, Tangalos EG, et al. Mayo Clinic Alzheimer’s Disease Patient Registry. Aging. 1990; 2: 408–415.
    OpenUrlPubMed
  15. ↵
    Petersen RC, Morris J. Clinical features in mild cognitive impairment: aging to Alzheimer’s disease. New York: Oxford University Press, 2003: 15–40.
  16. ↵
    Petersen RC, Smith GE, Waring SC, et al. Mild cognitive impairment clinical characterization and outcome. Arch Neurol. 1999; 56: 303–308.
    OpenUrlCrossRefPubMed
  17. ↵
    Petersen RC, Smith GE, Waring SC, et al. Aging, memory, and mild cognitive impairment. Int Psychogeriatr. 1997; 9: 65–69.
  18. ↵
    Smith GE, Petersen RC, Parisi JE, et al. Definition, course, and outcome of mild cognitive impairment. Aging Cogn Neuropsychology. 1996; 3: 141–147.
    OpenUrl
  19. ↵
    American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 3rd rev. ed. Washington, DC: American Psychiatric Press, 1987.
  20. ↵
    McKhann G, Drachman D, Folstein M, et al. Clinical diagnosis of Alzheimer’s disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease. Neurology. 1984; 34: 939–944.
    OpenUrlAbstract/FREE Full Text
  21. ↵
    Morris JC. The Clinical Dementia Rating (CDR): current version and scoring rules. Neurology. 1993; 43: 2412–2414.
  22. ↵
    Jack CR Jr. MRI-based hippocampal volume measurements in epilepsy. Epilepsia. 1994; 35 (suppl 6): S21—S29.
  23. ↵
    Jack CR Jr, Petersen RC, Xu YC, et al. Medial temporal atrophy on MRI in normal aging and very mild Alzheimer’s disease. Neurology. 1997; 49: 786–794.
    OpenUrlAbstract/FREE Full Text
  24. ↵
    Xu Y, Jack C Jr, O’Brien PC, et al. Usefulness of MRI measures of entorhinal cortex vs hippocampus in AD. Neurology. 2000; 54: 1760–1767.
    OpenUrlAbstract/FREE Full Text
  25. ↵
    Insausti R, Juottonen K, Soininen H, et al. MR volumetric analysis of the human entorhinal, perirhinal, and temporopolar cortices. AJNR Am J Neuroradiol. 1998; 19: 659–671.
    OpenUrlAbstract
  26. ↵
    Killiany RJ, Moss MB, Albert MS, et al. Temporal lobe regions on magnetic resonance imaging identify patients with early Alzheimer’s disease. Arch Neurol. 1993; 50: 949–954.
    OpenUrlCrossRefPubMed
  27. ↵
    Gunter JL, Shiung MM, Manduca A, et al. Methodological considerations for measuring rates of brain atrophy. J Magn Res Imag. 2003; 18: 16–24.
    OpenUrlCrossRefPubMed
  28. ↵
    Smith SM, Zhang Y, Jenkinson M, et al. Accurate, robust, and automated longitudinal and cross-sectional brain change analysis. Neuroimage. 2002; 17: 479–489.
    OpenUrlCrossRefPubMed
  29. ↵
    Freeborough PA, Fox NC. The boundary shift integral: an accurate and robust measure of cerebral volume changes from registered repeat MRI. IEEE Trans Med Imag. 1997; 15: 623–629.
    OpenUrl
  30. ↵
    Mattis S. Dementia Rating Scale: Professional Manual. Odessa, FL: Psychological Assessment Resources, Inc., 1988.
  31. ↵
    Rey A. L’examen clinique en psychologie. Paris: Presses Universitaires de France, 1964.
  32. ↵
    Wechsler D. Wechsler Memory Scale–Revised. New York: Psychological Corp., 1987.
  33. ↵
    Petersen RC, Waring SC, Smith GE, et al. Predictive value of APOE genotyping in incipient Alzheimer’s disease. Ann NY Acad Sci. 1996; 802: 58–69.
    OpenUrlPubMed
  34. ↵
    Jack CR Jr, Petersen RC, Xu Y, et al. Rates of hippocampal atrophy in normal aging, mild cognitive impairment, and Alzheimer’s disease. Neurology. 2000; 55: 484–489.
    OpenUrlAbstract/FREE Full Text
  35. ↵
    Choi S. Tests of equality of dependent correlation coefficients. Biometrika. 1977; 64: 645–647.
    OpenUrlAbstract/FREE Full Text
  36. ↵
    Braak H, Braak E. Morphological criteria for the recognition of Alzheimer’s disease and the distribution pattern of cortical changes related to this disorder. Neurobiol Aging. 1994; 15: 355–356.
    OpenUrlCrossRefPubMed
  37. ↵
    Killiany RJ, Hyman BT, Gopmez–Isla T, et al. MRI measures of entorhinal cortex vs hippocampus in preclinical AD. Neurology. 2002; 58: 1188–1196.
    OpenUrlAbstract/FREE Full Text
  38. ↵
    Killiany R, Gomez–Isla T, Moss M, et al. Use of structural magnetic resonance imaging to predict who will get Alzheimer’s disease. Ann Neurol. 2000; 47: 430–439.
    OpenUrlCrossRefPubMed
  39. ↵
    Dickerson BC, Goncharova I, Sullivan MP, et al. MRI-derived entorhinal and hippocampal atrophy in incipient and very mild Alzheimer’s disease. Neurobiol Aging. 2001; 22: 747–754.
    OpenUrlCrossRefPubMed
  40. ↵
    Visser PJ, Scheltens P, Verhey FRJ, et al. Medial temporal lobe atrophy and memory dysfunction as predictors for dementia in subjects with mild cognitive impairment. J Neurol. 1999; 246: 477–485.
    OpenUrlCrossRefPubMed
  41. ↵
    Jack CR Jr, Petersen RC, Xu Y, et al. Prediction of AD with MRI-based hippocampal volume in mild cognitive impairment. Neurology. 1999; 52: 1397–1403.
    OpenUrlAbstract/FREE Full Text
  42. ↵
    Schott JM, Fox NC, Frost C, et al. Assessing the onset of structural change in familial Alzheimer’s disease. Ann Neurol. 2003; 53: 181–188.
    OpenUrlCrossRefPubMed
View Abstract

Disputes & Debates: Rapid online correspondence

No comments have been published for this article.
Comment

NOTE: All authors' disclosures must be entered and current in our database before comments can be posted. Enter and update disclosures at http://submit.neurology.org. Exception: replies to comments concerning an article you originally authored do not require updated disclosures.

  • Stay timely. Submit only on articles published within the last 8 weeks.
  • Do not be redundant. Read any comments already posted on the article prior to submission.
  • 200 words maximum.
  • 5 references maximum. Reference 1 must be the article on which you are commenting.
  • 5 authors maximum. Exception: replies can include all original authors of the article.
  • Submitted comments are subject to editing and editor review prior to posting.

More guidelines and information on Disputes & Debates

Compose Comment

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
NOTE: The first author must also be the corresponding author of the comment.
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g. higgs-boson@gmail.com
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Publishing Agreement
NOTE: All authors, besides the first/corresponding author, must complete a separate Disputes & Debates Submission Form and provide via email to the editorial office before comments can be posted.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Vertical Tabs

You May Also be Interested in

Back to top
  • Article
    • Abstract
    • Methods.
    • Results.
    • Discussion.
    • Acknowledgments
    • References
  • Figures & Data
  • Info & Disclosures
Advertisement

Related Articles

  • No related articles found.

Topics Discussed

  • Alzheimer's disease
  • MRI
  • Volumetric MRI

Alert Me

  • Alert me when eletters are published
Neurology: 96 (3)

Articles

  • Ahead of Print
  • Current Issue
  • Past Issues
  • Popular Articles
  • Translations

About

  • About the Journals
  • Ethics Policies
  • Editors & Editorial Board
  • Contact Us
  • Advertise

Submit

  • Author Center
  • Submit a Manuscript
  • Information for Reviewers
  • AAN Guidelines
  • Permissions

Subscribers

  • Subscribe
  • Activate a Subscription
  • Sign up for eAlerts
  • RSS Feed
Site Logo
  • Visit neurology Template on Facebook
  • Follow neurology Template on Twitter
  • Visit Neurology on YouTube
  • Neurology
  • Neurology: Clinical Practice
  • Neurology: Genetics
  • Neurology: Neuroimmunology & Neuroinflammation
  • AAN.com
  • AANnews
  • Continuum
  • Brain & Life
  • Neurology Today

Wolters Kluwer Logo

Neurology | Print ISSN:0028-3878
Online ISSN:1526-632X

© 2021 American Academy of Neurology

  • Privacy Policy
  • Feedback
  • Advertise