Advertisement
Review| Volume 70, ISSUE 1, P13-18, July 01, 2011

Download started.

Ok

Using Brain Imaging Measures in Studies of Procognitive Pharmacologic Agents in Schizophrenia: Psychometric and Quality Assurance Considerations

Published:February 22, 2011DOI:https://doi.org/10.1016/j.biopsych.2011.01.004
      The first phase of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICs) initiative focused on the identification of cognitive constructs from human and animal neuroscience that were relevant to understanding cognitive deficits in schizophrenia, as well as promising task paradigms that could be used to assess these constructs behaviorally. The current phase of CNTRICs has the goal of expanding this initial work by including measures of brain function that can augment these behavioral tasks as biomarkers to be used in drug development processing. Here we review many of the psychometric issues that need to be addressed regarding the development and inclusion of such methods in the drug development process. In addition, we review quality assurance concerns, issues associated with multicenter trials, concerns associated with potential pharmacologic confounds on imaging measures, as well as power and analysis considerations. Although review is couched in the context of the use of biomarkers for treatment studies in schizophrenia, we believe the issues and suggestions included are relevant to the entire range of neuropsychiatric disorders as well as to a wide range of imaging modalities (i.e., functional magnetic resonance imaging, positron emission tomography, event-related potentials, electroencephalography, transcranial magnetic stimulation, near infrared spectroscopy, etc.) and are relevant to both pharmacologic and psychological intervention approaches.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Biological Psychiatry
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Breier A.
        Developing drugs for cognitive impairment in schizophrenia.
        Schizophr Bull. 2005; 31: 816-822
        • Cho R.Y.
        • Ford J.M.
        • Krystal J.H.
        • Laruelle M.
        • Cuthbert B.N.
        • Carter C.S.
        Functional neuroimaging and electrophysiology biomarkers for clinical trials for cognition in schizophrenia.
        Schizophr Bull. 2005; 31: 865-869
        • Lewis D.A.
        • Cho R.Y.
        • Carter C.S.
        • Eklund K.
        • Forster S.
        • Kelly M.A.
        • Montrose D.
        Subunit-selective modulation of GABA type A receptor neurotransmission and cognition in schizophrenia.
        Am J Psychiatry. 2008; 165: 1585-1593
        • Barch D.M.
        • Berman M.G.
        • Engle R.
        • Jones J.H.
        • Jonides J.
        • Macdonald 3rd, A.
        • et al.
        CNTRICS final task selection: Working memory.
        Schizophr Bull. 2009; 35: 136-152
        • Rogosa D.R.
        • Brandt D.
        • Zimowski M.
        A growth curve approach to the measurement of change.
        Psychol Bull. 1982; 92: 726-748
        • Rogosa D.R.
        • Willett J.B.
        Understanding correlates of change by modeling individual differences in growth.
        Psychometriika. 1983; 50: 203-228
        • Shrout P.E.
        • Fleiss J.L.
        Intraclass correlations: Uses in assessing rater reliability.
        Psychol Bull. 1979; 86: 420-428
        • Cronbach L.J.
        Coefficient alpha and the internal structure of tests.
        Psychometriika. 1951; 16: 297-334
        • Caceres A.
        • Hall D.L.
        • Zelaya F.O.
        • Williams S.C.
        • Mehta M.A.
        Measuring fMRI reliability with the intra-class correlation coefficient.
        Neuroimage. 2009; 45: 758-768
        • Raemaekers M.
        • Vink M.
        • Zandbelt B.
        • van Wezel R.J.
        • Kahn R.S.
        • Ramsey N.F.
        Test–retest reliability of fMRI activation during prosaccades and antisaccades.
        Neuroimage. 2007; 36: 532-542
        • Zandbelt B.B.
        • Gladwin T.E.
        • Raemaekers M.
        • van Buuren M.
        • Neggers S.F.
        • Kahn R.S.
        • et al.
        Within-subject variation in BOLD-fMRI signal changes across repeated measurements: Quantification and implications for sample size.
        Neuroimage. 2008; 42: 196-206
        • Specht K.
        • Willmes K.
        • Shah N.J.
        • Jancke L.
        Assessment of reliability in functional imaging studies.
        J Magn Reson Imaging. 2003; 17: 463-471
        • Fernandez G.
        • Specht K.
        • Weis S.
        • Tendolkar I.
        • Reuber M.
        • Fell J.
        • et al.
        Intrasubject reproducibility of presurgical language lateralization and mapping using fMRI.
        Neurology. 2003; 60: 969-975
        • Aron A.R.
        • Gluck M.A.
        • Poldrack R.A.
        Long-term test–retest reliability of functional MRI in a classification learning task.
        Neuroimage. 2006; 29: 1000-1006
        • Friedman L.
        • Stern H.
        • Brown G.G.
        • Mathalon D.H.
        • Turner J.
        • Glover G.H.
        • et al.
        Test–retest and between-site reliability in a multicenter fMRI study.
        Hum Brain Mapp. 2008; 29: 958-972
        • Raemaekers M.
        • Vink M.
        • Zandbeldt B.B.
        • van Wezel R.J.
        • Kahn R.
        • Ramsey N.F.
        Test-retest reliablity of fMRI activation during prosaccades and antisaccades.
        Neuroimage. 2007; 36: 532-542
        • Manoach D.S.
        • Halpern E.F.
        • Kramer T.S.
        • Chang Y.
        • Goff D.C.
        • Rauch S.L.
        • et al.
        Test–retest reliability of a functional MRI working memory paradigm in normal and schizophrenic subjects.
        Am J Psychiatry. 2001; 158: 955-958
        • Wei X.
        • Yoo S.S.
        • Dickey C.C.
        • Zou K.H.
        • Guttmann C.R.
        • Panych L.P.
        Functional MRI of auditory verbal working memory: Long-term reproducibility analysis.
        Neuroimage. 2004; 21: 1000-1008
        • Wagner K.
        • Frings L.
        • Quiske A.
        • Unterrainer J.
        • Schwarzwald R.
        • Spreer J.
        • et al.
        The reliability of fMRI activations in the medial temporal lobes in a verbal episodic memory task.
        Neuroimage. 2005; 28: 122-131
        • McGonigle D.J.
        • Howseman A.M.
        • Athwal B.S.
        • Friston K.J.
        • Frackowiak R.S.
        • Holmes A.P.
        Variability in fMRI: An examination of intersession differences.
        Neuroimage. 2000; 11: 708-734
        • zandbeldt B.B.
        • Gladwin T.E.
        • Raemaekers M.
        • van Buuren M.
        • Neggers S.F.
        • Kahn R.
        • et al.
        Within-subject variation in BOLD-fMRI signal changes across repeated measurements: Quantification and implications for sample size.
        Neuroimage. 2008; 42: 196-206
        • Cronbach L.J.
        • Nageswari R.
        • Gleser G.C.
        Theory of generalizability: A liberation of reliablity theory.
        Br J Stat Psychol. 1963; 16: 137-163
        • Cronbach L.J.
        • Gleser G.C.
        • Nanda H.
        • Rajaratnam N.
        The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles.
        John Wiley, New York1972
        • Brennan R.L.
        Generalizability Theory.
        Springer-Verlag, New York2000
        • Shavelson R.J.
        • Webb N.M.
        Generalizability Theory: A Primer.
        Sage, Newbury Park, CA1991
        • Yendiki A.
        • Greve D.N.
        • Wallace S.
        • Vangel M.
        • Bockholt J.
        • Mueller B.A.
        • et al.
        Multi-site characterization of an fMRI working memory paradigm: Reliability of activation indices.
        Neuroimage. 2010; 53: 119-131
        • Van Snellenberg J.X.
        • Torres I.J.
        • Thornton A.E.
        Functional neuroimaging of working memory in schizophrenia: Task performance as a moderating variable.
        Neuropsychology. 2006; 20: 497-510
        • Callicott J.H.
        • Bertolino A.
        • Mattay V.S.
        • Langheim F.J.
        • Duyn J.
        • Coppola R.
        • et al.
        Physiological dysfunction of the dorsolateral prefrontal cortex in schizophrenia revisited.
        Cereb Cortex. 2000; 10: 1078-1092
        • Gur R.C.
        • Gur R.E.
        Hypofrontality in schizophrenia: RIP.
        Lancet. 1995; 345: 1383-1384
        • Suckling J.
        • Barnes A.
        • Job D.
        • Brenan D.
        • Lymer K.
        • Dazzan P.
        • et al.
        Power calculations for multicenter imaging studies controlled by the false discovery rate.
        Hum Brain Mapp. 2010; 31: 1183-1195
        • Bennett C.M.
        • Miller M.B.
        How reliable are the results from functional magnetic resonance imaging?.
        Ann N Y Acad Sci. 2010; 1191: 133-155
        • Bosnell R.
        • Wegner C.
        • Kincses Z.T.
        • Korteweg T.
        • Agosta F.
        • Ciccarelli O.
        • et al.
        Reproducibility of fMRI in the clinical setting: Implications for trial designs.
        Neuroimage. 2008; 42: 603-610
        • Friedman L.
        • Glover G.H.
        Reducing interscanner variability of activation in a multicenter fMRI study: Controlling for signal-to-fluctuation-noise-ratio (SFNR) differences.
        Neuroimage. 2006; 33: 471-481
        • Friedman L.
        • Stern H.
        • Brown G.G.
        • Mathalon D.H.
        • Turner J.
        • Glover G.
        • et al.
        Test–retest and between-site reliability in a multicenter fMRI study.
        Hum Brain Mapp. 2008; 29: 958-972
        • Iannetti G.D.
        • Wise R.G.
        BOLD functional MRI in disease and pharmacological studies: Room for improvement?.
        Magn Reson Imaging. 2007; 25: 978-988
        • Desmond J.E.
        • Glover G.H.
        Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses.
        J Neurosci Methods. 2002; 118: 115-128
        • Mumford J.A.
        • Nichols T.E.
        Power calculation for group fMRI studies accounting for arbitrary design and temporal autocorrelation.
        Neuroimage. 2008; 39: 261-268
        • Suckling J.
        • Ohlssen D.
        • Andrew C.
        • Johnson G.
        • Williams S.C.
        • Graves M.
        • et al.
        Components of variance in a multicentre functional MRI study and implications for calculation of statistical power.
        Hum Brain Mapp. 2008; 29: 1111-1122
        • Lieberman M.D.
        • Cunningham W.A.
        Type I and Type II error concerns in fMRI research: Re-balancing the scale.
        Soc Cogn Affect Neurosci. 2009; 4: 423-428

      Linked Article

      • Standardization, Integration, and Sharing—Leveraging Research Investments
        Biological PsychiatryVol. 70Issue 1
        • Preview
          Cognitive impairment has been recognized as a significant cause of disability in schizophrenia for more than 20 years (1,2), but the development of effective treatments for cognitive impairment in schizophrenia has been slow to advance. The National Institute of Mental Health (NIMH) Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative (3) brought together members of academia, the pharmaceutical industry, and the US Food and Drug Administration to increase the viability of drug development by establishing consensus guidelines for study methodology, identifying promising targets for further investigation, and developing a standardized cognitive battery for use as end points in clinical trials.
        • Full-Text
        • PDF