The first phase of the Cognitive Neuroscience Treatment Research to Improve Cognition
in Schizophrenia (CNTRICs) initiative focused on the identification of cognitive constructs
from human and animal neuroscience that were relevant to understanding cognitive deficits
in schizophrenia, as well as promising task paradigms that could be used to assess
these constructs behaviorally. The current phase of CNTRICs has the goal of expanding
this initial work by including measures of brain function that can augment these behavioral
tasks as biomarkers to be used in drug development processing. Here we review many
of the psychometric issues that need to be addressed regarding the development and
inclusion of such methods in the drug development process. In addition, we review
quality assurance concerns, issues associated with multicenter trials, concerns associated
with potential pharmacologic confounds on imaging measures, as well as power and analysis
considerations. Although review is couched in the context of the use of biomarkers
for treatment studies in schizophrenia, we believe the issues and suggestions included
are relevant to the entire range of neuropsychiatric disorders as well as to a wide
range of imaging modalities (i.e., functional magnetic resonance imaging, positron
emission tomography, event-related potentials, electroencephalography, transcranial
magnetic stimulation, near infrared spectroscopy, etc.) and are relevant to both pharmacologic
and psychological intervention approaches.
Key Words
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to Biological PsychiatryAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- Developing drugs for cognitive impairment in schizophrenia.Schizophr Bull. 2005; 31: 816-822
- Functional neuroimaging and electrophysiology biomarkers for clinical trials for cognition in schizophrenia.Schizophr Bull. 2005; 31: 865-869
- Subunit-selective modulation of GABA type A receptor neurotransmission and cognition in schizophrenia.Am J Psychiatry. 2008; 165: 1585-1593
- CNTRICS final task selection: Working memory.Schizophr Bull. 2009; 35: 136-152
- A growth curve approach to the measurement of change.Psychol Bull. 1982; 92: 726-748
- Understanding correlates of change by modeling individual differences in growth.Psychometriika. 1983; 50: 203-228
- Intraclass correlations: Uses in assessing rater reliability.Psychol Bull. 1979; 86: 420-428
- Coefficient alpha and the internal structure of tests.Psychometriika. 1951; 16: 297-334
- Measuring fMRI reliability with the intra-class correlation coefficient.Neuroimage. 2009; 45: 758-768
- Test–retest reliability of fMRI activation during prosaccades and antisaccades.Neuroimage. 2007; 36: 532-542
- Within-subject variation in BOLD-fMRI signal changes across repeated measurements: Quantification and implications for sample size.Neuroimage. 2008; 42: 196-206
- Assessment of reliability in functional imaging studies.J Magn Reson Imaging. 2003; 17: 463-471
- Intrasubject reproducibility of presurgical language lateralization and mapping using fMRI.Neurology. 2003; 60: 969-975
- Long-term test–retest reliability of functional MRI in a classification learning task.Neuroimage. 2006; 29: 1000-1006
- Test–retest and between-site reliability in a multicenter fMRI study.Hum Brain Mapp. 2008; 29: 958-972
- Test-retest reliablity of fMRI activation during prosaccades and antisaccades.Neuroimage. 2007; 36: 532-542
- Test–retest reliability of a functional MRI working memory paradigm in normal and schizophrenic subjects.Am J Psychiatry. 2001; 158: 955-958
- Functional MRI of auditory verbal working memory: Long-term reproducibility analysis.Neuroimage. 2004; 21: 1000-1008
- The reliability of fMRI activations in the medial temporal lobes in a verbal episodic memory task.Neuroimage. 2005; 28: 122-131
- Variability in fMRI: An examination of intersession differences.Neuroimage. 2000; 11: 708-734
- Within-subject variation in BOLD-fMRI signal changes across repeated measurements: Quantification and implications for sample size.Neuroimage. 2008; 42: 196-206
- Theory of generalizability: A liberation of reliablity theory.Br J Stat Psychol. 1963; 16: 137-163
- The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles.John Wiley, New York1972
- Generalizability Theory.Springer-Verlag, New York2000
- Generalizability Theory: A Primer.Sage, Newbury Park, CA1991
- Multi-site characterization of an fMRI working memory paradigm: Reliability of activation indices.Neuroimage. 2010; 53: 119-131
- Functional neuroimaging of working memory in schizophrenia: Task performance as a moderating variable.Neuropsychology. 2006; 20: 497-510
- Physiological dysfunction of the dorsolateral prefrontal cortex in schizophrenia revisited.Cereb Cortex. 2000; 10: 1078-1092
- Hypofrontality in schizophrenia: RIP.Lancet. 1995; 345: 1383-1384
- Power calculations for multicenter imaging studies controlled by the false discovery rate.Hum Brain Mapp. 2010; 31: 1183-1195
- How reliable are the results from functional magnetic resonance imaging?.Ann N Y Acad Sci. 2010; 1191: 133-155
- Reproducibility of fMRI in the clinical setting: Implications for trial designs.Neuroimage. 2008; 42: 603-610
- Reducing interscanner variability of activation in a multicenter fMRI study: Controlling for signal-to-fluctuation-noise-ratio (SFNR) differences.Neuroimage. 2006; 33: 471-481
- Test–retest and between-site reliability in a multicenter fMRI study.Hum Brain Mapp. 2008; 29: 958-972
- BOLD functional MRI in disease and pharmacological studies: Room for improvement?.Magn Reson Imaging. 2007; 25: 978-988
- Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses.J Neurosci Methods. 2002; 118: 115-128
- Power calculation for group fMRI studies accounting for arbitrary design and temporal autocorrelation.Neuroimage. 2008; 39: 261-268
- Components of variance in a multicentre functional MRI study and implications for calculation of statistical power.Hum Brain Mapp. 2008; 29: 1111-1122
- Type I and Type II error concerns in fMRI research: Re-balancing the scale.Soc Cogn Affect Neurosci. 2009; 4: 423-428
Article info
Publication history
Published online: February 22, 2011
Accepted:
January 6,
2011
Received in revised form:
January 5,
2011
Received:
September 26,
2010
Identification
Copyright
© 2011 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.
ScienceDirect
Access this article on ScienceDirectLinked Article
- Standardization, Integration, and Sharing—Leveraging Research InvestmentsBiological PsychiatryVol. 70Issue 1
- PreviewCognitive impairment has been recognized as a significant cause of disability in schizophrenia for more than 20 years (1,2), but the development of effective treatments for cognitive impairment in schizophrenia has been slow to advance. The National Institute of Mental Health (NIMH) Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative (3) brought together members of academia, the pharmaceutical industry, and the US Food and Drug Administration to increase the viability of drug development by establishing consensus guidelines for study methodology, identifying promising targets for further investigation, and developing a standardized cognitive battery for use as end points in clinical trials.
- Full-Text
- Preview