Skip to main content

Main menu

  • Home
  • Current Issue
  • Ahead of Print
  • Past Issues
  • Info for
    • Authors
    • Print Subscriptions
  • About
    • About the Journal
    • About the Academy
    • Editorial Board
  • Feedback
  • Alerts
  • AAPL

User menu

  • Alerts

Search

  • Advanced search
Journal of the American Academy of Psychiatry and the Law
  • AAPL
  • Alerts
Journal of the American Academy of Psychiatry and the Law

Advanced Search

  • Home
  • Current Issue
  • Ahead of Print
  • Past Issues
  • Info for
    • Authors
    • Print Subscriptions
  • About
    • About the Journal
    • About the Academy
    • Editorial Board
  • Feedback
  • Alerts
OtherREGULAR ARTICLE

Conceptualizing and Characterizing Accuracy in Assessments of Competence to Stand Trial

Douglas Mossman
Journal of the American Academy of Psychiatry and the Law Online September 2008, 36 (3) 340-351;
Douglas Mossman
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • Figure 1.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 1.

    A ROC graph, based on data in Poythress et al.,36 that treats the MacCAT-CA Reasoning scale as a diagnostic test for incompetence to stand trial. Numbered markers represent (FPR, TPR) pairs associated with scores on the Reasoning scale. A smooth, binormal ROC is fitted to the data.

  • Figure 2.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 2.

    ROC curves for all three MacCAT-CA scales, based on data in Poythress et al.36 The dotted line (at FPR = 0.05) suggests that when detecting incompetence with high specificity, the Appreciation scale has the highest sensitivity. The circular markers represent points that maximize diagnostic information when the base rate of incompetence is 0.16 (the bottom left circle on each curve) and 0.30 (top right circle on each curve).

  • Figure 3.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 3.

    Hypothetical study results from a five-category rating of 200 defendants, half of whom are actually competent to stand trial. Gaussian distributions fit the rating data to the binormal assumption.

  • Figure 4.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 4.

    ROC graph based on hypothetical data in Figure 3. Segments of ROC curve areas labeled to indicate their sources in one of five rating categories. Four potential decision thresholds appear along the curve as circles that are fitted to a smooth curve according to the binormal assumption. The square labeled apparent accuracy based on yes-or-no opinions assumes that half the defendants rated 2, 3, and 4 are deemed competent and that these opinions are used to quantify accuracy.

Tables

  • Figures
    • View popup
    Table 1

    Instructions to Experts Who Perform Court-Ordered Evaluations of Competence to Stand Trial (Utah Code 77-15-5(4))25

    The experts shall consider … and address, in addition to any other factors determined to be relevant … :
    (a) the defendant's present capacity to:
         (i) comprehend and appreciate the charges or allegations against him;
         (ii) disclose to counsel pertinent facts, events, and states of mind;
         (iii) comprehend and appreciate the range and nature of possible penalties, if applicable, that may be imposed in the proceedings against him;
         (iv) engage in reasoned choice of legal strategies and options;
         (v) understand the adversary nature of the proceedings against him;
         (vi) manifest appropriate courtroom behavior; and
         (vii) testify relevantly, if applicable;
    (b) the impact of the mental disorder, or mental retardation, if any, on the nature and quality of the defendant's relationship with counsel;
    (c) if psychoactive medication is currently being administered:
         (i) whether the medication is necessary to maintain the defendant's competency; and
         (ii) the effect of the medication, if any, on the defendant's demeanor and affect and ability to participate in the proceedings.
    • View popup
    Table 2

    (FPR, TPR) Pairs that Maximize Each MacCAT-CA Scale's Information, Based on Data in Poythress et al.36

    MacCAT-CA ScaleBRFPRTPRInformationScale ScoreInterpretation (Impairment Level)
    Bits%max
    Understanding0.160.1810.5170.0538.39Mild
    0.300.2040.5480.0819.210Minimal
    Reasoning0.160.1180.4790.07111.29Mild
    0.300.1400.5140.10612.09Mild
    Appreciation0.160.0400.4070.10516.57Clinically significant
    0.300.0540.4410.14816.88Clinically significant
    • Also shown are the amounts of information yielded by each scale (both in bits and as a percentage of the information that would be obtained from a perfect test), corresponding scale scores, and the MacCAT-CA interpretations of these scores. BR = assumed base rate.

PreviousNext
Back to top

In this issue

Journal of the American Academy of Psychiatry and the Law Online: 36 (3)
Journal of the American Academy of Psychiatry and the Law Online
Vol. 36, Issue 3
September 2008
  • Table of Contents
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in recommending The Journal of the American Academy of Psychiatry and the Law site.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Conceptualizing and Characterizing Accuracy in Assessments of Competence to Stand Trial
(Your Name) has forwarded a page to you from Journal of the American Academy of Psychiatry and the Law
(Your Name) thought you would like to see this page from the Journal of the American Academy of Psychiatry and the Law web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Conceptualizing and Characterizing Accuracy in Assessments of Competence to Stand Trial
Douglas Mossman
Journal of the American Academy of Psychiatry and the Law Online Sep 2008, 36 (3) 340-351;

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Share
Conceptualizing and Characterizing Accuracy in Assessments of Competence to Stand Trial
Douglas Mossman
Journal of the American Academy of Psychiatry and the Law Online Sep 2008, 36 (3) 340-351;
del.icio.us logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Confidence About Adjudicative Competence
    • ROC Analysis of CST Data
    • Problems With Ascertaining Accuracy and the Truth
    • A Hypothetical Study
    • Conclusions
    • References
  • Figures & Data
  • Info & Metrics
  • PDF

Related Articles

Cited By...

More in this TOC Section

  • A Forensic Science-Based Model for Identifying and Mitigating Forensic Mental Health Expert Biases
  • Bias in Peer Review of Forensic Psychiatry Publications
  • Reconsidering the Relationship Between Criminal Insanity and Delusions
Show more Regular Article

Similar Articles

Site Navigation

  • Home
  • Current Issue
  • Ahead of Print
  • Archive
  • Information for Authors
  • About the Journal
  • Editorial Board
  • Feedback
  • Alerts

Other Resources

  • Academy Website
  • AAPL Meetings
  • AAPL Annual Review Course

Reviewers

  • Peer Reviewers

Other Publications

  • AAPL Practice Guidelines
  • AAPL Newsletter
  • AAPL Ethics Guidelines
  • AAPL Amicus Briefs
  • Landmark Cases

Customer Service

  • Cookie Policy
  • Reprints and Permissions
  • Order Physical Copy

Copyright © 2025 by The American Academy of Psychiatry and the Law