Self-reports by alcohol and drug abuse inpatients: factors affecting reliability and validity

Br J Addict. 1992 Jul;87(7):1013-24. doi: 10.1111/j.1360-0443.1992.tb03118.x.

Abstract

The reliability and validity of self-report data regarding substance abuse has often been questioned. To determine how best to enhance the veracity of self-report, three factors which might affect self-report veracity were examined: alcohol status at time of interview; level of cognitive functioning; and method of self-report data collection. Subjects were 234 admissions to an inpatient substance abuse treatment unit. Self-report data were collected via both personal interview on the day of admission and and questionnaire within the first week of stay. Self-reports concerned use of alcohol, cocaine, and marijuana in the days preceding admission. Test-retest reliability for the questionnaire data produced reliability coefficients of 0.88, 0.91, and 0.88, for alcohol, cocaine, and marijuana, respectively. Variation in inter-test interval had virtually no effect upon reliability coefficients. Interview data were compared to toxicologic analyses of blood and urine samples collected on admission. Overall, this comparison showed self-reports to be valid, with a 97% agreement between verbal report and laboratory data for alcohol, 93% for cocaine, and 84% for marijuana. The comparison of interview data with questionnaire responses also showed self-reports to be valid: 90% agreement for alcohol, 93% for cocaine, and 81% for marijuana. Level of cognitive function did not influence the validity of self-reports for any of the three substances. Recent consumption of alcohol also had no statistically significant effect on the validity of self-reported marijuana use, regardless of the operational form of validity tested. However, BAC-negative subjects produced a significantly greater validity coefficient for self-reported cocaine use (kappa = 0.87) than did BAC-positive patients (kappa = 0.43), when interview data were compared with toxicologic measures. A similar finding was not uncovered when interview and questionnaire data were compared. An interaction between admission alcohol status and cognitive function was uncovered for cocaine self-reports when interview data was compared with toxicologic measures. The rate of agreement for alcohol-negative subjects is quite high for both cognitively impaired and unimpaired subjects (M = 93% and M = 94%, respectively) as well as for alcohol-positive, cognitively unimpaired subjects (M = 94%), but not for alcohol-positive, cognitively impaired subjects (M = 67%). Results are discussed in terms of threats to the validity of self-report and strategies for the optimization of response accuracy.

Publication types

  • Research Support, U.S. Gov't, P.H.S.

MeSH terms

  • Adult
  • Alcoholism / epidemiology*
  • Alcoholism / psychology
  • Cocaine*
  • Cross-Sectional Studies
  • Female
  • Humans
  • Incidence
  • Male
  • Marijuana Abuse / epidemiology*
  • Marijuana Abuse / psychology
  • Reproducibility of Results
  • Substance Abuse Treatment Centers
  • Substance-Related Disorders / epidemiology*
  • Substance-Related Disorders / psychology
  • Truth Disclosure*
  • United States / epidemiology

Substances

  • Cocaine