Skip to main content
SpringerLink
Log in

An Instrument to Assess Competencies of Providers Treating Severe Mental Illness

  • Published:
Mental Health Services Research

Abstract

One approach to improving the quality of care for severe mental illnesses (SMI) such as schizophrenia is through the improvement of provider competencies; the attitudes, knowledge, and skills needed to deliver high-quality care. This paper describes a new instrument designed to measure such a set of competencies. A total of 341 providers of services to clients with SMI at 38 clinics within 5 publicly financed treatment organizations in 2 western states were asked to complete a paper-and-pencil survey including the new Competency Assessment Instrument (CAI: 15 scales, each assessing a particular provider competency), and additional measures used to establish validity (Recovery Attitude Questionnaire—7, Client Optimism Scale). Seventy-nine percent (N =269) responded at baseline, 83% (N =282) responded at 2 weeks. Ninety-seven percent of baseline respondents completed the survey at 2 weeks. Most CAI scales have good internal consistency (Cronbach's αs = .52–.93), test–retest reliability (scales ranged from .42 to .78), and validity, and should be useful in efforts to improve care.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • American Nurses Association. (1997). Position statements: Psychiatric mental health nursing and managed care. Kansas City: Author.

    Google Scholar 

  • American Psychiatric Association. (1994). Practice guidelines for the treatment of clients with bipolar disorder. American Journal of Psychiatry, 151, S1-S36.

    Google Scholar 

  • American Psychiatric Association. (1995). Practice guideline for psychiatric evaluation of adults. American Journal of Psychiatry, 152, 63-80.

    Google Scholar 

  • American Psychiatric Association. (1997). Practice guideline for the treatment of clients with schizophrenia. American Journal of Psychiatry, 154, 1-63.

    Google Scholar 

  • Amodeo, M., & Fassler, I. (2000). Social workers and substance-abusing clients: caseload composition and competency self-ratings. American Journal of Drug and Alcohol Abuse, 26(4), 629-641.

    Google Scholar 

  • Blumenthal, D., Gokhale, M., Campbell, E. G., & Weissman, J. S. (2001). Preparedness for clinical practice: Reports of graduating residents at academic health centers. JAMA, 286(9), 1027-1034.

    Google Scholar 

  • Borkin, J. R., Steffen, J. J., Ensfield, L. B., Krzton, K., Wishnick, H., Wilder, K., et al. (2000). Recovery attitudes questionnaire: Development and evaluation. Psychiatric Rehabilitation Journal, 24(2), 95-102.

    Google Scholar 

  • Carling, P., & Curtis, L. (1993). Training standards for staff who work with serious mental illnesses in public mental health services. Vermont: Vermont Department of Mental Health and Mental Retardation.

    Google Scholar 

  • Carraccio, C., & Englander, R. (2000). The objective structured clinical examination: A step in the direction of competency-based evaluation. Archives of Pediatric and Adolescent Medicine, 154(7), 736-741.

    Google Scholar 

  • Catell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245-276.

    Google Scholar 

  • The Center for Mental Health Services Managed Care Initiative. (1998). Co-occurring psychiatric and substance disorders in managed care systems: Standards of care, practice guidelines, workforce competencies, and training curricula. Rockville, MD: Author.

    Google Scholar 

  • Corrigan, P. W., McCracken, S. G., Edwards, M., Kommana, S., & Simpatico, T. (1997). Staff training to improve implementation and impact of behavioral rehabilitation programs. Psychiatric Services, 48(10), 1336-1338.

    Google Scholar 

  • Coursey, R. D., Curtis, L., Marsh, D. T., Campbell, J., Harding, C., Spaniol, L., et al. (2000a). Competencies for direct service staff who work with adults with severe mental illnesses in outpatient public mental health/managed care services. Psychiatric Rehabilitation Journal, 23(4), 370-377.

    Google Scholar 

  • Coursey, R. D., Curtis, L., Marsh, D. T., Campbell, J., Harding, C., Spaniol, L., et al. (2000b). Competencies for direct service staff who work with adults with severe mental illnesses: Specific knowledge, attitudes, skills, and bibliography. Psychiatric Rehabilitation Journal, 23(4), 378-392.

    Google Scholar 

  • Cradock, J., Young, A. S., & Sullivan, G. (2001). The accuracy of medical record documentation in schizophrenia. Journal of Behavioral Health Services and Research, 28(4), 456-465.

    Google Scholar 

  • Department of Veteran Affairs. (1997). Clinical guideline for management of persons with psychoses (Version 1.0). Washington, DC: Veterans Health Administration.

    Google Scholar 

  • DeSantis, P., Robison, K., Johnson, D., et al. (1997). The final report of the Blue Ribbon Commission on Mental Health Care. Madison, WI: Governor's Blue Ribbon Commission on Mental Health Care. Retrieved June 8, 2001, from http://www.dhfs.state.wi.us/MH_BCMH/bluerib.htm.

  • Dixon, L., Lyles, A., Scott, J., Lehman, A., Postrado, L., Goldman, H., et al. (1999). Services to families of adults with schizophrenia: From treatment recommendations to dissemination. Psychiatric Services, 50(2), 233-238.

    Google Scholar 

  • Drake, R. E., & Becker, D. R. (1996). The individual placement and support model of supported employment. Psychiatric Services, 47(5), 473-475.

    Google Scholar 

  • Drake, R. E., McHugo, G. J., Bebout, R. R., Becker, D. R., Harris, M., Bond, G. R., et al. (1999). A randomized clinical trial of supported employment for inner-city patients with severe mental disorders. Archives of General Psychiatry, 56(7), 627-633.

    Google Scholar 

  • Duberman, T. L. (1999). Assessing the critical behavioral competencies of outstanding managed care primary care physicians. Managed Care Interface, 12(3), 76-80.

    Google Scholar 

  • Egnew, R. C. (1995). California's mental health and educational partnership: A competency based graduate social work curriculum. Salinas, CA: Monterey County Health Department.

    Google Scholar 

  • Frances, A., Docherty, J. P., & Kahn, D. A., (Eds.). (1996). The Expert Consensus Guideline Series: Treatment of Bipolar Disorder. Journal of Clinical Psychiatry, 57(Suppl. 12A), 3-89.

    Google Scholar 

  • Galanter, M. (1988). Zealous self-help groups as adjuncts to psychiatric treatment: A study of Recovery, Inc. American Journal of Psychiatry, 145(10), 1248-1253.

    Google Scholar 

  • Glynn, S. M., Liberman, R. P., & Backer, T. E. (1997). Involving families in mental health services: Competencies for mental health workers. Northridge, CA: Center for Improving Mental Health Systems.

    Google Scholar 

  • Grusky, O., Tierney, K., & Spanish, M. T. (1989). Which community mental health services are most important? Administration and Policy in Mental Health, 17, 3-16.

    Google Scholar 

  • International Association of Psychosocial Rehabilitation Services. (1997). Practice guidelines for the psychiatric rehabilitation of persons with severe and persistent mental illness in a managed care environment. Columbia, MD: Author.

    Google Scholar 

  • Johnson, D. L. (1990). Service needs of the seriously mentally ill: Training implications for psychology. Washington, DC: American Psychological Association.

    Google Scholar 

  • Jonikas, J. (1993). Staff competencies for service-delivery staff in psychosocial rehabilitation programs. Chicago: Thresholds National Research and Training Center on Rehabilitation and Mental Illness.

    Google Scholar 

  • Kennedy, M. (1989). Psychiatric rehospitalization of GROWers. Paper presented at the Biennial Conference of the Society for Community Research and Action, East Lansing, MI.

  • Kissling, W. (1991). Guidelines for neuroleptic relapse prevention in schizophrenia. New York: Springer-Verlag.

    Google Scholar 

  • Kuehnel, T., Liberman, R., Howard, E., & Backer, T. (1996). Psychiatric rehabilitation competencies for mental health workers. Los Angeles: Human Interaction Research Institute. Unpublished manuscript.

    Google Scholar 

  • Lauder, W., Reynolds, W., Reilly, V., & Angus, N. (2000). The development and testing of the Mental Health Problems Perception Questionnaire. Journal of Psychiatric and Mental Health Nursing, 7(3), 221-226.

    Google Scholar 

  • Lehman, A. F. (1995). Vocational rehabilitation in schizophrenia. Schizophrenia Bulletin, 21(4), 645-656.

    Google Scholar 

  • Lehman, A. F. (1999). Quality of care in mental health: The case of schizophrenia. Health Affairs (Millwood), 18(5), 52-65.

    Google Scholar 

  • Lehman, A. F., & Steinwachs, D. M. (1998). Translating research into practice: The Schizophrenia Patient Outcomes Research Team (PORT) treatment recommendations. Schizophrenia Bulletin, 24(1), 1-10.

    Google Scholar 

  • Levine, M., & Perkins, D. V. (1987). Principles of community psychology: Perspectives and applications. New York: Oxford University Press.

    Google Scholar 

  • Liberman, R. P., Hilty, D. M., Drake, R. E., & Tsang, H. W. (2001). Requirements for multidisciplinary teamwork in psychiatric rehabilitation. Psychiatric Services, 52(10), 1331-1342.

    Google Scholar 

  • Lu, F., Lim, R., & Mezzich, J. (1995). Issues in the assessment and diagnosis of culturally diverse individuals. In J. Oldham & M. Riba (Eds.), Review of psychiatry (pp. 477-509). Washington, DC: American Psychiatric Press, Inc.

    Google Scholar 

  • McEvoy, J. P., Scheifler, P. L., Frances, A. (Eds.). (1999). Treatment of schizophrenia 1999. The expert consensus guideline series. Journal of Clinical Psychiatry, 60Suppl. 11, 3-80.

    Google Scholar 

  • McEvoy, J. P., Weiden, P. J., Smith, T. E., Carpenter, D., Kahn, D. A., & Frances, A. (1996). The Expert Consensus Guideline Series: Treatment of schizophrenia. Journal of Clinical Psychiatry, 57(Suppl. 12B), 5-58.

    Google Scholar 

  • Meredith, L. S., Rubenstein, L. V., Rost, K., Ford, D. E., Gordon, N., Nutting, P., et al. (1999). Treating depression in staff-model versus network-model managed care organizations. Journal of General Internal Medicine, 14(1), 39-48.

    Google Scholar 

  • Moos, R., Schaefer, J., Andrassy, J., & Moos, B. (2001). Outpatient mental health care, self-help groups, and patients' one-year treatment outcomes. Journal of Clinical Psychology, 57(3), 273-287.

    Google Scholar 

  • Muesser, K. T., & Glynn, S. M. (1988). Family intervention for schizophrenia. In K. S. Dobson & K. D. Craig (Eds.), Empirically-supported therapies: Best practices in professional psychology (pp. 157-185). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Muñoz, R. A. (2000). American Psychiatric Association Practice Guidelines for the treatment of psychiatric disorders: Compendium 2000. Washington, DC: American Psychiatric Association.

    Google Scholar 

  • Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.

    Google Scholar 

  • Oxman, A. D., Thomson, M. A., Davis, D. A., & Haynes, R. B. (1995). No magic bullets: A systematic review of 102 trials of interventions to improve professional practice. Canadian Medical Association Journal, 153(10), 1423-1431.

    Google Scholar 

  • Peabody, J. W., Luck, J., Glassman, P., Dresselhaus, T. R., & Lee, M. (2000). Comparison of vignettes, standardized patients, and chart abstraction: A prospective validation study of 3 methods for measuring quality. JAMA, 283(13), 1715-1722.

    Google Scholar 

  • Rappaport, J. (1993). Narrative studies, personal stories, and identity transformation in the mutual help context. Journal of Applied Behavioral Science, 29, 239-256.

    Google Scholar 

  • Rush, A. J., Rago, W. V., Crismon, M. L., Toprac, M. G., Shon, S. P., Suppes, T., et al. (1999). Medication treatment for the severely and persistently mentally ill: The Texas Medication Algorithm Project. Journal of Clinical Psychiatry, 60(5), 284-291.

    Google Scholar 

  • Sachs, G. S., Printz, D. J., Kahn, D. A., Carpenter, D., Docherty, J. P. (2000). The Expert Consensus Guideline Series: Medication Treatment of Bipolar Disorder 2000. (A Postgraduate Medicine Special Report). New York: McGraw-Hill.

    Google Scholar 

  • Satish, U., Streufert, S., Marshall, R., Smith, J. S., Powers, S., Gorman, P., et al. (2000). Strategic management simulations is a novel way to measure resident competencies. American Journal of Surgery, 181, 557-561.

    Google Scholar 

  • Segal, S. P., Silverman, C., & Temkin, T. (1995). Measuring empowerment in client-run self-help agencies. Community Mental Health Journal, 31(3), 215-227.

    Google Scholar 

  • Taylor, M., Bradley, V., & Warren, R. (1996). The community support skill standards: Tools for managing change and achieving outcomes, skill standards for direct service workers in the human service. Cambridge: Human Services Research Institute.

    Google Scholar 

  • Torey, C., & Wyzik, P. (1997). New Hampshire clinical practice guidelines for adults in community support programs. Lebanon, NH: West Central Services.

    Google Scholar 

  • Trochim, W., & Cook, J. (1993). Workforce competencies for psychosocial rehabilitation workers: A concept mapping project (Final report). Columbus: International Association of Psychosocial Rehabilitation Services.

    Google Scholar 

  • Unutzer, J., Simon, G., Pabiniak, C., Bond, K., & Katon, W. (2000). The use of administrative data to assess quality of care for bipolar disorder in a large staff model HMO. General Hospital Psychiatry, 22(1), 1-10.

    Google Scholar 

  • Ware, J. E. (1984). Methodological considerations in the selection of health status assessment procedures. In N. K. Wenger, M. E. Mattson, D. C. Furberg, J. Elinson (Eds.), Assessment of quality of life in clinical trials of cardiovascular therapies. New York: Le Jacq Publishing.

    Google Scholar 

  • Yager, J., Docherty, J. P., & Tischler, G. L. (1997). Preparing psychiatric residents for managed care. Values, proficiencies, curriculum, and implications for psychotherapy training. Journal of Psychotherapy Practice and Research, 6(2), 108-122.

    Google Scholar 

  • Young, A. S., Forquer, S. L., Tran, A., Starzynski, M., & Shatkin, J. (2000). Identifying clinical competencies that support rehabilitation and empowerment in individuals with severe mental illness. Journal of Behavioral Health Services Research, 27(3), 321-333.

    Google Scholar 

  • Young, A. S., Grusky, O., Sullivan, G., Webster, C. M., & Podus, D. (1998). The effect of provider characteristics on case management activities. Administration and Policy in Mental Health, 26(1), 21-32.

    Google Scholar 

  • Young, A. S., Sullivan, G., Burnam, M. A., & Brook, R. H. (1998). Measuring the quality of outpatient treatment for schizophrenia. Archives of General Psychiatry, 55(7), 611-617.

    Google Scholar 

  • Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432-442.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. VA VISN-22 Mental Illness Research, Education, and Clinical Center, Los Angeles, California

    Matthew Chinman & Alexander S. Young

  2. RAND, Santa Monica, California

    Matthew Chinman & Melissa Rowe

  3. Comprehensive Neuroscience, Inc., Colorado Springs, Colorado

    Sandy Forquer

  4. ValueOptions, Colorado Springs, Colorado

    Edward Knight & Anita Miller

Authors
  1. Matthew Chinman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alexander S. Young
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Melissa Rowe
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sandy Forquer
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Edward Knight
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Anita Miller
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chinman, M., Young, A.S., Rowe, M. et al. An Instrument to Assess Competencies of Providers Treating Severe Mental Illness. Ment Health Serv Res 5, 97–108 (2003). https://doi.org/10.1023/A:1023281527952

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1023281527952

Search

Navigation