Skip to main content
SpringerLink
Log in

Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis

  • Review
  • Published:
Neuropsychology Review Aims and scope Submit manuscript

Abstract

The purpose of the current systematic review and meta-analysis was to assess the effect of videoconference administration on adult neurocognitive tests. We investigated whether the scores acquired during a videoconference administration were different from those acquired during on-site administration. Relevant counterbalanced crossover studies were identified according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Twelve studies met criteria for analysis. Included samples consisted of healthy adults as well as those with psychiatric or neurocognitive disorders, with mean ages ranging from 34 to 88 years. Heterogenous data precluded the interpretation of a summary effect for videoconference administration. Studies including particpants with a mean age of 65–75, as well as studies that utilized a high speed network connection, indicated consistent performance across videoconference and on-site conditions, however studies with older participants and slower connections were more variable. Subgroup analyses indicated that videoconference scores for untimed tasks and those allowing for repetition fell 1/10th of a standard deviation below on-site scores. Test specific analyses indicated that verbally-mediated tasks including digit span, verbal fluency, and list learning were not affected by videoconference administration. Scores for the Boston Naming Test fell 1/10th of a standard deviation below on-site scores. Heterogenous data precluded meaningful interpretation of tasks with a motor component. The administration of verbally-mediated tasks by qualified professionals using existing norms was supported, and the use of visually-dependent tasks may also be considered. Variability in previous studies indicates a need for further investigation of motor-dependent tasks. We recommend the development of clinical best practices for conducting neuropsychological assessments via videoconference, and advocate for reimbursement structures that allow consumers to benefit from the increased access, convenience, and cost-savings that remote assessment provides.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Acierno, R., Gros, D. F., Ruggiero, K. J., Hernandez-Tejada, B. M. A., Knapp, R. G., Lejuez, C. W., et al. (2016). Behavioral activation and therapeutic exposure for posttraumatic stress disorder: a noninferiority trial of treatment delivered in person versus home-based telehealth. Depression and Anxiety. doi:10.1002/da.22476.

  • Adjorlolo, S. (2015). Can teleneuropsychology help meet the neuropsychological needs of western Africans? The case of Ghana. Applied Neuropsychology: Adult, 22(5), 388–398. doi:10.1080/23279095.2014.949718.

    Article  Google Scholar 

  • Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., et al. (2012). Videoconferencing psychotherapy: a systematic review. Psychological Services, 9(2), 111–131. doi:10.1037/a0027924.

    Article  PubMed  Google Scholar 

  • Ball, C. J., Scott, N., McLaren, P. M., & Watson, J. P. (1993). Preliminary evaluation of a low-cost videoconferencing (LCVC) system for remote cognitive testing of adult psychiatric patients. British Journal of Clinical Psychology, 32(3), 303–307. doi:10.1111/j.2044-8260.1993.tb01060.x.

    Article  PubMed  Google Scholar 

  • Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008). A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. Journal of Technology in Human Services, 26(2–4), 109–160. doi:10.1080/15228830802094429.

    Article  Google Scholar 

  • Barton, C., Morris, R., Rothlind, J., & Yaffe, K. (2011). Video-telemedicine in a memory disorders clinic: evaluation and management of rural elders with cognitive impairment. Telemedicine and e-Health, 17(10), 789–793.

    Article  PubMed  Google Scholar 

  • Bashshur, R. L., Shannon, G. W., Bashshur, N., & Yellowlees, P. M. (2015). The empirical evidence for telemedicine interventions in mental disorders. Telemedicine and e-Health. doi:10.1089/tmj.2015.0206.

  • Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088–1101. doi:10.2307/2533446.

    Article  CAS  PubMed  Google Scholar 

  • Beglinger, L. J., Gaydos, B., Tangphao-Daniels, O., Duff, K., Kareken, D. A., Crawford, J., et al. (2005). Practice effects and the use of alternate forms in serial neuropsychological testing. Archives of Clinical Neuropsychology, 20(4), 517–529. doi:10.1016/j.acn.2004.12.003.

    Article  PubMed  Google Scholar 

  • Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1(2), 97–111. doi:10.1002/jrsm.12.

    Article  PubMed  Google Scholar 

  • Cernich, A. N., Brennana, D. M., Barker, L. M., & Bleiberg, J. (2007). Sources of error in computerized neuropsychological assessment. Archives of Clinical Neuropsychology, 22(Suppl 1), S39–S48. doi:10.1016/j.acn.2006.10.004.

    Article  PubMed  Google Scholar 

  • Cheung, M. W.-L., & Vijayakumar, R. (2016). A guide to conducting a meta-analysis. Neuropsychology Review, 1–8. doi:10.1007/s11065-016-9319-z.

  • Ciemins, E., Halloway, B., Coon, P. J., McClosky-Armstrong, T., & Min, S. (2009). Telemedicine and the Mini-mental state Examination: Assessment from a distance. Telemedicine and e-Health. doi:10.1089/tmj.2008.0144.

  • Cohen, J. (1988). Statistical power analysis for the behavioral Sciences. Hillsdale: L. Erlbaum Associates.

    Google Scholar 

  • Cullum, C., Weiner, M., Gehrmann, H., & Hynan, L. (2006). Feasibility of telecognitive assessment in dementia. Assessment, 13(4), 385–390. doi:10.1177/1073191106289065.

    Article  PubMed  Google Scholar 

  • Cullum, C., Hynan, L., Grosch, M., Parikh, M., & Weiner, M. (2014). Teleneuropsychology: evidence for video teleconference-based neuropsychological assessment. Journal of the International Neuropsychological Society, 20(10), 1028–1033. doi:10.1017/S1355617714000873.

    Article  PubMed Central  Google Scholar 

  • Czaja, S. J. (2016). Long-term care services and support systems for older adults: the role of technology. American Psychologist, 71(4), 294–301. doi:10.1037/a0040258.

    Article  PubMed  Google Scholar 

  • Davis, L. E., Coleman, J., Harnar, J., & King, M. K. (2014). Teleneurology: successful delivery of chronic neurologic care to 354 patients living remotely in a rural state. Telemedicine and e-Health, 20(5), 473–477. doi:10.1089/tmj.2013.0217.

    Article  PubMed  Google Scholar 

  • DeYoung, N., Belkonen, S., Luci, K., Slater, M., Quigley, T., & Shenal, B. (2015). The reliability and accuracy of administering the Montreal cognitive assessment over telehealth. Presented at the 43rd annual meeting of the International neuropsychological Society, Denver, CO.

  • Ding, H., Hu, G. L., Zheng, X. Y., Chen, Q., Threapleton, D. E., & Zhou, Z. H. (2015). The method quality of cross-over studies involved in Cochrane systematic reviews. PloS One, 10(4). doi:10.1371/journal.pone.0120519.

  • Duff, K. (2012). Evidence-based indicators of neuropsychological change in the individual patient: relevant concepts and methods. Archives of Clinical Neuropsychology, 27(3), 248–261. doi:10.1093/arclin/acr120.

  • Fordyce, M. A., Chen, F. M., Doescher, M. P., & Hart, L. G. (2007). 2005 physician supply and distribution in rural areas of the United States. Final report, 116. http://depts.washington.edu/uwrhrc/uploads/RHRC%20FR116%20Fordyce.pdf. Accessed 20 July 2016.

  • Fortney, J. C., Pyne, J. M., Turner, E. E., Farris, K. M., Normoyle, T. M., Avery, M. D., et al. (2015). Telepsychiatry integration of mental health services into rural primary care settings. International Review of Psychiatry, 27(6), 525–539. doi:10.3109/09540261.2015.1085838.

    Article  PubMed  Google Scholar 

  • Galusha-Glasscock, J. M., Horton, D. K., Weiner, M. F., & Cullum, C. M. (2015). Video teleconference administration of the Repeatable Battery for the assessment of neuropsychological status. Archives of Clinical Neuropsychology. doi:10.1093/arclin/acv058.

  • Gros, D. F., Morland, L. A., Greene, C. J., Acierno, R., Strachan, M., Egede, L. E., et al. (2013). Delivery of evidence-based psychotherapy via video telehealth. Journal of Psychopathology and Behavioral Assessment, 35(4), 506–521. doi:10.1007/s10862-013-9363-4.

    Article  Google Scholar 

  • Grosch, M. C., Gottlieb, M. C., & Cullum, C. M. (2011). Initial practice recommendations for teleneuropsychology. The Clinical Neuropsychologist, 25(7), 1119–1133. doi:10.1080/13854046.2011.609840.

    Article  PubMed  Google Scholar 

  • Grosch, M. C., Weiner, M. F., Hynan, L. S., Shore, J., & Cullum, C. M. (2015). Video teleconference-based neurocognitive screening in geropsychiatry. Psychiatry Research, 225(3), 734–735. doi:10.1016/j.psychres.2014.12.040.

    Article  PubMed  PubMed Central  Google Scholar 

  • Harrell, K. M., Wilkins, S. S., Connor, M. K., & Chodosh, J. (2014). Telemedicine and the evaluation of cognitive impairment: the additive value of neuropsychological assessment. Journal of the American Medical Directors Association, 15(8), 600–606. doi:10.1016/j.jamda.2014.04.015.

    Article  PubMed  Google Scholar 

  • Higgins, J. P., & Green, S. (2011). Cochrane handbook for systematic reviews of interventions. http://handbook.cochrane.org/front_page.htm. Accessed 8 Apr 2016.

  • Higgins, J. P. T., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558. doi:10.1002/sim.1186.

    Article  PubMed  Google Scholar 

  • Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ: British Medical Journal, 327(7414), 557–560.

    Article  PubMed  PubMed Central  Google Scholar 

  • Hildebrand, R., Chow, H., Williams, C., Nelson, M., & Wass, P. (2004). Feasibility of neuropsychological testing of older adults via videoconference: implications for assessing the capacity for independent living. Journal of Telemedicine and Telecare, 10(3), 130–134.

    Article  PubMed  Google Scholar 

  • Hilty, D. M., Nesbitt, T. S., Kuenneth, C. A., Cruz, G. M., & Hales, R. E. (2007). Rural versus suburban primary care needs, utilization, and satisfaction with telepsychiatric consultation. The Journal of Rural Health, 23(2), 163–165. doi:10.1111/j.1748-0361.2007.00084.x.

    Article  PubMed  Google Scholar 

  • Hilty, D. M., Ferrer, D. C., Parish, M. B., Johnston, B., Callahan, E. J., & Yellowlees, P. M. (2013). The effectiveness of telemental health: a 2013 review. Telemedicine and e-Health, 19(6), 444–454. doi:10.1089/tmj.2013.0075.

    Article  PubMed  PubMed Central  Google Scholar 

  • Jacobsen, S. E., Sprenger, T., Andersson, S., & Krogstad, J.-M. (2003). Neuropsychological assessment and telemedicine: a preliminary study examining the reliability of neuropsychology services performed via telecommunication. Journal of the International Neuropsychological Society, 9(3), 472–478. doi:10.1017/S1355617703930128.

    Article  PubMed  Google Scholar 

  • Johnson, K. A., Meyer, J., Yazar, S., & Turner, A. W. (2015). Real-time teleophthalmology in rural Western Australia. Australian Journal of Rural Health, 23(3), 142–149. doi:10.1111/ajr.12150.

    Article  PubMed  Google Scholar 

  • Kirkwood, K. T., Peck, D. F., & Bennie, L. (2000). The consistency of neuropsychological assessments performed via telecommunication and face to face. Journal of Telemedicine and Telecare, 6, 147–151.

    Article  CAS  PubMed  Google Scholar 

  • Lilly, C. M., Zubrow, M. T., Kempner, K. M., Reynolds, H. N., Subramanian, S., Eriksson, E. A., et al. (2014). Critical care telemedicine: evolution and state of the art*. Critical Care Medicine, 42(11), 2429–2436. doi:10.1097/CCM.0000000000000539.

    Article  PubMed  Google Scholar 

  • Loh, P., Ramesh, P., Maher, S., Saligari, J., Flicker, L., & Goldswain, P. (2004). Can patients with dementia be assessed at a distance? The use of telehealth and standardised assessments. Internal Medicine Journal, 34(5), 239–242.

    Article  CAS  PubMed  Google Scholar 

  • Loh, P., Donaldson, M., Flicker, L., Maher, S., & Goldswain, P. (2007). Development of a telemedicine protocol for the diagnosis of Alzheimer’s disease. Journal of Telemedicine and Telecare, 13(2), 90–94. doi:10.1258/135763307780096159.

    Article  PubMed  Google Scholar 

  • Luxton, D. D., Pruitt, L. D., & Osenbach, J. E. (2014). Best practices for remote psychological assessment via telehealth technologies. Professional Psychology: Research and Practice, 45(1), 27–35. doi:10.1037/a0034547.

    Article  Google Scholar 

  • McEachern, W., Kirk, A., Morgan, D. G., Crossley, M., & Henry, C. (2008). Reliability of the MMSE administered in-person and by telehealth. Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques, 35(5), 643–646. doi:10.1017/S0317167100009458.

    Article  PubMed  Google Scholar 

  • Menon, A. S., Kondapavalru, P., Krishna, P., Chrismer, J. B., Raskin, A., Hebel, J. R., & Ruskin, P. E. (2001). Evaluation of a portable low cost videophone system in the assessment of depressive symptoms and cognitive function in elderly medically ill veterans. The Journal of Nervous and Mental Disease, 189(6), 399–401.

    Article  CAS  PubMed  Google Scholar 

  • Montani, C., Billaud, N., Tyrrell, J., Fluchaire, I., Malterre, C., Lauvernay, N., et al. (1997). Psychological impact of a remote psychometric consultation with hospitalized elderly people. Journal of Telemedicine and Telecare, 3(3), 140–145. doi:10.1258/1357633971931048.

  • Parikh, M., Grosch, M. C., Graham, L. L., Hynan, L. S., Weiner, M., Shore, J. H., & Cullum, C. M. (2013). Consumer acceptability of brief videoconference-based neuropsychological assessment in older individuals with and without cognitive impairment. The Clinical Neuropsychologist, 27(5), 808–817. doi:10.1080/13854046.2013.791723.

    Article  PubMed  PubMed Central  Google Scholar 

  • Shores, M. M., Ryan-Dykes, P., Williams, R. M., Mamerto, B., Sadak, T., Pascualy, M., et al. (2004). Identifying undiagnosed dementia in residential care veterans: comparing telemedicine to in-person clinical examination. International Journal of Geriatric Psychiatry, 19(2), 101–108. doi:10.1002/gps.1029.

    Article  PubMed  Google Scholar 

  • Temple, V., Drummond, C., Valiquette, S., & Jozsvai, E. (2010). A comparison of intellectual assessments over video conferencing and in-person for individuals with ID: preliminary data. Journal of Intellectual Disability Research, 54(6), 573–577. doi:10.1111/j.1365-2788.2010.01282.x.

    Article  CAS  PubMed  Google Scholar 

  • Tensen, E., van der Heijden, J. P., Jaspers, M. W. M., & Witkamp, L. (2016). Two decades of teledermatology: current status and integration in national healthcare systems. Current Dermatology Reports, 5(2), 96–104. doi:10.1007/s13671-016-0136-7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Turkstra, L. S., Quinn-Padron, M., Johnson, J. E., Workinger, M. S., & Antoniotti, N. (2012). In-person versus telehealth assessment of discourse ability in adults with traumatic brain injury. The Journal of Head Trauma Rehabilitation, 27(6), 424–432. doi:10.1097/HTR.0b013e31823346fc.

    Article  PubMed  PubMed Central  Google Scholar 

  • Turner, T. H., Horner, M. D., Vankirk, K. K., Myrick, H., & Tuerk, P. W. (2012). A pilot trial of neuropsychological evaluations conducted via telemedicine in the veterans health administration. Telemedicine Journal and E-Health: The Official Journal of the American Telemedicine Association, 18(9), 662–667. doi:10.1089/tmj.2011.0272.

    Article  Google Scholar 

  • Vahia, I. V., Ng, B., Camacho, A., Cardenas, V., Cherner, M., Depp, C. A., et al. (2015). Telepsychiatry for neurocognitive testing in older rural Latino adults. The American Journal of Geriatric Psychiatry, 23(7), 666–670. doi:10.1016/j.jagp.2014.08.006.

    Article  PubMed  Google Scholar 

  • Vestal, L., Smith-Olinde, L., Hicks, G., Hutton, T., & Hart Jr., J. (2006). Efficacy of language assessment in Alzheimer’s disease: comparing in-person examination and telemedicine. Clinical Interventions in Aging, 1(4), 467.

    Article  PubMed  PubMed Central  Google Scholar 

  • Wadsworth, H. E., Galusha-Glasscock, J. M., Womack, K. B., Quiceno, M., Weiner, M. F., Hynan, L. S., et al. (2016). Remote neuropsychological assessment in rural American Indians with and without cognitive impairment. Archives of Clinical Neuropsychology, acw030. doi:10.1093/arclin/acw030.

  • Wechsler, L. R. (2015). Advantages and limitations of teleneurology. JAMA Neurology, 72(3), 349–354. doi:10.1001/jamaneurol.2014.3844.

    Article  PubMed  Google Scholar 

  • Wennergren, J., Munshi, I., Fajardo, A. D., & George, V. V. (2014). Implementation of clinical video telemedicine (CVT) within a VA medical center is cost effective and well received by veterans. International Journal of Clinical Medicine, 5(12), 711–716. doi:10.4236/ijcm.2014.512097.

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the Department of Veterans Affairs Office of Academic Affiliations Advanced Fellowship Program in Mental Illness, Research, and Treatment and the Mid-Atlantic Mental Illness Research, Education, and Clinical Center (VISN 6 MIRECC) of the Department of Veterans Affairs Office of Mental Health Services. Special thanks to Larry A. Tupler for his support of this and other related teleneuropsychology investigations within the VISN 6 MIRECC.

Author information

Authors and Affiliations

  1. VA Mid-Atlantic Mental Illness Research, Education, and Clinical Centers (MIRECC), W. G. “Bill” Hefner Veterans Affairs Medical Center, Salisbury, NC, 28144, USA

    Timothy W. Brearly, Robert D. Shura, Sarah L. Martindale & Jared A. Rowland

  2. Mental Health and Behavioral Sciences Service Line, W. G. “Bill” Hefner Veterans Affairs Medical Center, Salisbury, NC, 28144, USA

    Timothy W. Brearly, Robert D. Shura & Sarah L. Martindale

  3. Department of Psychiatry and Behavioral Sciences, Wake Forest School of Medicine, Winston-Salem, NC, 27103, USA

    Timothy W. Brearly, Robert D. Shura, Sarah L. Martindale & Jared A. Rowland

  4. The College Board, Yardley, PA, 19067, USA

    Rory A. Lazowski

  5. Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, 98102, USA

    David D. Luxton

  6. Mental Health Service Line, Salem Veterans Affairs Medical Center, Salem, VA, 24153, USA

    Brian V. Shenal

  7. Virginia Tech Carilion School of Medicine, Roanoke, VA, 24016, USA

    Brian V. Shenal

  8. Research and Education Service Line, W. G. “Bill” Hefner Veterans Affairs Medical Center, Salisbury, NC, 28144, USA

    Jared A. Rowland

  9. Department of Neurobiology and Anatomy, Wake Forest School of Medicine, Medical Center Boulevard, Winston-Salem, NC, 27157, USA

    Jared A. Rowland

Authors
  1. Timothy W. Brearly
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Robert D. Shura
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sarah L. Martindale
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rory A. Lazowski
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. David D. Luxton
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Brian V. Shenal
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jared A. Rowland
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Timothy W. Brearly.

Electronic supplementary material

ESM 1

(PDF 298 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Brearly, T.W., Shura, R.D., Martindale, S.L. et al. Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis. Neuropsychol Rev 27, 174–186 (2017). https://doi.org/10.1007/s11065-017-9349-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11065-017-9349-1

Keywords

Search

Navigation