Initial Reliability and Validity testing of the DESTINY Stroke and Large Vessel Screening Tool

  • Daniel Nyancho University of Texas Southwestern Medical Center, Dallas, Texas, USA
  • Ryan Cheung University of Texas Southwestern Medical Center, Dallas, Texas, USA
  • Aardhra Venkatachalam University of Texas Southwestern Medical Center, Dallas, Texas, USA
  • Folefac Atem University of Texas Southwestern Medical Center, Dallas, Texas, USA
  • Sonja Stutzman University of Texas Southwestern Medical Center, Dallas, Texas, USA
  • Daiwai Olson University of Texas Southwestern Medical Center, Dallas, Texas, USA
  • Deborah Diercks University of Texas Southwestern Medical Center, Dallas, Texas, USA
  • Mark Johnson University of Texas Southwestern Medical Center, Dallas, Texas, USA
  • Roberta Novakovic-White University of Texas Southwestern Medical Center, Dallas, Texas, USA
DOI: https://doi.org/10.37719/jhcs.2020.v2i2.oa004
Keywords: stroke, large vessel occlusion, screening tool, validity, reliability

Abstract

Background: Screening is a valuable tool in emergency medicine for triaging, activation of protocols, and resource allocation. The Dallas Emergency Department Screening Tool to Identify Stroke (DESTINY) was developed to screen for all stroke subtypes, with improved sensitivity for posterior circulation stroke and large vessel occlusion (LVO). The main purpose of this study was to evaluate how reliably the tool could be taught and used by ED Nurses.

Methods: This is Phase 1 of a multi-phase study to evaluate the DESTINY tool. A vascular neurologist retrospectively reviewed 409 stroke code activations between January and December of 2018. Thirty descriptive vignettes were composed: right anterior circulation stroke (n=5), left anterior circulation stroke (n=5), posterior circulation stroke (n=5), TIA and stroke mimic (n=6), non-LVO stroke (n=5), and hemorrhagic stroke (n= 4). Fifteen emergency medicine registered nurses used the DESTINY tool to screen the vignettes following the stroke education and DESTINY training module.

Results: Individual Pearson Correlation Coefficients (PCC) were calculated for each nurse compared to the vascular neurologist (range: 0.43860 to 0.96966; mean: 0.8746 ± 0.1484). All individual PCC were statistically significant except for one [PCC of 0.43860 (p = 0.0153)]. Cronbach’s Alpha scores were very similar across multiple raters (standardized alpha for nurse raters: 0.9853). Omnibus test to compare DESTINY scores by stroke type demonstrated left anterior LVO and mimic/TIA stroke had few outlier observations, however, poorly differentiated hemorrhagic from ischemic stroke

Conclusion: As demonstrated by high interrater reliability, the DESTINY tool can be effectively taught to ED nurses using clinical vignettes. The DESTINY tool is good at differentiating non-LVO, anterior LVO, mimics, and TIAs; while the ability to distinguish between anterior LVO/posterior LVO and ischemic/hemorrhagic stroke was sub-optimal. Utilizing the lessons learned in the early version of the DESTINY screening tool we expect that the high-reliability scores will continue to improve in future prospective studies.

Downloads

Download data is not yet available.

References

Benjamin, E.J., Muntner, P., Alonso, A., Bittencourt, C., Callway, C., Carson, A., Chamberlain, A., Chang, A., Cheng, S., Das, S., Delling, F., Djousse, L., Elkind, M., Ferguson, J., Fornage, M., Jordan, L., Khan, S., Kissela, B., Knutson, K., Kwan, T., & Virani, S. (2019). Heart Disease and Stroke Statistics; 2019 Update: A Report From the American Heart Association. Circulation, 139(10):e56-e528. https://doi.org/10.1161/CIR.0000000000000659

Beumer, D., Mulder, M, J. H. L., Saiedie, G., Fonville, S., van Oostenbrugge, van Zwam, W., Homburg, P., van der Lugt, A., Dippel, D. (2016). The occurrence of intracranial large vessel occlusion in consecutive, non-referred patients with acute ischemic stroke. Neurovascular Imaging, 2(1):11. https://doi.org/10.1186/s40809-016-0022-5

Beume L-A., Hieber, M., Kaller, C. P., Nitschke, K., Bardutzky, J., Urbach, H., Weiller, C., Rijntjes, M. (2018).. Large Vessel Occlusion in Acute Stroke. Stroke, 49(10):2323-2329. https://doi.org/10.1161/STROKEAHA.118.022253

Buelow, J. M., Hinkle, J. L., & McNett, M. (2016). Reliability and Validity for Neuroscience Nurses. Journal of Neuroscience Nursing, 48(5):238-241. https://doi.org/10.1097/JNN.0000000000000239.

Hill, M., Roshon, K., Bladen, C., Haley, E., Jr., McClelland, J., & Suter, M. (2020). Decreasing Door-to-Groin Puncture Times in a Nonacademic Comprehensive Stroke Center. Journal of Neuroscience Nursing, 52(3):132-135. https://doi.org/10.1097/jnn.0000000000000505

Krishnamurthi, R. V., Feigin, V. L., Forouzanfar M. H., Mensah, G., Connor, M., Bennett, D., Moran, A., Sacco, R., Anderson, L., Truelsen, T., O'Donnell, M., Venketasubramanian, N., Barker-Collo, S., Lawes, C., Wang, W., Shinohara, Y., Witt, E., Ezzati, M., Naghavi, M., Murray, C. (2013). Global and regional burden of first-ever ischaemic and haemorrhagic stroke during 1990-2010: findings from the Global Burden of Disease Study 2010. The Lancet Global Health, 1(5):e259-281. https://doi.org/10.1016/S2214-109X(13)70089-5

Lakomkin, N., Dhamoon, M., Carroll, K., Singh, I., Tuhrim, S., Lee, J., Fifi, J., Mocco, J. (2019). Prevalence of large vessel occlusion in patients presenting with acute ischemic stroke: a 10-year systematic review of the literature. Journal of Neurointerventional Surgery, 11(3):241-245. https://doi.org/10.1136/neurintsurg-2018-014239

Lawrence, E., Merbach, D., Thorpe, S., Llinas, R. H., & Marsh, E.B. (2018). Streamlining the Process for Intravenous Tissue Plasminogen Activator. Journal of Neuroscience Nursing, 50(1):37-41. https://doi.org/10.1097/JNN.0000000000000337

Middleton, S., Grimley, R., & Alexandrov, A. W. (2015). Triage, Treatment, and Transfer. Stroke, 46(2):e18-e25. https://doi.org/10.1161/STROKEAHA.114.006139

Powers, W. J., Rabinstein, A. A., Ackerson, T., Adeoye, O., Bambakidis, N., Becker, K., Biller, J., Brown, M., Demaerschalk, B., Hoh, B., Jauch, E., Kidwell, C., Leslie-Mazwi, T., Ovbiagele, B., Scott, P., Sheth, K., Southerland, A., Summers, D., Tirschwell, D. (2019). Guidelines for the Early Management of Patients With Acute Ischemic Stroke: 2019 Update to the 2018 Guidelines for the Early Management of Acute Ischemic Stroke: A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association. Stroke, 50(12):e344-e418. https://doi.org/10.1161/STR.0000000000000211

Rennert, R. C., Wali, A. R., Steinberg, J. A., Santiago-Dieppa, D., Olson, S., Pannell, J. S., & Khalessi, A. (2019). Epidemiology, Natural History, and Clinical Presentation of Large Vessel Ischemic Stroke. Neurosurgery, 85(suppl_1):S4-S8. https://doi.org/10.1093/neuros/nyz042

Smith, E. E., Kent, D. M., Bulsara, K. R., Leung, L., Lichtman, J., Reeves, M., Towfighi, A., Whiteley, W., & Zahuranec, D. (2018). Accuracy of Prediction Instruments for Diagnosing Large Vessel Occlusion in Individuals With Suspected Stroke: A Systematic Review for the 2018 Guidelines for the Early Management of Patients With Acute Ischemic Stroke. Stroke, 49(3):e111-e122. https://doi.org/10.1161/STR.0000000000000160

Smith, E., Shobha, N., Dai, D., Olson, D., Reeves, M., Saver, J., Fernandez, A., Peterson, E., Fonarow, G., & Schwamm, L. (2013). A risk score for in-hospital death in patients admitted with ischemic or hemorrhagic stroke. Journal of the American Heart Association, 2(1), e005207. https://doi.org/10.1161/JAHA.112.005207.

Smith, W. S., Lev, M. H., English, J. D., Camargo, E., Chou, M., Johnston, S., Gonzales, G., Schaefer, P., Dillon, W., Koroshtetz, W., Furie, K. (2009). Significance of Large Vessel Intracranial Occlusion Causing Acute Ischemic Stroke and TIA. Stroke, 40(12):3834-3840. https://doi.org/10.1161/STROKEAHA.109.561787

Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2:53-55. https://doi.org/10.5116/ijme.4dfb.8dfd

Teleb, M. S., Ver Hage, A., Carter, J., Jayaraman, M. V., & McTaggart, R.A. (2017). Stroke vision, aphasia, neglect (VAN) assessment—a novel emergent large vessel occlusion screening tool: pilot study and comparison with current clinical severity indices. Journal of Neurointerventional Surgery, 9(2):122-126. https://doi.org/10.1136/neurintsurg-2015-012131

Ver Hage, A., Teleb, M., & Smith, E. (2018).An Emergent Large Vessel Occlusion Screening Protocol for Acute Stroke: A Quality Improvement Initiative. Journal of Neuroscience Nursing, 50(2):68-73. https://doi.org/10.1097/JNN.0000000000000346

Zhu, W., Churilov, L., Campbell, B.C., Lin, M., Liu, X., Davis, S., Yan, B. (2014). Does large vessel occlusion affect clinical outcome in stroke with mild neurologic deficits after intravenous thrombolysis? Journal of Stroke and Cerebrovascular Disease, 23(10):2888-2893. https://doi.org/10.1016/j.jstrokecerebrovasdis.2014.07.018

Published
2020-12-18
How to Cite
Daniel Nyancho, Cheung, R., Venkatachalam, A., Atem, F., Stutzman, S., Olson, D., Diercks, D., Johnson, M., & Novakovic-White, R. (2020). Initial Reliability and Validity testing of the DESTINY Stroke and Large Vessel Screening Tool . Journal of Health and Caring Sciences, 2(2), 112-122. https://doi.org/10.37719/jhcs.2020.v2i2.oa004
Issue
Vol. 2 No. 2 (2020): July-December
Section
ORIGINAL ARTICLE(S)

Copyright (c) 2020 Journal of Health and Caring Sciences

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.