Access the full text.
Sign up today, get DeepDyve free for 14 days.
N. Otsu (1979)
A Threshold Selection Method from Gray-Level HistogramsIEEE Trans. Syst. Man Cybern., 9
G. Schiff, L. Volk, Mayya Volodarskaya, Deborah Williams, L. Walsh, S. Myers, D. Bates, R. Rozenblum (2017)
Screening for medication errors using an outlier detection systemJournal of the American Medical Informatics Association, 24
H. Santos, A. Ulbrich, Vinicius Woloszyn, Renata Vieira (2019)
DDC-Outlier: Preventing Medication Errors Using Unsupervised LearningIEEE Journal of Biomedical and Health Informatics, 23
S. Nelson, Colin Walsh, Casey Olsen, Andrew McLaughlin, Joseph LeGrand, Nick Schutz, T. Lasko (2020)
Demystifying artificial intelligence in pharmacy.American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists
Allie Woods, David Mulherin, Allen Flynn, J. Stevenson, Christopher Zimmerman, B. Chaffee (2014)
Clinical decision support for atypical orders: detection and warning of atypical medication orders submitted to a computerized provider order entry systemJournal of the American Medical Informatics Association : JAMIA, 21 3
J. Poikonen (2009)
An informatics perspective on nearly universal prospective order review.American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists, 66 8
Jonathan Chen, M. Alagappan, M. Goldstein, S. Asch, R. Altman (2017)
Decaying relevance of clinical data towards future decisions in data-driven inpatient clinical order setsInternational journal of medical informatics, 102
Christy Gorbach, L. Blanton, Beverly Lukawski, Alex Varkey, E. Pitman, K. Garey (2015)
Frequency of and risk factors for medication errors by pharmacists during order verification in a tertiary care medical center.American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists, 72 17
D. Tribble (2009)
Automating order review is delegation, not abdication.American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists, 66 12
G. Segal, A. Segev, A. Brom, Y. Lifshitz, YishayWasserstrum, E. Zimlichman (2019)
Reducing drug prescription errors and adverse drug events by application of a probabilistic, machine-learning based clinical decision support system in an inpatient settingJournal of the American Medical Informatics Association : JAMIA
Allen Flynn (2019)
Using artificial intelligence in health-system pharmacy practice: Finding new patterns that matterAmerican Journal of Health-System Pharmacy, 76
Sunny Bhakta, A. Colavecchia, Linda Haines, Divya Varkey, K. Garey (2019)
A systematic approach to optimize electronic health record medication alerts in a health systemAmerican Journal of Health-System Pharmacy, 76
S. Payrovnaziri, Zhaoyi Chen, Pablo Rengifo-Moreno, Tim Miller, J. Bian, Jonathan Chen, Xiuwen Liu, Zhe He (2020)
Explainable artificial intelligence models using real-world electronic health record data: a systematic scoping reviewJournal of the American Medical Informatics Association : JAMIA
J. Corny, Asok Rajkumar, Olivier Martin, X. Dode, J. Lajonchère, O. Billuart, Y. Bézie, A. Buronfosse (2020)
A machine learning–based clinical decision support system to identify prescriptions with a high risk of medication errorJournal of the American Medical Informatics Association : JAMIA, 27
Harkaryn Bagri, K. Dahri, M. Legal (2019)
Hospital Pharmacists' Perceptions and Decision-Making Related to Drug-Drug Interactions.The Canadian journal of hospital pharmacy, 72 4
Takaya Saito, Marc Rehmsmeier (2015)
The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced DatasetsPLoS ONE, 10
X. Robin, N. Turck, A. Hainard, N. Tiberti, F. Lisacek, Jean-Charles Sanchez, Markus Müller (2011)
pROC: an open-source package for R and S+ to analyze and compare ROC curvesBMC Bioinformatics, 12
Fabian Pedregosa, G. Varoquaux, Alexandre Gramfort, V. Michel, B. Thirion, O. Grisel, Mathieu Blondel, Gilles Louppe, P. Prettenhofer, Ron Weiss, Ron Weiss, J. Vanderplas, Alexandre Passos, D. Cournapeau, M. Brucher, M. Perrot, E. Duchesnay (2011)
Scikit-learn: Machine Learning in PythonArXiv, abs/1201.0490
ObjectivesThe study sought to assess the clinical performance of a machine learning model aiming to identify unusual medication orders.Materials and MethodsThis prospective study was conducted at CHU Sainte-Justine, Canada, from April to August 2020. An unsupervised machine learning model based on GANomaly and 2 baselines were trained to learn medication order patterns from 10 years of data. Clinical pharmacists dichotomously (typical or atypical) labeled orders and pharmacological profiles (patients’ medication lists). Confusion matrices, areas under the precision-recall curve (AUPRs), and F1 scores were calculated.ResultsA total of 12 471 medication orders and 1356 profiles were labeled by 25 pharmacists. Medication order predictions showed a precision of 35%, recall (sensitivity) of 26%, and specificity of 97% as compared with pharmacist labels, with an AUPR of 0.25 and an F1 score of 0.30. Profile predictions showed a precision of 49%, recall of 75%, and specificity of 82%, with an AUPR of 0.60, and an F1 score of 0.59. The model performed better than the baselines. According to the pharmacists, the model was a useful screening tool, and 9 of 15 participants preferred predictions by medication, rather than by profile.DiscussionPredictions for profiles had higher F1 scores and recall compared with medication order predictions. Although the performance was much better for profile predictions, pharmacists generally preferred medication order predictions.ConclusionsBased on the AUPR, this model showed better performance for the identification of atypical pharmacological profiles than for medication orders. Pharmacists considered the model a useful screening tool. Improving these predictions should be prioritized in future research to maximize clinical impact.
Journal of the American Medical Informatics Association – Oxford University Press
Published: May 6, 2021
Keywords: machine learning; clinical pharmacy information systems; decision support systems; clinical; medical order entry systems; hospital pharmaceutical services
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.