Access the full text.
Sign up today, get DeepDyve free for 14 days.
Dmitry Khodyakov, S. Hempel, L. Rubenstein, P. Shekelle, R. Foy, S. Salem-Schatz, Sean O'Neill, M. Danz, S. Dalal (2011)
Conducting Online Expert panels: a feasibility and experimental replicability studyBMC Medical Research Methodology, 11
O’Haire
Methods for Engaging Stakeholders To Identify and Prioritize Future Research Needs. Methods Future Research Needs Report No. 4. (Prepared by the Oregon Evidence-based Practice Center and the Vanderbilt Evidence-based Practice Center under Contract No. 290-2007-10057-I.) Rockville, MD: AHRQ Publication No. 11-EHC 044-EF. Agency for Healthcare Research and Quality. June 2011. Available at:
Dmitry Khodyakov, L. Mikesell, Ron Schraiber, M. Booth, E. Bromley (2016)
On using ethical principles of community-engaged research in translational science.Translational research : the journal of laboratory and clinical medicine, 171
C. Barber, Jatin Patel, L. Woodhouse, Christopher Smith, Stephen Weiss, J. Homik, S. LeClercq, D. Mosher, T. Christiansen, J. Howden, T. Wasylak, James Greenwood-Lee, Andrea Emrick, E. Suter, B. Kathol, Dmitry Khodyakov, S. Grant, D. Campbell-Scherer, L. Phillips, Jennifer Hendricks, D. Marshall (2015)
Development of key performance indicators to evaluate centralized intake for patients with osteoarthritis and rheumatoid arthritisArthritis Research & Therapy, 17
L. Ohno-Machado, Z. Agha, D. Bell, Lisa Dahm, Michele Day, J. Doctor, D. Gabriel, Maninder Kahlon, Katherine Kim, M. Hogarth, M. Matheny, D. Meeker, J. Nebeker (2014)
pSCANNER: patient-centered Scalable National Network for Effectiveness ResearchJournal of the American Medical Informatics Association : JAMIA, 21
S. Wright, J. Street (2007)
Democracy, deliberation and design: the case of online discussion forumsNew Media & Society, 9
Dmitry Khodyakov, S. Stockdale, Nina Smith, M. Booth, Lisa Altman, L. Rubenstein (2016)
Patient engagement in the process of planning and designing outpatient care improvements at the Veterans Administration Health‐care System: findings from an online expert panelHealth Expectations : An International Journal of Public Participation in Health Care and Health Policy, 20
C. Barber, D. Marshall, D. Mosher, P. Akhavan, L. Tucker, K. Houghton, M. Batthish, D. Levy, H. Schmeling, J. Ellsworth, H. Tibollo, S. Grant, Dmitry Khodyakov, D. Lacaille (2016)
Development of System-level Performance Measures for Evaluation of Models of Care for Inflammatory Arthritis in CanadaThe Journal of Rheumatology, 43
Dmitry Khodyakov, S. Grant, C. Barber, D. Marshall, J. Esdaile, D. Lacaille (2017)
Acceptability of an online modified Delphi panel approach for developing health services performance measures: results from 3 panels on arthritis researchJournal of Evaluation in Clinical Practice, 23
Lavallee
Stakeholder engagement in patient-centered outcomes research: High-touch or high-tech? Expert Rev PharmacoecoOutcomes Res2014, 14
C. Claassen, J. Pearson, Dmitry Khodyakov, P. Satow, R. Gebbia, A. Berman, Daniel Reidenberg, S. Feldman, S. Molock, M. Carras, R. Lento, J. Sherrill, Beverly Pringle, S. Dalal, T. Insel (2014)
Reducing the burden of suicide in the U.S.: the aspirational research goals of the National Action Alliance for Suicide Prevention Research Prioritization Task Force.American journal of preventive medicine, 47 3
D. Lavallee, Carla Williams, E. Tambor, P. Deverka (2012)
Stakeholder engagement in comparative effectiveness research: how will we measure success?Journal of comparative effectiveness research, 1 5
J. Culley (2011)
Use of a Computer-Mediated Delphi Process to Validate a Mass Casualty Conceptual ModelCIN: Computers, Informatics, Nursing, 29
J. Domecq, Gabriela Prutsky, Tarig Elraiyah, Zhen Wang, Mohammed Nabhan, Nathan Shippee, Juan Brito, K. Boehmer, Rim Hasan, Belal Firwana, Patricia Erwin, David Eton, Jeff Sloan, V. Montori, Noor Asi, Abd Dabrh, M. Murad (2014)
Patient engagement in research: a systematic reviewBMC Health Services Research, 14
C. Barber, Deborah Marshall, Nanette Alvarez, G.B. Mancini, D. Lacaille, S. Keeling, J. Aviña-Zubieta, Dmitry Khodyakov, C. Barnabe, P. Faris, Alexa Smith, R. Noormohamed, G. Hazlewood, Liam Martin, J. Esdaile (2015)
Development of Cardiovascular Quality Indicators for Rheumatoid Arthritis: Results from an International Expert Panel Using a Novel Online ProcessThe Journal of Rheumatology, 42
Ruth Stewart, Jenny Caird, K. Oliver, S. Oliver (2011)
Patients’ and clinicians’ research prioritiesHealth Expectations, 14
J. Timbie, R. Rudin, Vivian Towe, Emily Chen, Lauren Hunter, S. Case, V. Kotzias, Z. Predmore, Shaela Moen, M. Ridgely (2015)
National Patient-Centered Clinical Research Network (PCORnet) Phase I
J. Boote, Wendy Baird, C. Beecroft (2010)
Public involvement at the design stage of primary health research: a narrative review of case examples.Health policy, 95 1
Kristine Campbell, L. Olson, H. Keenan (2015)
Critical Elements in the Medical Evaluation of Suspected Child Physical AbusePediatrics, 136
T. Concannon, P. Meissner, J. Grunbaum, N. Mcelwee, J. Guise, John Santa, P. Conway, Denise Daudelin, E. Morrato, L. Leslie (2012)
A New Taxonomy for Stakeholder Engagement in Patient-Centered Outcomes ResearchJournal of General Internal Medicine, 27
P. Deverka, D. Lavallee, P. Desai, J. Armstrong, M. Gorman, Leah Hole-Curry, James O'Leary, B. Ruffner, John Watkins, D. Veenstra, L. Baker, J. Unger, S. Ramsey (2012)
Facilitating comparative effectiveness research in cancer genomics: evaluating stakeholder perceptions of the engagement process.Journal of comparative effectiveness research, 1 4
J. Bailey, S. Pearson (1983)
Development of a Tool for Measuring and Analyzing Computer User SatisfactionManagement Science, 29
Linda Oostendorp, Marie-Anne Durand, Amy Lloyd, G. Elwyn (2015)
Measuring organisational readiness for patient engagement (MORE): an international online Delphi consensus studyBMC Health Services Research, 15
K. Carman, Maureen Maurer, Rikki Mangrum, Manshu Yang, Marjorie Ginsburg, S. Sofaer, M. Gold, Ela Pathak-Sen, Dierdre Gilmore, J. Richmond, J. Siegel (2016)
Understanding An Informed Public's Views On The Role Of Evidence In Making Health Care Decisions.Health affairs, 35 4
S. Dalal, Dmitry Khodyakov, R. Srinivasan, Susan Straus, J. Adams (2011)
ExpertLens: A System for Eliciting Opinions from a Large Pool of Non-Collocated Experts with Diverse KnowledgeTechnological Forecasting and Social Change, 78
S. Hiltz, Kenneth Johnson (1990)
User satisfaction with computer-mediated communication systemsManagement Science, 36
L. Esmail, Emily Moore, Alison Rein (2015)
Evaluating patient and stakeholder engagement in research: moving from theory to practice.Journal of comparative effectiveness research, 4 2
Bolanle Olaniran (1996)
A model of group satisfaction in computer-mediated communication and face-to-face meetingsBehav. Inf. Technol., 15
Dmitry Khodyakov, T. Savitsky, S. Dalal (2015)
Collaborative learning framework for online stakeholder engagementHealth Expectations : An International Journal of Public Participation in Health Care and Health Policy, 19
P. Deverka, D. Lavallee, P. Desai, L. Esmail, S. Ramsey, D. Veenstra, S. Tunis (2012)
Stakeholder participation in comparative effectiveness research: defining a framework for effective engagement.Journal of comparative effectiveness research, 1 2
L. Forsythe, Lauren Ellis, Lauren Edmundson, Raj Sabharwal, Alison Rein, Kristen Konopka, L. Frank (2015)
Patient and Stakeholder Engagement in the PCORI Pilot Projects: Description and Lessons LearnedJournal of General Internal Medicine, 31
Objective: Little evidence exists about effective and scalable methods for meaningful stakeholder engagement in research. We explored patient/caregiver experiences with a high-tech online engagement approach for patient-centered research prioritization, compared their experiences with those of professional stakeholders, and identified factors associated with favorable participant experiences.Methods: We conducted 8 online modified-Delphi (OMD) panels. Panelists participated in 2 rating rounds with a statistical feedback/online discussion round in between. Panels focused on weight management/obesity, heart failure, and Kawasaki disease. We recruited a convenience sample of adults with any of the 3 conditions (or parents/guardians of Kawasaki disease patients), clinicians, and researchers. Measures included self-reported willingness to use OMD again, the panelists’ study participation and online discussion experiences, the system’s perceived ease of use, and active engagement metrics.Results: Out of 349 panelists, 292 (84%) completed the study. Of those, 46% were patients, 36% were clinicians, and 19% were researchers. In multivariate models, patients were not significantly more actively engaged (Odds ratio (OR) = 1.69, 95% confidence interval (CI), 0.94–3.05) but had more favorable study participation (β = 0.49; P ≤ .05) and online discussion (β = 0.18; P ≤ .05) experiences and were more willing to use OMD again (β = 0.36; P ≤ .05), compared to professional stakeholders. Positive perceptions of the OMD system’s ease of use (β = 0.16; P ≤ .05) and favorable study participation (β = 0.26; P ≤ .05) and online discussion (β = 0.57; P ≤ .05) experiences were also associated with increased willingness to use OMD in the future. Active engagement was not associated with online experience indices or willingness to use OMD again.Conclusion: Online approaches to engaging large numbers of stakeholders are a promising and efficient adjunct to in-person meetings.
Journal of the American Medical Informatics Association – Oxford University Press
Published: May 1, 2017
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.