Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Selection Bias From Requiring Patients to Give Consent to Examine Data for Health Services Research

Selection Bias From Requiring Patients to Give Consent to Examine Data for Health Services Research BackgroundNew rulings nationwide require health services researchers to obtain patient consent before examining personally identifiable data. A selection bias may result if consenting patients differ from those who do not give consent.ObjectiveTo compare patients who consent, refuse, and do not answer.DesignPatients completing an in-office survey were asked for permission to be surveyed at home and for their records to be reviewed. Survey responses and practice billing data were used to compare patients by consent status.SettingUrban family practice center.PatientsOf 2046 eligible patients, 1106 were randomly selected for the survey, were approached by staff, and agreed to participate. Approximately 87% of the nonparticipants were eliminated through a randomization process.Main Outcome MeasureConsent status.ResultsA total of 33% of patients did not give consent: 25% actively refused, and 8% did not answer. Consenting patients were older, included fewer women and African Americans, and reported poorer physical function than those who did not give consent (P<.05). Patients who did not answer the question were older, included more women and African Americans, and were less educated than those who answered (P<.02). Visits for certain reasons (eg, pelvic infections) were associated with lower consent rates. On multivariate analysis, older age, male sex, and lower functional status were significant predictors of consent.ConclusionsPatients who release personal information for health services research differ in important characteristics from those who do not. In this study, older patients and those in poorer health were more likely to grant consent. Quality and health services research restricted to patients who give consent may misrepresent outcomes for the general population.CONCERNS ABOUT patient privacy have prompted governments and health care organizations to impose new rulings that require researchers to obtain explicit consent from patients before they can access personally identifiable data and medical records. Although in principle the duty to safeguard privacy is unassailable,having to obtain written authorization from patients introduces problems for primary care, health services, and public health research.The first problem is logistical: locating and contacting patients can be daunting, if not impossible, and may render certain vital classes of studies infeasible.Second, restricting data to patients who provide authorization may compromise external validity: patients who are available and willing to provide consent may differ in important respects from other patients. In such cases, inferences based on this subset of patients may mischaracterize the quality and effectiveness of health care for the general population.For example, a 1997 Minnesota statute requires researchers to obtain patient consent before examining medical records.A health plan in that state, participating in a Food and Drug Administration surveillance study, could not examine the records of patients using a new drug (to investigate reports of the occurrence of seizures) without obtaining patient permission. Despite 2 rounds of letters (and telephone calls to nonrespondents), only 52% of patients responded, and only 19% gave consent.Unreported by the authors is whether this subgroup of patients differed in important ways from other patients taking the drug.Yawn et al,implementing the same law to conduct outcomes research at a health care system, confirmed that refusal was nonuniform, occurring more often among women, young persons, and patients visiting for certain reasons. They noted, for example, that the refusal rate among female smokers whose fetus or infant died following preterm birth or from sudden infant death syndrome was 4 times greater than among other patients (B. P. Yawn, e-mail communication, 1999). They warned that this "authorization bias" could distort outcomes data. For example, if data from women withholding consent were excluded, an epidemiologic study of maternal smoking and child mortality might not expose its association with prematurity and sudden infant death syndrome. Yawn et al noted that the restriction itself—barred access to data on nonconsenting patients—made the bias "undefined and undefinable."We know of no other studies that formally examined this phenomenon.We acquired an opportunity to explore this matter further when our institutional review board (IRB) instructed us to ask patients for consent before contacting them at home for surveys or examining their medical records. The IRB permission to access limited demographic and health status data, even for patients who do not consent to further participation, enabled us to compare the characteristics of consenting and nonconsenting patients.METHODSBACKGROUNDThe Department of Family Practice of Virginia Commonwealth University (VCU) has established a practice-based research network that collects prospective data on primary care patients and practices. Eventually, data on patient risk factors, provider characteristics, performance indicators, and outcomes will derive from a variety of sources (eg, patients, medical records, billing data). Currently, the primary data come from a survey that patients complete while awaiting their appointments with physicians. The Health Assessment Survey (HAS) asks about demographics (age, sex, race, education, income), functional status, cigarette use, and (for women) recent Papanicolaou testing.SETTINGThis study was conducted at the first site in the network, a university-affiliated family practice clinic in downtown Richmond, Va, averaging 10 700 annual visits. The practice includes large proportions of low-income and minority patients; approximately 34% are either Medicaid beneficiaries or uninsured and 71% are African American.CONSENT REQUIREMENTSThe institutional review board required no explicit consent for the HAS. A statement at the beginning of the HAS reviewed how the results would be used, and patients (or the parent or guardian of minors) decided whether to proceed. Although completed forms left the practice when they were forwarded to VCU, the only personal identifier they contained was the patient's medical record number, which meant little outside the practice and, therefore, functioned as a key code. (Under federal statute, this permitted the IRB to alter consent proceduresand waive documentation.)We linked HAS responses with administrative visit data (birth date, visit date, Current Procedural Terminology 4and International Classification of Diseases, Ninth Revision, Clinical Modification[ICD-9-CM] codes). The practice exported this information to VCU researchers in an electronic file from which personally identifiable data were removed. We used the medical record number key code to link this information with HAS responses. The inability to link this information to the personal identity of the patient permitted the IRB to waive consent.Future plans call for augmenting these data with mail or telephone surveys and with audits of medical records. Because these studies will require access to personal information (eg, mailing address), our IRB instructed us to obtain explicit patient authorization. We therefore added a question soliciting this consent to the end of the HAS survey:"Our practice is working with Family Practice researchers at Virginia Commonwealth University to ensure that you receive the best possible care. We are asking you to give them permission to contact you by phone or mail and to review your medical record to inquire further about your health and the medical care you are receiving (see the blue information sheet for details). All obtained information will be kept strictly confidential by the VCU researchers and us. (Mark one oval.)O I give permission to be contacted and for my records to be reviewed to obtain information about the quality of care I have received.O I do notgive permission to be contacted or for my records to be reviewed."The blue sheet (Figure 1), attached to the HAS, provided study details required by the IRB for informed consent.Figure 1.One-page fact sheet accompanying survey.SAMPLING FRAMEWe monitored consent rates for 29 weeks (May through November 1999). During that time, 2046 patients visiting the practice met HAS eligibility criteria: visiting a physician, not making their first visit, age of 14 years or older (minors had to be accompanied by a parent or guardian), and HAS not taken for 1 year. Of these 2046 patients, approximately 60% were selected randomly to take the survey; we applied this random filter to limit the burden on office staff. Approximately 6% of eligible patients did not participate because of inability (eg, too ill), staff workload or oversights, or patient refusal (at this clinic we previously documented an 89% participation rate among approached patients). The 1106 patients (54%) who were approached by office staff and agreed to take the HAS constitute the sample for this study. These patients were younger and included more women than the 940 nonparticipants (P<.01).CONSENT CATEGORIESThere were 3 possible responses to the consent question: active consent, active denial, or no answer (passive denial). The last 2 groups formed a combined category of patients who, actively or passively, did not give consent.DEMOGRAPHIC VARIABLES AND HEALTH OUTCOMESAge and sex were available in practice billing data, and race, educational status, and income were provided by the HAS. The latter, adapted from the US Census questionnaire and the National Health Interview Survey, asked patients to choose 1 of 7 levels of education and 1 of 8 ranges of annual combined family income.The ICD-9-CMdiagnoses recorded at the index visit were classified with Clinical Classification Software (CCS).Severity of illness, based on ICD-9-CMcodes for the past year, was evaluated with the Johns Hopkins Adjusted Clinical Groups (ACG) Case-Mix System.After classifying diagnoses into ambulatory diagnostic groups, the ACG branching algorithm assigns patients to 1 of 93 mutually exclusive ACG categories.Functional status was measured with the 36-Item Short-Form Health Survey,included in the HAS. We used the 36-Item Short-Form Health Survey Physical Component Summary (PCS) and Mental Component Summary (MCS) to aggregate its 8 physical and mental functional status domains.Higher PCS and MCS scores reflect higher functional status.STATISTICAL ANALYSISResults were analyzed with SAS software.The statistical significance of differences between means was assessed by analysis of variance (ttest). To determine if differences in summary measures across groups deviated significantly from what would be expected if groups were assigned randomly, we used an asymptotic approximation to the permutation ttest: the 2-sample ttest corrected for sampling from a finite population (the sampling frame).Differences between percentages were assessed with the χ2test. Associations between the consent responses (consent given, consent denied) and demographic and health variables were assessed with multivariate logistic regression, thereby producing variable-specific adjusted odds ratios. The model included indicators for missing data.We imputed consent responses for patients not answering the question by likening their response to their nearest neighbor (as measured by the Mahalanobis distance) in the responding group based on age, sex, the number of missing survey items, and the number of the last completed item before the consent question. This nonparametric discrimination method correctly classified 75% of the responding group (Goodman-Kruskal γ, 0.84).RESULTSRESPONDENTSThe mean age of the 1106 patients who participated in the HAS was 41 years; 78% were female, 55% had a high school or higher education, and 69% were above the poverty level in Richmond, Va, for a family of 4 (combined annual family income, >$15 000). Twenty-six percent of respondents were current cigarette smokers.CONSENT RESPONSESOf the 1106 HAS participants, 743 (67%) answered yes to the consent question (ie, giving researchers permission to contact them for further surveys and review their records). A total of 278 (25%) actively denied consent, and 85 (8%) did not answer. Approximately 80% of the patients in the latter group also did not answer preceding questions (compared with 41% for patients who did answer the consent question), suggesting that many gave no answer because they did not reach the end of the form.DEMOGRAPHIC COMPARISONSPatients who gave consent (n = 743) were significantly older (P<.01) and included fewer women (P<.001) and African Americans (P<.01) than patients who did not give consent (n = 363) (Table 1). Within the latter group of nonconsenters, we found significant demographic differences between patients who actively denied consent (n = 278) and those who passively denied by not answering (n = 85). Those who did not answer were older (P<.001), had less education (P<.01) and income (P= .05), and included more African Americans (P<.01) than those who actively denied consent.Table 1. Characteristics of Respondents by Consent Status*ConsentNo. of RespondentsDemographic CharacteristicsFunctional StatusMean Age, yFemale, %Income ≥ $15 000, %Higher Education, %Race, Black-White RatioMean PCS ScoreMean MCS ScoreGiven74341.3 (0.54)75.2 (1.6)68.5 (1.8)54.4 (1.8)2.3 (0.18)43.3 (0.43)47.3 (0.46)Not given36338.8† (0.76)83.8† (1.9)69.4 (2.8)57.7 (2.7)3.3† (0.43)45.8† (0.62)48.2 (0.69)Active denial27837.0† (0.79)82.6† (2.3)71.0 (3.0)60.4† (2.9)2.9 (0.40)46.4† (0.66)48.7 (0.72)Passive denial (did not answer)8544.8‡ (1.83)88.0 (3.6)59.5‡ (8.1)42.9‡ (7.1)6.4‡ (2.18)42.1‡ (1.75)45.6 (2.04)Answered (consent given plus active denial)102140.1§ (0.46)77.2§ (1.3)69.1 (1.5)56.0§ (1.6)2.4§ (0.17)44.2 (0.36)47.7 (0.39)*Values in parentheses are SE. PCS indicates Physical Component Summary; MCS, Mental Component Summary.†Statistically significant ( P≤.05) differences when compared with patients who gave consent.‡Statistically significant ( P≤.05) differences when compared with patients who actively denied consent.§Statistically significant ( P≤.02) differences when compared with patients who did not answer the consent question (passive denial).Because these data indicated that the active and passive denial groups were demographically distinct, we excluded patients who did not answer and contrasted the responses of patients who actively denied consent (n = 278) with those of patients who gave consent (n = 743). Patients who actively denied consent were younger (P<.001), included more women (P<.01), and were more educated (P= .05) than those who gave consent (Table 1). Refusal rates decreased with age (Figure 2), with the 18- to 24-year-old age group having the highest refusal rate (34%).Figure 2.Responses to consent question by age. An association between age and consent is apparent for adults aged 18 to 64 years. Age groups that do not seem to follow this pattern (ages 14-17, 65-74, and ≥75 years) had small sample sizes, with wide confidence intervals limiting the precision of the mean.The 85 patients who did not answer (neither actively giving nor denying consent) differed significantly from those who answered (n = 1021); they were older (P= .01), included more women (P<.01), were less educated (P= .02), and included more African Americans (P<.001). Although statistical significance was not reached, they appeared to be less affluent than patients who answered the question (P= .07). Current smoking rates were similar among all groups.HEALTH STATUS COMPARISONSFunctional StatusPatients who gave consent had significantly lower mean PCS scores than patients who did not consent (P<.001) (Table 1). When patients who did not answer (passive denials) were excluded from the latter group, the difference in PCS scores was larger, and the difference in mean MCS scores approached significance (P= .07). Patients with the highest physical function scores were significantly more likely to refuse (Figure 3). The PCS scores were significantly lower for patients who did not answer the question than for those who actively denied consent (P= .02).Figure 3.Consent responses and physical functional status. Denial rates are highest in patients with mean 36-Item Short-Form Health Survey Physical Component Summary (PCS) scores above the 75th percentile. Corresponding PCS scores by percentile interval were as follows: 0 to 29.8 (0%-12.5%), greater than 29.8 to 36.0 (>12.5%-25%), greater than 36.0 to 41.8 (>25%-37.5%), greater than 41.8 to 46.2 (>37.5%-50.0%), greater than 46.2 to 50.0 (>50.0%-62.5%), greater than 50.0 to 53.0 (>62.5%-75.0%), greater than 53.0 to 55.9 (>75.0%-87.5%), and greater than 55.9 to 100 (>87.5%).Diagnoses Recorded at Index VisitDenial rates were highest when patients visited for contraception (CCS 11.1, 46.7%), urinary disorders (CCS 10.1, 39.4%), uncomplicated diabetes (CCS 3.2, 37.5%), headache (CCS 6.5, 37.0%), or female genital disorders (CCS 10.3, 35.4%). The CCS categories were distributed similarly for those who gave and denied consent, although patients who denied consent were more likely to visit for certain reasons: miscellaneous conditions of the nervous system (CCS 6.9), parasitic and other infections (CCS 1.4), and contraception (CCS 11.1) (P= .02, .06, and .09, respectively). Within the broad category of female genital disorders (CCS 10.3), there were no significant differences, but denials were more likely among women with pelvic infections (CCS 10.3.2) (P= .02). A total of 20% of patients who did not answer the question visited for diabetes (CCS 3.2-3.3), a much higher proportion than among those who answered (5.7%) (P<.01).Severity of IllnessThe ACG distributions of patients who gave and denied consent did not differ significantly. Some differences were noted, however, in 2 of the 32 ambulatory diagnostic groupings on which they are based. Patients who gave consent were more likely than those who denied consent to have visited for "stable chronic medical conditions" (eg, type 2 diabetes mellitus) (59.2% vs 50.2%, P= .01), and the rate was even higher (67.5%) for those who did not answer. The difference for "unstable chronic medical conditions" (16.1% vs 11.5% for those who gave and denied consent, respectively) was smaller and did not reach statistical significance (P= .07).Accounting for Patients Who Did Not AnswerWe do not know how many patients did not answer the last question because they did not reach the end of the form, nor can we predict their answers. Although this group had unique demographic and health characteristics, we doubt that their answers would have changed our overall findings. Using nearest neighbor estimates, we predict that only 53 (62%) of the 85 patients who did not answer would have given consent. When we combined these 53 patients with the 743 who actively gave consent and the remaining 32 nonresponders with the 278 who actively denied consent, we found no difference in the previously described demographic and health profiles of the 2 populations.Multivariate Logistic Regression AnalysisMultivariate logistic regression analysis revealed a significant and independent association between giving consent and increased age (P= .01), male sex (P= .01), and lower mean PCS scores (P= .03) (Table 2). Patients were also less likely to give consent if they did not answer questions on income (P<.01), smoking (P<.01), or functional status (PCS and MCS, P<.01). We repeated the multivariate logistic regression after reassigning patients in the passive denial category to either the active consent or active denial category, using imputed values from the nearest neighbor analysis. It revealed the same set of significant associations, except that missing data on smoking status lost significance.Table 2. Odds Ratios for Consent (vs No Consent) From Multivariate Logistic Regression AnalysisVariable*Adjusted Odds Ratio (95% Wald Confidence Interval)PSex (male vs female)1.62 (1.12-2.35).01Age (10-y increments)1.16 (1.04-1.29).008Education (>high school vs ≤high school)1.47 (0.92-2.36).50Income (≥$15 000 vs <$15 000)1.22 (0.60-2.52).80Smoking status (current smoker vs nonsmoker)0.91 (0.63-1.30).66PCS (10-point increments)0.85 (0.74-0.98).03MCS (10-point increments)0.92 (0.81-1.04).19Race (black vs white)0.93 (0.78-1.10).68Missing data (missing vs present)Sex0.98 (0.20-4.72).98Age1.10 (0.49-2.50).81Education0.44 (0.17-1.18).10Income0.26 (0.17-0.41)<.001Smoking status0.17 (0.05-0.62).007PCS/MCS0.26 (0.09-0.70).008Race0.48 (0.11-2.12).33*PCS indicates Physical Component Summary; MCS, Mental Component Summary.COMMENTThis study found that patients who gave consent differed in important demographic and health characteristics from those who did not consent. The demographic variables that differed between these groups (eg, age, sex, race) have important associations with health outcomes. Furthermore, patients who denied consent differed in functional status and in the health conditions for which they sought care. Patients in poorer health were more likely to consent. In our model, for example, the probability of obtaining consent would be 89% for a 65-year-old man with a PCS of 30 but only 70% for a 35-year-old woman with a PCS of 60. Differences in some indices followed this pattern but did not reach statistical significance. Whether this reflects a lack of difference or inadequate power is unclear. For example, the CCS category with the most patients (CCS 10, genitourinary disorders) had only 165 patients. With this sample size, the power to detect a true consent rate that was 10% higher or lower than the observed value (67.5%) was only 49%. Power would be even smaller for less populated categories.To the extent that these data are generalizable, they indicate that research restricted to patients who give explicit written consent may mischaracterize the health status of the larger population. Whether statistical adjustments for these discordances could compensate for this selection bias is unclear. It is also uncertain how this selection bias interrelates, both in magnitude and synergism, to other biases, such as those introduced by nonresponse and nonparticipation. For example, patients who took the HAS were younger and included more women than those who did not participate.In effect, the selection bias we report represents the last of a series of biases that filter out patients from the original population.Both the internal and external validity of this study are contestable. The internal validity—the extent to which our findings are valid for our clinic population—may be limited by the wording and location of the consent question on the HAS form and by the setting in which the question was asked. These factors might explain our high refusal rate. When Yawn et alrequested patients' consent to comply with Minnesota law, only 3.6% refused and 4.5% were undecided. Similarly, the Mayo Clinic reported a consent rate of 96% among patients who returned forms.Both programs sought access only to medical records, however. Our question combined 2 requests: permission to examine medical records and permission to be contacted for surveys. Our high rejection rate is not unlike the large proportion of patients who do not return mail surveys (ie, our question may simply have preselected these nonresponders).The topics on the HAS that precede the consent question and their wording may have influenced consent. For example, more patients may have given consent if preceding questions addressed a condition that they had. The reading level and cultural orientation of the text may have dissuaded many of our patients with limited education or minority backgrounds. Potentially sensitive questions on the HAS may have discouraged consent. Patients who did not answer the question about income were, on multivariate analysis, significantly less likely to give consent.Locating the consent question at the end of the form may have contributed to nonresponse. Patients who did not give consent were, on multivariate analysis, less likely to have answered the preceding questions. Patients who did not answer tended to be older, more ill, and less educated and would be expected to proceed more slowly through a survey. Moreover, asking the consent question while patients waited for appointments might yield different answers than inquiring at a less stressful time. Finally, consent may have an independent association with visit frequency, an association we hope to analyze in future studies.The external validity of the study—the extent to which our findings can be extrapolated elsewhere—may be limited. Patients attending a family practice center in downtown Richmond, Va, a predominantly African American and low-income population, differ from patients in other settings. Moreover, much of the information that patients read in our fact sheet concerned our study and research network and would not apply when other researchers solicit consent. We would expect patients' willingness to offer consent and the characteristics of those who refuse to differ by setting.Yawn et al,for example, described a different profile for patients who denied consent. In their study, refusal was most common among women, persons aged 41 to 64 years, and patients visiting for mental illness, eye care, trauma, and gynecologic problems. Their patient population differed from ours. They also solicited consent differently. In addition to outpatient clinics, authorization was obtained at the emergency department and hospital. A receptionist or hospital registration clerk requested consent as part of normal registration. The form and accompanying material addressed only the use of medical records (with no mention of surveys) and gave patients greater reassurance that their anonymity would be protected.Despite these differences, both our study and the work by Yawn et al reached the same conclusion: patients who give consent differ in important characteristics from those who do not. We know of no other studies in the medical setting that have examined this bias. Studies in school settings have also shown that having to obtain parental consent to survey children leads to underrepresentation of at-risk youth.To the extent that this occurs in medicine, studies of the effectiveness and quality of care that require explicit consent could produce skewed results, potentially misleading clinicians, policymakers, and consumers.The net harms to society of requiring consent should be weighed against the benefits. If obtaining consent selectively omits data that mask a problem in women receiving timely mammograms, for example, then data privacy could come at the cost of higher breast cancer mortality. When this selection bias is extended across all studies for which written authorization might be required—public health surveillance, outcomes research, quality assurance—the potential grows for misjudgments of epidemiologic trends, risk rates, and the effectiveness and safety of tests and treatments. Some public health groups have warned about the harms to society from such data errors.Nonetheless, strong ethical arguments support the need for consent, at least for the release of personally identifiable data.Patients deserve to know when unauthorized individuals examine their medical records or have access to their address or other personal details. Electronic incursions into personal informationand violations of privacy by unauthorized entities (eg, employers,marketing firms) have heightened public sensitivity to this issue. Access to personal genetic information has raised further concerns about the need for consent, as illustrated by recent experience in Iceland.According to a Louis Harris poll, 27% of Americans believe that their medical records have been improperly disclosed, and 64% object to researchers gaining access without explicit consent.Strong public sentiment prompted federal action by Congressand the Clinton administration (privacy regulations on electronically transferred medical data,bioethics commission on human subjects research). As of 1999, 5 state legislatures had passed or were considering comprehensive health information statutes.Federal officials have recently terminated research at major academic centers, often because of privacy violations.The dilemma posed by the selection bias we observed reflects a tension between competing ethical duties: the rights of individuals to privacy and, conversely, of society to accurate monitoring of the effectiveness and safety of health care.Which duty should prevail is an ethicaland legal issueworthy of thoughtful discourse by providers, ethicists, researchers, policymakers, and patients. The first step is to confirm the existence of the selection bias. Further work by investigators in other research settings and with larger sample sizes will help elucidate this problem, its magnitude, and the extent to which it can be attenuated by better methods for obtaining consent.Since this article was accepted for publication, the Institute of Medicine published a report on protecting data privacy in health services research. The report warned that "the requirement of consent would likely lead to bias and invalid findings, because those who opt out might differ systematically from those giving consent."Our findings validate this concern.MSDonaldsonKNLohrHealth Data in the Information Age: Use, Disclosure, and Privacy.Washington, DC: National Academy Press; 1994.LJMelton IIIThe threat to medical-records research.N Engl J Med.1997;337:1466-1470.Not AvailableAccess to Health Records, Subdivision 3-Patient Consent to Release of Records.Minnesota Law 144.335. Effective 1/1/97.DBMcCarthyDShatinCRDrinkardJHKleinmanJSGardnerMedical records and privacy: empirical effects of legislation.Health Serv Res.1999;34(1, pt 2):417-425.BPYawnRAYawnGRGeierZXiaSJJacobsenThe impact of requiring patient authorization for use of data in medical records research.J Fam Pract.1998;47:361-365.SFRothemichSHWoolfREJohnsonDWMarslandEvaluating the administration of an office-based health survey in a primary care practice.J Clin Epidemiol.2000;53(10):1002-1012.Not AvailableFederal Policy for the Protection of Human Subjects (1994) (codified at 45 CFR §46.116(d)). 56.Federal Register 28003.(June 18, 1991).Not AvailableFederal Policy for the Protection of Human Subjects (1994) (codified at 45 CFR §46.117(c)2). 56Federal Register 28002,(June 18, 1991).Not AvailableInternational Classification of Diseases, Ninth Revision, Clinical Modification.Washington, DC: Public Health Service, US Dept of Health and Human Services; 1988.Not AvailableClinical Classification Software (CCS) Summary and Download: Summary and Downloading Information.Rockville, Md: Agency for Health Care Policy and Research. Available at: http://www.ahrq.gov/data/hcup/ccs.htm. Accessed February 5, 2000.BStarfieldJWeinerLMumfordDSteinwachsAmbulatory care groups: a categorization of diagnoses for research and management.Health Serv Res.1991;26:53-74.Not AvailableThe Johns Hopkins University ACG Case Mix Adjustment System: Documentation for PC-DOS and UNIX.Baltimore, Md: Johns Hopkins University School of Hygiene and Public Health, Health Services Research and Development Center; 1998. Further details available at: http://www.acg.jhsph.edu/. Accessed February 5, 2000.JEWare JrMKosinskiSDKellerSF-36 Physical & Mental Health Summary Scales: A User's Manual.Boston, Mass: Health Institute, New England Medical Center; 1994.JEWare JrMKosinskiMSBaylissCAMcHorneyWHRogersARaczekComparison of methods for the scoring and statistical analysis of SF-36 health profile and summary measures: summary of results from the Medical Outcomes Study.Med Care.1995;33(4 suppl):AS264-AS279.Not AvailableSAS Statistical Software[computer program].Cary, NC: SAS Institute Inc; 1996.DRCoxDVHinkleyTheoretical Statistics.New York, NY: Chapman & Hall Ltd; 1974.DFMorrisonMultivariate Statistical Methods.New York, NY: McGraw-Hill Inc; 1976.FAEsbensenMHMillerTJTaylorNHeAFrengDifferential attrition rates and active parental consent.Eval Rev.1999;23:316-335.American College of EpidemiologyStatement on Health Data Control, Access, and Confidentiality.Available at: http://www.acepidemiology.org/data.html. Accessed February 14, 2000.BWoodwardChallenges to human subject protections in US medical research.JAMA.1999;282:1947-1952.JHagel IIIJFRayportThe coming battle for customer information.Harv Bus Rev.1997;75:53-55, 58, 60-61.DMStuddertRAND Institute for Civil JusticeDirect contracts, data sharing and employee risk selection: new stakes for patient privacy in tomorrow's health insurance markets.Am J Law Med.1999;25:233-265.BLoAAlpersUses and abuses of prescription drug information in pharmacy benefits management programs.JAMA.2000;283:801-806.JRGulcherKStefanssonThe Icelandic Healthcare Database and informed consent.N Engl J Med.2000;342:1827-1830.GJAnnasRules for research on human genetic variation: lessons from Iceland.N Engl J Med.2000;342:1830-1833.Harris/EquifaxHealth Care Information Privacy: A Survey of the Public and Leaders.Conducted for Equifax. New York, NY: Louis Harris & Associates; 1993.Not AvailableHealth Insurance Portability and Accountability Act of 1996.§264[00a9](2), Pub L No. 104-191, 110 Stat 1936, 2033 (1996).Not AvailableStandards of Privacy of Individually Identifiable Health Information: Proposed Rule, 64.Federal Register 55918-60065(1999) (codified at 45 CFR §160164).Not AvailableExecutive Order 12975 of October 3, 1995.Available at: http://www.bioethics.gov/about/eo12975.htm. Accessed February 15, 2000.JGHodge JrLOGostinPDJacobsonLegal issues concerning electronic health information: privacy, quality, and liability.JAMA.1999;282:1466-14671.DFPhillipsIRBs search for answers and support during a time of institutional change.JAMA.2000;283:729-730.LGostinHealth care information and the protection of personal privacy: ethical and legal considerations.Ann Intern Med.1997;127:683-690.Institute of MedicineProtecting Data Privacy in Health Services Research: Committee on the Role of Institutional Review Boards in Health Services Research Data Privacy Protection.Washington, DC: National Academy Press; 2000.Accepted for publication August 9, 2000.This research was supported in part by a Robert Wood Johnson Generalist Physician Faculty Scholars Award to Dr Rothemich.Presented in part at the 27th Annual Meeting of the North American Primary Care Research Group, San Diego, Calif, November 10, 1999, and the 2000 Annual Meeting of the Association for Health Services Research, Los Angeles, Calif, June 26, 2000.We thank Barbara P. Yawn, MD, MSc, and Finn-Aage Esbensen PhD, MA, for their helpful contributions to the manuscript.Reprints: Steven H. Woolf, MD, MPH, Department of Family Practice, Medical College of Virginia, Virginia Commonwealth University, 3712 Charles Stewart Dr, Fairfax, VA 22033. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Archives of Family Medicine American Medical Association

Selection Bias From Requiring Patients to Give Consent to Examine Data for Health Services Research

Loading next page...
 
/lp/american-medical-association/selection-bias-from-requiring-patients-to-give-consent-to-examine-data-0COxYaK5Pt

References (32)

Publisher
American Medical Association
Copyright
Copyright 2000 American Medical Association. All Rights Reserved. Applicable FARS/DFARS Restrictions Apply to Government Use.
ISSN
1063-3987
eISSN
1063-3987
DOI
10-1001/pubs.Arch Fam Med.-ISSN-1063-3987-9-10-foc0057
Publisher site

Abstract

BackgroundNew rulings nationwide require health services researchers to obtain patient consent before examining personally identifiable data. A selection bias may result if consenting patients differ from those who do not give consent.ObjectiveTo compare patients who consent, refuse, and do not answer.DesignPatients completing an in-office survey were asked for permission to be surveyed at home and for their records to be reviewed. Survey responses and practice billing data were used to compare patients by consent status.SettingUrban family practice center.PatientsOf 2046 eligible patients, 1106 were randomly selected for the survey, were approached by staff, and agreed to participate. Approximately 87% of the nonparticipants were eliminated through a randomization process.Main Outcome MeasureConsent status.ResultsA total of 33% of patients did not give consent: 25% actively refused, and 8% did not answer. Consenting patients were older, included fewer women and African Americans, and reported poorer physical function than those who did not give consent (P<.05). Patients who did not answer the question were older, included more women and African Americans, and were less educated than those who answered (P<.02). Visits for certain reasons (eg, pelvic infections) were associated with lower consent rates. On multivariate analysis, older age, male sex, and lower functional status were significant predictors of consent.ConclusionsPatients who release personal information for health services research differ in important characteristics from those who do not. In this study, older patients and those in poorer health were more likely to grant consent. Quality and health services research restricted to patients who give consent may misrepresent outcomes for the general population.CONCERNS ABOUT patient privacy have prompted governments and health care organizations to impose new rulings that require researchers to obtain explicit consent from patients before they can access personally identifiable data and medical records. Although in principle the duty to safeguard privacy is unassailable,having to obtain written authorization from patients introduces problems for primary care, health services, and public health research.The first problem is logistical: locating and contacting patients can be daunting, if not impossible, and may render certain vital classes of studies infeasible.Second, restricting data to patients who provide authorization may compromise external validity: patients who are available and willing to provide consent may differ in important respects from other patients. In such cases, inferences based on this subset of patients may mischaracterize the quality and effectiveness of health care for the general population.For example, a 1997 Minnesota statute requires researchers to obtain patient consent before examining medical records.A health plan in that state, participating in a Food and Drug Administration surveillance study, could not examine the records of patients using a new drug (to investigate reports of the occurrence of seizures) without obtaining patient permission. Despite 2 rounds of letters (and telephone calls to nonrespondents), only 52% of patients responded, and only 19% gave consent.Unreported by the authors is whether this subgroup of patients differed in important ways from other patients taking the drug.Yawn et al,implementing the same law to conduct outcomes research at a health care system, confirmed that refusal was nonuniform, occurring more often among women, young persons, and patients visiting for certain reasons. They noted, for example, that the refusal rate among female smokers whose fetus or infant died following preterm birth or from sudden infant death syndrome was 4 times greater than among other patients (B. P. Yawn, e-mail communication, 1999). They warned that this "authorization bias" could distort outcomes data. For example, if data from women withholding consent were excluded, an epidemiologic study of maternal smoking and child mortality might not expose its association with prematurity and sudden infant death syndrome. Yawn et al noted that the restriction itself—barred access to data on nonconsenting patients—made the bias "undefined and undefinable."We know of no other studies that formally examined this phenomenon.We acquired an opportunity to explore this matter further when our institutional review board (IRB) instructed us to ask patients for consent before contacting them at home for surveys or examining their medical records. The IRB permission to access limited demographic and health status data, even for patients who do not consent to further participation, enabled us to compare the characteristics of consenting and nonconsenting patients.METHODSBACKGROUNDThe Department of Family Practice of Virginia Commonwealth University (VCU) has established a practice-based research network that collects prospective data on primary care patients and practices. Eventually, data on patient risk factors, provider characteristics, performance indicators, and outcomes will derive from a variety of sources (eg, patients, medical records, billing data). Currently, the primary data come from a survey that patients complete while awaiting their appointments with physicians. The Health Assessment Survey (HAS) asks about demographics (age, sex, race, education, income), functional status, cigarette use, and (for women) recent Papanicolaou testing.SETTINGThis study was conducted at the first site in the network, a university-affiliated family practice clinic in downtown Richmond, Va, averaging 10 700 annual visits. The practice includes large proportions of low-income and minority patients; approximately 34% are either Medicaid beneficiaries or uninsured and 71% are African American.CONSENT REQUIREMENTSThe institutional review board required no explicit consent for the HAS. A statement at the beginning of the HAS reviewed how the results would be used, and patients (or the parent or guardian of minors) decided whether to proceed. Although completed forms left the practice when they were forwarded to VCU, the only personal identifier they contained was the patient's medical record number, which meant little outside the practice and, therefore, functioned as a key code. (Under federal statute, this permitted the IRB to alter consent proceduresand waive documentation.)We linked HAS responses with administrative visit data (birth date, visit date, Current Procedural Terminology 4and International Classification of Diseases, Ninth Revision, Clinical Modification[ICD-9-CM] codes). The practice exported this information to VCU researchers in an electronic file from which personally identifiable data were removed. We used the medical record number key code to link this information with HAS responses. The inability to link this information to the personal identity of the patient permitted the IRB to waive consent.Future plans call for augmenting these data with mail or telephone surveys and with audits of medical records. Because these studies will require access to personal information (eg, mailing address), our IRB instructed us to obtain explicit patient authorization. We therefore added a question soliciting this consent to the end of the HAS survey:"Our practice is working with Family Practice researchers at Virginia Commonwealth University to ensure that you receive the best possible care. We are asking you to give them permission to contact you by phone or mail and to review your medical record to inquire further about your health and the medical care you are receiving (see the blue information sheet for details). All obtained information will be kept strictly confidential by the VCU researchers and us. (Mark one oval.)O I give permission to be contacted and for my records to be reviewed to obtain information about the quality of care I have received.O I do notgive permission to be contacted or for my records to be reviewed."The blue sheet (Figure 1), attached to the HAS, provided study details required by the IRB for informed consent.Figure 1.One-page fact sheet accompanying survey.SAMPLING FRAMEWe monitored consent rates for 29 weeks (May through November 1999). During that time, 2046 patients visiting the practice met HAS eligibility criteria: visiting a physician, not making their first visit, age of 14 years or older (minors had to be accompanied by a parent or guardian), and HAS not taken for 1 year. Of these 2046 patients, approximately 60% were selected randomly to take the survey; we applied this random filter to limit the burden on office staff. Approximately 6% of eligible patients did not participate because of inability (eg, too ill), staff workload or oversights, or patient refusal (at this clinic we previously documented an 89% participation rate among approached patients). The 1106 patients (54%) who were approached by office staff and agreed to take the HAS constitute the sample for this study. These patients were younger and included more women than the 940 nonparticipants (P<.01).CONSENT CATEGORIESThere were 3 possible responses to the consent question: active consent, active denial, or no answer (passive denial). The last 2 groups formed a combined category of patients who, actively or passively, did not give consent.DEMOGRAPHIC VARIABLES AND HEALTH OUTCOMESAge and sex were available in practice billing data, and race, educational status, and income were provided by the HAS. The latter, adapted from the US Census questionnaire and the National Health Interview Survey, asked patients to choose 1 of 7 levels of education and 1 of 8 ranges of annual combined family income.The ICD-9-CMdiagnoses recorded at the index visit were classified with Clinical Classification Software (CCS).Severity of illness, based on ICD-9-CMcodes for the past year, was evaluated with the Johns Hopkins Adjusted Clinical Groups (ACG) Case-Mix System.After classifying diagnoses into ambulatory diagnostic groups, the ACG branching algorithm assigns patients to 1 of 93 mutually exclusive ACG categories.Functional status was measured with the 36-Item Short-Form Health Survey,included in the HAS. We used the 36-Item Short-Form Health Survey Physical Component Summary (PCS) and Mental Component Summary (MCS) to aggregate its 8 physical and mental functional status domains.Higher PCS and MCS scores reflect higher functional status.STATISTICAL ANALYSISResults were analyzed with SAS software.The statistical significance of differences between means was assessed by analysis of variance (ttest). To determine if differences in summary measures across groups deviated significantly from what would be expected if groups were assigned randomly, we used an asymptotic approximation to the permutation ttest: the 2-sample ttest corrected for sampling from a finite population (the sampling frame).Differences between percentages were assessed with the χ2test. Associations between the consent responses (consent given, consent denied) and demographic and health variables were assessed with multivariate logistic regression, thereby producing variable-specific adjusted odds ratios. The model included indicators for missing data.We imputed consent responses for patients not answering the question by likening their response to their nearest neighbor (as measured by the Mahalanobis distance) in the responding group based on age, sex, the number of missing survey items, and the number of the last completed item before the consent question. This nonparametric discrimination method correctly classified 75% of the responding group (Goodman-Kruskal γ, 0.84).RESULTSRESPONDENTSThe mean age of the 1106 patients who participated in the HAS was 41 years; 78% were female, 55% had a high school or higher education, and 69% were above the poverty level in Richmond, Va, for a family of 4 (combined annual family income, >$15 000). Twenty-six percent of respondents were current cigarette smokers.CONSENT RESPONSESOf the 1106 HAS participants, 743 (67%) answered yes to the consent question (ie, giving researchers permission to contact them for further surveys and review their records). A total of 278 (25%) actively denied consent, and 85 (8%) did not answer. Approximately 80% of the patients in the latter group also did not answer preceding questions (compared with 41% for patients who did answer the consent question), suggesting that many gave no answer because they did not reach the end of the form.DEMOGRAPHIC COMPARISONSPatients who gave consent (n = 743) were significantly older (P<.01) and included fewer women (P<.001) and African Americans (P<.01) than patients who did not give consent (n = 363) (Table 1). Within the latter group of nonconsenters, we found significant demographic differences between patients who actively denied consent (n = 278) and those who passively denied by not answering (n = 85). Those who did not answer were older (P<.001), had less education (P<.01) and income (P= .05), and included more African Americans (P<.01) than those who actively denied consent.Table 1. Characteristics of Respondents by Consent Status*ConsentNo. of RespondentsDemographic CharacteristicsFunctional StatusMean Age, yFemale, %Income ≥ $15 000, %Higher Education, %Race, Black-White RatioMean PCS ScoreMean MCS ScoreGiven74341.3 (0.54)75.2 (1.6)68.5 (1.8)54.4 (1.8)2.3 (0.18)43.3 (0.43)47.3 (0.46)Not given36338.8† (0.76)83.8† (1.9)69.4 (2.8)57.7 (2.7)3.3† (0.43)45.8† (0.62)48.2 (0.69)Active denial27837.0† (0.79)82.6† (2.3)71.0 (3.0)60.4† (2.9)2.9 (0.40)46.4† (0.66)48.7 (0.72)Passive denial (did not answer)8544.8‡ (1.83)88.0 (3.6)59.5‡ (8.1)42.9‡ (7.1)6.4‡ (2.18)42.1‡ (1.75)45.6 (2.04)Answered (consent given plus active denial)102140.1§ (0.46)77.2§ (1.3)69.1 (1.5)56.0§ (1.6)2.4§ (0.17)44.2 (0.36)47.7 (0.39)*Values in parentheses are SE. PCS indicates Physical Component Summary; MCS, Mental Component Summary.†Statistically significant ( P≤.05) differences when compared with patients who gave consent.‡Statistically significant ( P≤.05) differences when compared with patients who actively denied consent.§Statistically significant ( P≤.02) differences when compared with patients who did not answer the consent question (passive denial).Because these data indicated that the active and passive denial groups were demographically distinct, we excluded patients who did not answer and contrasted the responses of patients who actively denied consent (n = 278) with those of patients who gave consent (n = 743). Patients who actively denied consent were younger (P<.001), included more women (P<.01), and were more educated (P= .05) than those who gave consent (Table 1). Refusal rates decreased with age (Figure 2), with the 18- to 24-year-old age group having the highest refusal rate (34%).Figure 2.Responses to consent question by age. An association between age and consent is apparent for adults aged 18 to 64 years. Age groups that do not seem to follow this pattern (ages 14-17, 65-74, and ≥75 years) had small sample sizes, with wide confidence intervals limiting the precision of the mean.The 85 patients who did not answer (neither actively giving nor denying consent) differed significantly from those who answered (n = 1021); they were older (P= .01), included more women (P<.01), were less educated (P= .02), and included more African Americans (P<.001). Although statistical significance was not reached, they appeared to be less affluent than patients who answered the question (P= .07). Current smoking rates were similar among all groups.HEALTH STATUS COMPARISONSFunctional StatusPatients who gave consent had significantly lower mean PCS scores than patients who did not consent (P<.001) (Table 1). When patients who did not answer (passive denials) were excluded from the latter group, the difference in PCS scores was larger, and the difference in mean MCS scores approached significance (P= .07). Patients with the highest physical function scores were significantly more likely to refuse (Figure 3). The PCS scores were significantly lower for patients who did not answer the question than for those who actively denied consent (P= .02).Figure 3.Consent responses and physical functional status. Denial rates are highest in patients with mean 36-Item Short-Form Health Survey Physical Component Summary (PCS) scores above the 75th percentile. Corresponding PCS scores by percentile interval were as follows: 0 to 29.8 (0%-12.5%), greater than 29.8 to 36.0 (>12.5%-25%), greater than 36.0 to 41.8 (>25%-37.5%), greater than 41.8 to 46.2 (>37.5%-50.0%), greater than 46.2 to 50.0 (>50.0%-62.5%), greater than 50.0 to 53.0 (>62.5%-75.0%), greater than 53.0 to 55.9 (>75.0%-87.5%), and greater than 55.9 to 100 (>87.5%).Diagnoses Recorded at Index VisitDenial rates were highest when patients visited for contraception (CCS 11.1, 46.7%), urinary disorders (CCS 10.1, 39.4%), uncomplicated diabetes (CCS 3.2, 37.5%), headache (CCS 6.5, 37.0%), or female genital disorders (CCS 10.3, 35.4%). The CCS categories were distributed similarly for those who gave and denied consent, although patients who denied consent were more likely to visit for certain reasons: miscellaneous conditions of the nervous system (CCS 6.9), parasitic and other infections (CCS 1.4), and contraception (CCS 11.1) (P= .02, .06, and .09, respectively). Within the broad category of female genital disorders (CCS 10.3), there were no significant differences, but denials were more likely among women with pelvic infections (CCS 10.3.2) (P= .02). A total of 20% of patients who did not answer the question visited for diabetes (CCS 3.2-3.3), a much higher proportion than among those who answered (5.7%) (P<.01).Severity of IllnessThe ACG distributions of patients who gave and denied consent did not differ significantly. Some differences were noted, however, in 2 of the 32 ambulatory diagnostic groupings on which they are based. Patients who gave consent were more likely than those who denied consent to have visited for "stable chronic medical conditions" (eg, type 2 diabetes mellitus) (59.2% vs 50.2%, P= .01), and the rate was even higher (67.5%) for those who did not answer. The difference for "unstable chronic medical conditions" (16.1% vs 11.5% for those who gave and denied consent, respectively) was smaller and did not reach statistical significance (P= .07).Accounting for Patients Who Did Not AnswerWe do not know how many patients did not answer the last question because they did not reach the end of the form, nor can we predict their answers. Although this group had unique demographic and health characteristics, we doubt that their answers would have changed our overall findings. Using nearest neighbor estimates, we predict that only 53 (62%) of the 85 patients who did not answer would have given consent. When we combined these 53 patients with the 743 who actively gave consent and the remaining 32 nonresponders with the 278 who actively denied consent, we found no difference in the previously described demographic and health profiles of the 2 populations.Multivariate Logistic Regression AnalysisMultivariate logistic regression analysis revealed a significant and independent association between giving consent and increased age (P= .01), male sex (P= .01), and lower mean PCS scores (P= .03) (Table 2). Patients were also less likely to give consent if they did not answer questions on income (P<.01), smoking (P<.01), or functional status (PCS and MCS, P<.01). We repeated the multivariate logistic regression after reassigning patients in the passive denial category to either the active consent or active denial category, using imputed values from the nearest neighbor analysis. It revealed the same set of significant associations, except that missing data on smoking status lost significance.Table 2. Odds Ratios for Consent (vs No Consent) From Multivariate Logistic Regression AnalysisVariable*Adjusted Odds Ratio (95% Wald Confidence Interval)PSex (male vs female)1.62 (1.12-2.35).01Age (10-y increments)1.16 (1.04-1.29).008Education (>high school vs ≤high school)1.47 (0.92-2.36).50Income (≥$15 000 vs <$15 000)1.22 (0.60-2.52).80Smoking status (current smoker vs nonsmoker)0.91 (0.63-1.30).66PCS (10-point increments)0.85 (0.74-0.98).03MCS (10-point increments)0.92 (0.81-1.04).19Race (black vs white)0.93 (0.78-1.10).68Missing data (missing vs present)Sex0.98 (0.20-4.72).98Age1.10 (0.49-2.50).81Education0.44 (0.17-1.18).10Income0.26 (0.17-0.41)<.001Smoking status0.17 (0.05-0.62).007PCS/MCS0.26 (0.09-0.70).008Race0.48 (0.11-2.12).33*PCS indicates Physical Component Summary; MCS, Mental Component Summary.COMMENTThis study found that patients who gave consent differed in important demographic and health characteristics from those who did not consent. The demographic variables that differed between these groups (eg, age, sex, race) have important associations with health outcomes. Furthermore, patients who denied consent differed in functional status and in the health conditions for which they sought care. Patients in poorer health were more likely to consent. In our model, for example, the probability of obtaining consent would be 89% for a 65-year-old man with a PCS of 30 but only 70% for a 35-year-old woman with a PCS of 60. Differences in some indices followed this pattern but did not reach statistical significance. Whether this reflects a lack of difference or inadequate power is unclear. For example, the CCS category with the most patients (CCS 10, genitourinary disorders) had only 165 patients. With this sample size, the power to detect a true consent rate that was 10% higher or lower than the observed value (67.5%) was only 49%. Power would be even smaller for less populated categories.To the extent that these data are generalizable, they indicate that research restricted to patients who give explicit written consent may mischaracterize the health status of the larger population. Whether statistical adjustments for these discordances could compensate for this selection bias is unclear. It is also uncertain how this selection bias interrelates, both in magnitude and synergism, to other biases, such as those introduced by nonresponse and nonparticipation. For example, patients who took the HAS were younger and included more women than those who did not participate.In effect, the selection bias we report represents the last of a series of biases that filter out patients from the original population.Both the internal and external validity of this study are contestable. The internal validity—the extent to which our findings are valid for our clinic population—may be limited by the wording and location of the consent question on the HAS form and by the setting in which the question was asked. These factors might explain our high refusal rate. When Yawn et alrequested patients' consent to comply with Minnesota law, only 3.6% refused and 4.5% were undecided. Similarly, the Mayo Clinic reported a consent rate of 96% among patients who returned forms.Both programs sought access only to medical records, however. Our question combined 2 requests: permission to examine medical records and permission to be contacted for surveys. Our high rejection rate is not unlike the large proportion of patients who do not return mail surveys (ie, our question may simply have preselected these nonresponders).The topics on the HAS that precede the consent question and their wording may have influenced consent. For example, more patients may have given consent if preceding questions addressed a condition that they had. The reading level and cultural orientation of the text may have dissuaded many of our patients with limited education or minority backgrounds. Potentially sensitive questions on the HAS may have discouraged consent. Patients who did not answer the question about income were, on multivariate analysis, significantly less likely to give consent.Locating the consent question at the end of the form may have contributed to nonresponse. Patients who did not give consent were, on multivariate analysis, less likely to have answered the preceding questions. Patients who did not answer tended to be older, more ill, and less educated and would be expected to proceed more slowly through a survey. Moreover, asking the consent question while patients waited for appointments might yield different answers than inquiring at a less stressful time. Finally, consent may have an independent association with visit frequency, an association we hope to analyze in future studies.The external validity of the study—the extent to which our findings can be extrapolated elsewhere—may be limited. Patients attending a family practice center in downtown Richmond, Va, a predominantly African American and low-income population, differ from patients in other settings. Moreover, much of the information that patients read in our fact sheet concerned our study and research network and would not apply when other researchers solicit consent. We would expect patients' willingness to offer consent and the characteristics of those who refuse to differ by setting.Yawn et al,for example, described a different profile for patients who denied consent. In their study, refusal was most common among women, persons aged 41 to 64 years, and patients visiting for mental illness, eye care, trauma, and gynecologic problems. Their patient population differed from ours. They also solicited consent differently. In addition to outpatient clinics, authorization was obtained at the emergency department and hospital. A receptionist or hospital registration clerk requested consent as part of normal registration. The form and accompanying material addressed only the use of medical records (with no mention of surveys) and gave patients greater reassurance that their anonymity would be protected.Despite these differences, both our study and the work by Yawn et al reached the same conclusion: patients who give consent differ in important characteristics from those who do not. We know of no other studies in the medical setting that have examined this bias. Studies in school settings have also shown that having to obtain parental consent to survey children leads to underrepresentation of at-risk youth.To the extent that this occurs in medicine, studies of the effectiveness and quality of care that require explicit consent could produce skewed results, potentially misleading clinicians, policymakers, and consumers.The net harms to society of requiring consent should be weighed against the benefits. If obtaining consent selectively omits data that mask a problem in women receiving timely mammograms, for example, then data privacy could come at the cost of higher breast cancer mortality. When this selection bias is extended across all studies for which written authorization might be required—public health surveillance, outcomes research, quality assurance—the potential grows for misjudgments of epidemiologic trends, risk rates, and the effectiveness and safety of tests and treatments. Some public health groups have warned about the harms to society from such data errors.Nonetheless, strong ethical arguments support the need for consent, at least for the release of personally identifiable data.Patients deserve to know when unauthorized individuals examine their medical records or have access to their address or other personal details. Electronic incursions into personal informationand violations of privacy by unauthorized entities (eg, employers,marketing firms) have heightened public sensitivity to this issue. Access to personal genetic information has raised further concerns about the need for consent, as illustrated by recent experience in Iceland.According to a Louis Harris poll, 27% of Americans believe that their medical records have been improperly disclosed, and 64% object to researchers gaining access without explicit consent.Strong public sentiment prompted federal action by Congressand the Clinton administration (privacy regulations on electronically transferred medical data,bioethics commission on human subjects research). As of 1999, 5 state legislatures had passed or were considering comprehensive health information statutes.Federal officials have recently terminated research at major academic centers, often because of privacy violations.The dilemma posed by the selection bias we observed reflects a tension between competing ethical duties: the rights of individuals to privacy and, conversely, of society to accurate monitoring of the effectiveness and safety of health care.Which duty should prevail is an ethicaland legal issueworthy of thoughtful discourse by providers, ethicists, researchers, policymakers, and patients. The first step is to confirm the existence of the selection bias. Further work by investigators in other research settings and with larger sample sizes will help elucidate this problem, its magnitude, and the extent to which it can be attenuated by better methods for obtaining consent.Since this article was accepted for publication, the Institute of Medicine published a report on protecting data privacy in health services research. The report warned that "the requirement of consent would likely lead to bias and invalid findings, because those who opt out might differ systematically from those giving consent."Our findings validate this concern.MSDonaldsonKNLohrHealth Data in the Information Age: Use, Disclosure, and Privacy.Washington, DC: National Academy Press; 1994.LJMelton IIIThe threat to medical-records research.N Engl J Med.1997;337:1466-1470.Not AvailableAccess to Health Records, Subdivision 3-Patient Consent to Release of Records.Minnesota Law 144.335. Effective 1/1/97.DBMcCarthyDShatinCRDrinkardJHKleinmanJSGardnerMedical records and privacy: empirical effects of legislation.Health Serv Res.1999;34(1, pt 2):417-425.BPYawnRAYawnGRGeierZXiaSJJacobsenThe impact of requiring patient authorization for use of data in medical records research.J Fam Pract.1998;47:361-365.SFRothemichSHWoolfREJohnsonDWMarslandEvaluating the administration of an office-based health survey in a primary care practice.J Clin Epidemiol.2000;53(10):1002-1012.Not AvailableFederal Policy for the Protection of Human Subjects (1994) (codified at 45 CFR §46.116(d)). 56.Federal Register 28003.(June 18, 1991).Not AvailableFederal Policy for the Protection of Human Subjects (1994) (codified at 45 CFR §46.117(c)2). 56Federal Register 28002,(June 18, 1991).Not AvailableInternational Classification of Diseases, Ninth Revision, Clinical Modification.Washington, DC: Public Health Service, US Dept of Health and Human Services; 1988.Not AvailableClinical Classification Software (CCS) Summary and Download: Summary and Downloading Information.Rockville, Md: Agency for Health Care Policy and Research. Available at: http://www.ahrq.gov/data/hcup/ccs.htm. Accessed February 5, 2000.BStarfieldJWeinerLMumfordDSteinwachsAmbulatory care groups: a categorization of diagnoses for research and management.Health Serv Res.1991;26:53-74.Not AvailableThe Johns Hopkins University ACG Case Mix Adjustment System: Documentation for PC-DOS and UNIX.Baltimore, Md: Johns Hopkins University School of Hygiene and Public Health, Health Services Research and Development Center; 1998. Further details available at: http://www.acg.jhsph.edu/. Accessed February 5, 2000.JEWare JrMKosinskiSDKellerSF-36 Physical & Mental Health Summary Scales: A User's Manual.Boston, Mass: Health Institute, New England Medical Center; 1994.JEWare JrMKosinskiMSBaylissCAMcHorneyWHRogersARaczekComparison of methods for the scoring and statistical analysis of SF-36 health profile and summary measures: summary of results from the Medical Outcomes Study.Med Care.1995;33(4 suppl):AS264-AS279.Not AvailableSAS Statistical Software[computer program].Cary, NC: SAS Institute Inc; 1996.DRCoxDVHinkleyTheoretical Statistics.New York, NY: Chapman & Hall Ltd; 1974.DFMorrisonMultivariate Statistical Methods.New York, NY: McGraw-Hill Inc; 1976.FAEsbensenMHMillerTJTaylorNHeAFrengDifferential attrition rates and active parental consent.Eval Rev.1999;23:316-335.American College of EpidemiologyStatement on Health Data Control, Access, and Confidentiality.Available at: http://www.acepidemiology.org/data.html. Accessed February 14, 2000.BWoodwardChallenges to human subject protections in US medical research.JAMA.1999;282:1947-1952.JHagel IIIJFRayportThe coming battle for customer information.Harv Bus Rev.1997;75:53-55, 58, 60-61.DMStuddertRAND Institute for Civil JusticeDirect contracts, data sharing and employee risk selection: new stakes for patient privacy in tomorrow's health insurance markets.Am J Law Med.1999;25:233-265.BLoAAlpersUses and abuses of prescription drug information in pharmacy benefits management programs.JAMA.2000;283:801-806.JRGulcherKStefanssonThe Icelandic Healthcare Database and informed consent.N Engl J Med.2000;342:1827-1830.GJAnnasRules for research on human genetic variation: lessons from Iceland.N Engl J Med.2000;342:1830-1833.Harris/EquifaxHealth Care Information Privacy: A Survey of the Public and Leaders.Conducted for Equifax. New York, NY: Louis Harris & Associates; 1993.Not AvailableHealth Insurance Portability and Accountability Act of 1996.§264[00a9](2), Pub L No. 104-191, 110 Stat 1936, 2033 (1996).Not AvailableStandards of Privacy of Individually Identifiable Health Information: Proposed Rule, 64.Federal Register 55918-60065(1999) (codified at 45 CFR §160164).Not AvailableExecutive Order 12975 of October 3, 1995.Available at: http://www.bioethics.gov/about/eo12975.htm. Accessed February 15, 2000.JGHodge JrLOGostinPDJacobsonLegal issues concerning electronic health information: privacy, quality, and liability.JAMA.1999;282:1466-14671.DFPhillipsIRBs search for answers and support during a time of institutional change.JAMA.2000;283:729-730.LGostinHealth care information and the protection of personal privacy: ethical and legal considerations.Ann Intern Med.1997;127:683-690.Institute of MedicineProtecting Data Privacy in Health Services Research: Committee on the Role of Institutional Review Boards in Health Services Research Data Privacy Protection.Washington, DC: National Academy Press; 2000.Accepted for publication August 9, 2000.This research was supported in part by a Robert Wood Johnson Generalist Physician Faculty Scholars Award to Dr Rothemich.Presented in part at the 27th Annual Meeting of the North American Primary Care Research Group, San Diego, Calif, November 10, 1999, and the 2000 Annual Meeting of the Association for Health Services Research, Los Angeles, Calif, June 26, 2000.We thank Barbara P. Yawn, MD, MSc, and Finn-Aage Esbensen PhD, MA, for their helpful contributions to the manuscript.Reprints: Steven H. Woolf, MD, MPH, Department of Family Practice, Medical College of Virginia, Virginia Commonwealth University, 3712 Charles Stewart Dr, Fairfax, VA 22033.

Journal

Archives of Family MedicineAmerican Medical Association

Published: Nov 1, 2000

There are no references for this article.