Patient-reported outcome (PRO) measurement plays an increasingly important role in health care and understanding health outcomes. PROs are any report of a patient's health status that comes directly from the patient, and can measure patient symptoms, patient function, and quality-of-life. PROs have been used successfully to assess impairment in a clinical setting. Use of PROs to systematically quantify the patient experience provides valuable data to assist with clinical care; however, initiating use of PROs in clinical practice can be daunting. Here we provide suggestions for implementation of PROs and examples of opportunities to use PROs to tailor individual patient therapy to improve patient outcomes, patient–physician communication, and the quality of care for hematology/oncology patients.

Learning Objectives
  • To understand the utility of patient-reported outcome measures in clinical practice

  • To develop strategies for implementation of PROs into clinical practice

Patient-reported outcome (PRO) measurement plays an increasingly important role in health care and understanding health outcomes. PROs are any report of a patient's health status that comes directly from the patient. PROs inform clinicians and researchers about issues associated with health status that are most important to patients and their families, and generate data to facilitate improved care of the patient. Given these benefits, governing agencies have recommended assessing PROs in health care as evident by the FDA's PRO guidance publications1  for the drug industry and the NIH's Patient-Reported Outcome Measurement Information System (PROMIS) initiative.2 

PRO measures provide composite scores from a series of questions around a central concept to quantify the level of distress or impairment caused by a patient's symptoms, disease, or treatment. A variety of PROs have been developed and validated to assess symptoms (such as nausea and vomiting, insomnia, constipation, and pain), patient physical, social, and emotional function, and more complex constructs such as impact of health on peer relationships. There are generic and disease-specific PROs that can be used to measure these outcomes, as well as available measures for use in pediatric and adult patients. See Table 1 for commonly used PROs.

Table 1.

Commonly used PROs in cancer care

Commonly used PROs in cancer care
Commonly used PROs in cancer care

Adults and children with cancer commonly experience symptoms that lead to impaired physical function, emotional function, and social function resulting in decreased health status.3-7  Patient symptoms often go undetected during typical clinic interviews, and clinicians may underestimate the impact of symptoms from interview alone.8-10  The impact of cancer and cancer treatment on patient health status can be systematically quantified using PRO measures in children and adults.5,11,12  Use of PROs in these populations has identified symptoms and impairments in patient function. Most patients receiving treatment experience decreased health status13,14 ; however, cancer patients with better symptom management and better PROs live longer with less distress.15-17  PROs generate data that can facilitate better care regardless of diagnosis or prognosis for cancer patients.

PRO measures are recognized tools that can be used to assess impairment in a clinical setting.9,18-21  Multiple studies confirm that clinical integration of PROs does not increase the duration of clinic visits, that provider and patient satisfaction is high, and that all parties feel their use improves communication.12,19,20,22-24 

The successful use of PROs in outpatient orthopedic surgery clinics highlights the feasibility of use in busy outpatient settings and the benefit in clinical decision making. Orthopedic clinics have integrated PRO collection into clinical practice to monitor patient pain, mobility, and function. These data are used to monitor improvement or deterioration in function related to the condition, assess response to nonsurgical interventions, and assist with decision making regarding elective surgical interventions for knee, hip, or back problems.21,25 

Several randomized trials have examined the impact of clinical use of PROs on patient–physician communication in adult oncology patients. In these studies, providers were randomized to receive PRO data compared with control groups who did not receive PRO data prior to clinic visits. Salient issues related to PROs, such as psychosocial issues and symptoms were more likely to be discussed for visits where the clinical team received the summary.12,19,20  Some patients experienced better functioning as a result of the intervention.12  Similar work in children with advanced cancer and pediatric cancer survivors has demonstrated that providing PRO data to clinicians increased discussion of psychosocial issues and improved the patient's health status in certain subpopulations (see Example 1).23,24,26 

Use of EMRs in the United States is required for public and private healthcare providers to maintain Medicaid and Medicare reimbursement. Integration of PROs into EMR is a vital step toward improving accessibility and user-friendliness of PROs in clinical and research settings.27  To illustrate the benefit of PRO integration into EMRs, we will highlight one large EMR, Epic. The next version of Epic will contain functionality to collect PROs and integrate PRO data into the EMRs. Patients whose healthcare providers use Epic can sign up for MyChart, an electronic portal that allows patients to view laboratory and imaging reports, schedule appointments, and communicate non-urgent issues with their providers. Certain existing PROs have been integrated with the MyChart system, with the ability to create additional disease- or clinic-specific PROs. Providers can identify which PROs they would like patients to complete and send them secure email notifications via the MyChart portal. Once complete, the PROs integrate within the Epic EMR and can be viewed alongside other clinical data by the provider. Providers have the ability to visually examine the impact of interventions on PRO scores to understand the impact of care decisions from the patient's perspective (Figure 1).28 

Figure 1.

Conceptual framework for PRO integration in clinical care.

Figure 1.

Conceptual framework for PRO integration in clinical care.

Close modal

Use of PROs in clinical practice is not limited to practitioners who use EPIC or whose systems have already integrated PROs into their EMRs. A practical work-around for lack of PRO integration into the EMRs is collection of electronic PROs using RedCap. RedCap is an electronic data management system that currently has functionality to collect a variety of PROs, including a wide variety of generic and disease-specific instruments for pediatric and adult patients. The full list of available instruments can be found at http://project-redcap.org. Custom PROs can be built into RedCap to meet the specific needs of the users.

The majority of work integrating electronic PRO collection into the clinical setting has been done in adult patient care settings. A pilot study in pediatric sickle cell, oncology, and bone marrow transplant patients confirmed the feasibility of obtaining electronic PROs in the pediatric clinic setting.29  Electronic PROs were captured on tablets in the clinic waiting room and the results of the PROs were provided to the clinicians during the visit. Cincinnati Children's Hospital has adopted a tablet and kiosk-based system to collect PROs in their outpatient clinics under an initiative to improve quality of care, demonstrating feasibility within a large pediatric healthcare system and diverse patient populations.28 

The ultimate goal of health care is to restore or preserve functioning and well-being related to health.30  Achieving this goal in hematology/oncology care is challenging because many distressing symptoms are subjective in nature. Use of PROs to systematically quantify the patient experience provides valuable data to assist with clinical decision making.31,32  The National Comprehensive Cancer Network acknowledges that symptoms, such as fatigue and pain are “a subjective experience that should be systematically assessed using patient self-reports” (www.nccn.org). However, operationalization of this process can be cumbersome and prohibitive to clinical practices. Table 2 highlights healthcare systems that have successfully integrated PROs into practice by utilizing the power of electronic PROs integrated into EHR to tailor care for individuals. Here we provide several additional examples of clinical use of PROs.

Table 2.

Examples of PRO use in health care

Examples of PRO use in health care
Examples of PRO use in health care

Example 1.

Patients seen in clinic for routine care complete PROs measuring commonly experienced symptoms (eg, pain, fatigue, nausea/vomiting, insomnia, anxiety, depressive symptoms, and impaired physical mobility). PRO scores and trends over time are available for review at interdisciplinary patient staffing meetings. Providers can review PRO scores and discuss interventions. For example, the case of a patient receiving therapy for Hodgkin lymphoma is reviewed monthly at a staffing meeting that includes the program nurse coordinator, advanced practice provider, physician, social worker, and psychologist. Review of her case reveals that she is continuing along her prescribed treatment course without incident and she seemed well at her last visit. Review of her PRO scores demonstrate worsening depressive symptoms as she moves farther into her chemotherapy course. Additionally, her physical function is worsening as she progresses through treatment (Figure 2). This information triggers an additional clinic visit to thoroughly assess these symptoms and to create action plans including engagement of the psychology and physical therapy teams in her care and assessment of her ability to care for herself at home.

Figure 2.

Hypothetical PRO data output for review at patient staffing.

Figure 2.

Hypothetical PRO data output for review at patient staffing.

Close modal

Example 2.

Patients followed for management of sickle cell disease are seen annually in a comprehensive clinic (interdisciplinary clinic involving the nurse coordinator, physician, advanced practice provider, social work, psychology, physical therapy, and genetic counselor) and every 2-3 months for management of hydroxyurea therapy. Patients complete a full battery of PROs at the annual comprehensive clinic visit (includes measurement of a wide variety of symptoms, physical, social, emotional function, and global quality-of-life) and a smaller battery of disease-specific PROs at each hydroxyurea clinic (pain, fatigue). The comprehensive battery provides a more complete and longitudinal view of the patient's health status and impact of disease over time, whereas the disease-specific symptom-directed PROs collected at hydroxyurea visits provide targeted information regarding patient symptoms over time. For example, a teenage boy with Hg SS disease is seen in comprehensive sickle cell clinic for his first visit after moving from another state. PROs collected at this visit indicate that he has significant difficulty with pain and fatigue causing him to miss significant time at school. This is in turn impacting his social relationships and his mood. The clinical team initiates hydroxyurea therapy and the team psychologist begins to work with the patient. He is followed every 2-3 months over the upcoming year. PROs quantifying pain and fatigue begin to improve after several months of hydroxyurea treatment. The comprehensive battery at his next annual visit indicate continued difficulty but improved pain and global quality-of-life, improving school attendance, and improving peer relationships. He continues to work with the team psychologist for management of depressive symptoms and strategies to deal with his pain.

Quality improvement examines processes in order to improve them. It consists of systematic and continuous actions that lead to measurable improvement in health care services and the health status of targeted patient groups. The Institute of Medicine defines quality in health care as a direct correlation between the level of improved health services and the desired health outcomes of individuals and populations.36  Using PROs to understand these desired health outcomes provides valuable measures to gauge quality of certain aspects of care. Table 2 highlights several applications of PRO data in quality improvement.

Performance improvement addresses human performance within organizations at the individual, process, and organizational levels. The use of PROs as performance measures in hematology/oncology has been endorsed by the National Quality Forum and the International Society for Quality of Life Research and recommendations for the process have been described.35  This application of PROs is currently in its infancy, an example of PRO use for this purpose is detailed in table 2.

Implementation of PROs presents challenges to healthcare providers and systems, however, solutions exist to overcome barriers and successfully use PROs in clinical practice. As mentioned previously, PRO use is not limited to healthcare providers whose EMR has integrated PROs. Electronic data capture of PROs is possible using several different platforms and can be worked into clinical workflows accordingly.

The manner by which PROs are collected (eg, EMR before clinic visit versus PRO collection at clinic visit via RedCap) will influence the setting in which data is reviewed by the clinical team as well as how PRO data is reviewed with the patient. When PRO results are available to providers prior to a patient visit, it is ideal to review the data with the patient and use the information for shared medical decision making in real time. When PROs are available for review after the patient encounter, decision making around an issue is likely to happen over the telephone, in person at an additional clinic visit specifically to address the concern, or at the next scheduled visit depending on the clinical scenario. The decision to have real-time PRO data available for a scheduled clinic visit or to review these data post-visit depends largely on the ability of the health care system to support the collection and scoring of the data in a timely manner and for the health care team to be educated in interpreting the results.

An additional barrier to successful integration of PROs to support clinical practice is determining which PROs to collect from patients and at what time intervals. The International Society for Quality of Life Research has published a user's guide to help aid clinicians who want to implement PRO measurement into their practices.33  Consensus recommendations for PRO inclusion in adult cancer clinical trials recommend measurement of health-related quality-of-life and commonly experienced symptoms (anorexia, anxiety, constipation, depression, diarrhea, dyspnea, fatigue, insomnia, nausea, pain, neuropathy, and vomiting).34,35  It is reasonable to choose from this battery of PROs and tailor to the needs of the individual patient population, considering which elements are most applicable in any given clinical setting. To limit patient burden and increase completion rates, consider soliciting a full battery of measures initially and at longer intervals as demonstrated in Example 2 (eg, annual completion of global HRQL measure, pain, fatigue, nausea/vomiting, social function, and sexual function), with more frequent assessment of most salient measures of symptoms for which clinicians are able to intervene or may inform management decisions (eg, monthly or quarterly assessment of pain, fatigue, and nausea/vomiting).

Feasibility and process issues in individual clinics are best addressed by implementation of PROs first in a limited patient population as well as with a limited number of healthcare providers. This allows for rapid process evaluation and improvement cycles from both the patient and provider perspective prior to widespread implementation. Lastly, support from key stakeholder groups including administrators, healthcare providers, ancillary staff, IT personnel, and patient advocates is key to successful implementation of PROs in clinical practice.

Summary

Integration of PROs into clinical care is a vital step toward individualizing patient care and making care truly patient-centered. Keys to successful integration of PROs into clinical care include: (1) buy-in of administrative leaders, clinicians, and patients; (2) customization of PRO measures to meet goals and needs of each clinical practice; and (3) electronic capture of PRO data.

Julie Panepinto, Pediatric Hematology/Oncology, Medical College of Wisconsin/Children's Research Institute of the Children's Hospital of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226; Phone: 414-456-4170; Fax: 414-955-6543; e-mail: [email protected].

1
Guidance for Industry and FDA Staff Qualification Process for Drug Development Tools
U.S. Department of Health and Human Services Center for Drug Evaluation and Research 2014
Accessed September 25, 2015 
2
Cella
 
D
Yount
 
S
Rothrock
 
N
Gershon
 
R
Cook
 
K
Reeve
 
B
et al. 
The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years
Med Care
2007
, vol. 
45
 
5 Suppl 1
(pg. 
S3
-
S11
)
3
Fisch
 
MJ
Lee
 
JW
Weiss
 
M
Wagner
 
LI
Chang
 
VT
Cella
 
D
et al. 
Prospective, observational study of pain and analgesic prescribing in medical oncology outpatients with breast, colorectal, lung, or prostate cancer
J Clin Oncol
2012
, vol. 
30
 
16
(pg. 
1980
-
1988
)
4
Gold
 
JI
Douglas
 
MK
Thomas
 
ML
Elliott
 
JE
Rao
 
SM
Miaskowski
 
C
The relationship between posttraumatic stress disorder, mood states, functional status, and quality of life in oncology outpatients
J Pain Symptom Manage
2012
, vol. 
44
 
4
(pg. 
520
-
31
)
5
Fakhry
 
H
Goldenberg
 
M
Sayer
 
G
Aye
 
SS
Bagot
 
K
Pi
 
S
et al. 
Health-related quality of life in childhood cancer
J Dev Behav Pediatr
2013
, vol. 
34
 
6
(pg. 
419
-
440
)
6
Buckner
 
TW
Wang
 
J
DeWalt
 
DA
Jacobs
 
S
Reeve
 
BB
Hinds
 
PS
Patterns of symptoms and functional impairments in children with cancer
Pediatr Blood Cancer
2014
, vol. 
61
 
7
(pg. 
1282
-
1288
)
7
LeBlanc
 
TW
Nickolich
 
M
Rushing
 
CN
Samsa
 
GP
Locke
 
SC
Abernethy
 
AP
What bothers lung cancer patients the most? A prospective, longitudinal electronic patient-reported outcomes study in advanced non-small cell lung cancer
Support Care Cancer
 
Prepublished on March 21, 2015, as DOI 10.1007/s00520-015-2699-4
8
Basch
 
E
The missing voice of patients in drug-safety reporting
N Engl J Med
2010
, vol. 
362
 
10
(pg. 
865
-
869
)
9
Basch
 
E AA
Supporting clinical practice decisions with real-time patient-reported outcomes
J Clin Oncol
2011
, vol. 
29
 (pg. 
954
-
956
)
10
Pakhomov
 
S
Jacobsen
 
SJ
Chute
 
CG
Roger
 
VL
Agreement between patient-reported symptoms and their documentation in the medical record
Am J Manag Care
2008
, vol. 
14
 
8
(pg. 
530
-
9
)
11
Montazeri
 
A
Health-related quality of life in breast cancer patients: a bibliographic review of the literature from 1974 to 2007
J Exp Clin Cancer Res
2008
, vol. 
27
 pg. 
32
 
12
Velikova
 
G
Booth
 
L
Smith
 
AB
Brown
 
PM
Lynch
 
P
Brown
 
JM
et al. 
Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial
J Clin Oncol
2004
, vol. 
22
 
4
(pg. 
714
-
724
)
13
Eiser
 
C
E
 
J
Stride
 
CB
Quality of life in children newly diagnosed with cancer and their mothers
Health Qual Life Outcomes
2005
, vol. 
3
 pg. 
29
 
14
Varni
 
JW
L
 
C
Burwinkle
 
TM
Literature review: health-related quality of life measurement in pediatric oncology: hearing the voices of the children
J Pediatr Psychol
2007
, vol. 
32
 
9
(pg. 
1151
-
1163
)
15
Temel
 
JS
Greer
 
JA
Muzikansky
 
A
Gallagher
 
ER
Admane
 
S
Jackson
 
VA
et al. 
Early palliative care for patients with metastatic non-small-cell lung cancer
N Engl J Med
2010
, vol. 
363
 
8
(pg. 
733
-
742
)
16
Taylor
 
DH
Bull
 
J
Zhong
 
X
Samsa
 
G
Abernethy
 
AP
The effect of palliative care on patient functioning
J Palliat Med
2013
, vol. 
16
 
10
(pg. 
1227
-
1231
)
17
Montazeri
 
A
Quality of life data as prognostic indicators of survival in cancer patients: an overview of the literature from 1982 to 2008
Health Qual Life Outcomes
2009
, vol. 
7
 pg. 
102
 
18
Macefield
 
RC
A
 
K
Blazeby
 
JM
Integration of clinical and patient-reported outcomes in surgical oncology
Br J Surg
2013
, vol. 
100
 (pg. 
28
-
37
)
19
Detmar
 
S
M
 
M
Schornagel
 
JH
Wever
 
LDV
Aaronson
 
NK
Health-related quality-of-life assessments and patient-physician communication
JAMA
2002
, vol. 
288
 (pg. 
3027
-
3034
)
20
Berry
 
DL
B
 
B
Halpenny
 
B
Wolpin
 
S
et al. 
Enhancing patient-provider communication with the electronic self-report assessment for cancer: a randomized trial
J Clin Oncol
2011
, vol. 
29
 
8
(pg. 
1029
-
1035
)
21
Ayers
 
DC
Zheng
 
H
Franklin
 
PD
Integrating patient-reported outcomes into orthopaedic clinical practice: proof of concept from FORCE-TJR
Clin Orthop Relat Res
2013
, vol. 
471
 
11
(pg. 
3419
-
3425
)
22
Engelen
 
V
Zwieten
 
Mv
Koopman
 
H
Detmar
 
S
Caron
 
H
Brons
 
P
et al. 
The influence of patient reported outcomes on the discussion of psychosocial issues in children with cancer
Pediatric Blood Cancer
2012
, vol. 
59
 (pg. 
161
-
166
)
23
Engelen
 
V
Detmar
 
S
Koopman
 
H
Maurice-Stam
 
H
Caron
 
H
Hoogerbrugge
 
P
et al. 
Reporting health-related quality of life scores to physicians during routine follow-up visits of pediatric oncology patients: is it effective?
Pediatr Blood Cancer
2012
, vol. 
58
 
5
(pg. 
766
-
774
)
24
Wolfe
 
J
Orellana
 
L
Cook
 
EF
Ullrich
 
C
Kang
 
T
Geyer
 
JR
et al. 
Improving the care of children with advanced cancer by using an electronic patient-reported feedback intervention: results from the PediQUEST randomized controlled trial
J Clin Oncol
2014
, vol. 
32
 
11
(pg. 
1119
-
1126
)
25
Nelson
 
EC
Hvitfeldt
 
H
Reid
 
R
Grossman
 
D
Lindblad
 
S
Mastanduno
 
MP
et al. 
Using Patient-Reported Information to Improve Health Outcomes and Health Care Value: Case Studies from Dartmouth, Karolinksa, and Group Health
2012
Accessed September 25, 2015
Lebanon, NH
The Dartmouth Institute for Health Policy and Clinical Practive, Center for Population Health
 
26
Engelen
 
V
Koopman
 
HM
Detmar
 
SB
Raat
 
H
van de Wetering
 
MD
Brons
 
P
et al. 
Health-related quality of life after completion of successful treatment for childhood cancer
Pediatr Blood Cancer
2011
, vol. 
56
 
4
(pg. 
646
-
653
)
27
Wu
 
AW
Kharrazi
 
H
Boulware
 
LE
Snyder
 
CF
Measure once, cut twice–adding patient-reported outcome measures to the electronic health record for comparative effectiveness research
J Clin Epidemiol
2013
, vol. 
66
 
8 Suppl
(pg. 
S12
-
20
)
28
Wu
 
AW
Jensen
 
RE
Salzberg
 
C
Snyder
 
C
Advances in the Use of Patient Reported Outcome Measures in Electronic Health Records
2013
Accessed September 25, 2015
Baltimore, Maryland
Center for Health Services and Outcomes Research, Johns Hopkins Bloomberg School of Public Health
 
29
Myrvik
 
MP
Beverung
 
LM
Panepinto
 
JA
Igler
 
EC
Englebert
 
N
Bingen
 
KM
Integration of electronic patient-reported outcomes (ePROs) into pediatric clinic settings across hematoloyg/oncology/bone marrow transplant
Clin Practice Pedtr Psychol
2014
, vol. 
2
 
1
(pg. 
39
-
49
)
30
Osoba
 
D
King
 
M
Fayers
 
P
Hays
 
RD
Meaningful differences
Assessing Quality of Life in Clinical Trials
2005
New York
Oxford Press
(pg. 
244
-
257
)
31
Rumsfeld
 
JS
Health status and clinical practice: when will they meet?
Circulation
2002
, vol. 
106
 
1
(pg. 
5
-
7
)
32
Snyder
 
CF
Aaronson
 
NK
Use of patient-reported outcomes in clinical practice
Lancet
2009
, vol. 
374
 
9687
(pg. 
369
-
370
)
33
Aaronson
 
NK
Elliott
 
T
Greenhalgh
 
J
Halyard
 
M
Hess
 
R
Miller
 
DR
et al. 
User's Guide to Implementing Patient-Reported Outcomes Assessment in Clinical Practice
International Society for Quality of Life Research
2015
Accessed September 25, 2015 
34
Basch
 
E
Abernethy
 
AP
Mullins
 
CD
Reeve
 
BB
Smith
 
ML
Coons
 
SJ
et al. 
Recommendations for incorporating patient-reported outcomes into clinical comparative effectiveness research in adult oncology
J Clin Oncol
2012
, vol. 
30
 
34
(pg. 
4249
-
4255
)
35
Basch
 
E
Snyder
 
C
McNiff
 
K
Brown
 
R
Maddux
 
S
Smith
 
ML
et al. 
Patient-reported outcome performance measures in oncology
J Oncol Pract
2014
, vol. 
10
 
3
(pg. 
209
-
211
)
36
Insitute of Medicine, Quality and Patient Safety
Accessed September 25, 2015 
37
Abernethy
 
AP
Ahmad
 
A
Zafar
 
SY
Wheeler
 
JL
Reese
 
JB
Lyerly
 
HK
Electronic patient-reported data capture as a foundation of rapid learning cancer care
Med Care
2010
, vol. 
48
 
6 Suppl
(pg. 
S32
-
S38
)
38
Abernethy
 
AP
Zafar
 
SY
Uronis
 
H
Wheeler
 
JL
Coan
 
A
Rowe
 
K
et al. 
Validation of the Patient Care Monitor (Version 2.0): a review of system assessment instrument for cancer patients
J Pain Symptom Manage
2010
, vol. 
40
 
4
(pg. 
545
-
558
)
39
Eton
 
DT
Beebe
 
TJ
Hagen
 
PT
et al. 
Harmonizing and consolidating the measurement of patient-reported outcomes at healthcare institutions: a position statement of the Mayo Clinic
Patient Relat Outcome Meas
2014
, vol. 
5
 (pg. 
7
-
15
)
40
MN Community Measurement; Measure Up to Better Health
Accessed September 25, 2015 

Competing Interests

Conflict-of-interest disclosures: S.D. declares no competing financial interests; J.P. has received research funding from HRSA and NIH and has consulted for NKT Therapeutics.

Author notes

Off-label drug use: None disclosed.