Results from the WPHP Client Exit Survey:
What Graduating Participants are Really Saying on the Way Out the Door
FSPHP Annual Meeting San Diego, CA April 28, 2016 Chris Bundy, MD MPH Medical Director (Current)
Charles Meredith, MD Medical Director (Former)
Washington Physicians Health Program
Washington Physicians Health Program Assistant Clinical Professor Dept of Psychiatry, UWSOM
Assistant Clinical Professor Dept of Psychiatry, UWSOM
President Washington State Psychiatric Association
Dislosures No conflicts to report
Learning Objectives
Using WPHP’s exit survey experience as a reference:
Describe how exit surveys might benefit your program (the goal to be achieved) Discuss the variables your program might measure to attain those goals List some limitations of exit surveys Analyze barriers to conducting exit surveys in your organization
3
WPHP Goals
Quality improvement
Marketing and outreach
Stakeholder accountability
Others…
What We Measured
Participant Characteristics
Participant Outcomes
Participant Satisfaction
How We Measured
23 item questionnaire plus sub-items (43 items total) Anonymous via electronic survey Consecutive SUD/DXM program completers at exit appointment beginning in early 2015 Data summarized for analysis n=22/38 program discharges to date (yep we missed a few during implementation)
What We Found…
Demogaphy Gender: 73% male, 27% female Average age (SD): 50 (12) Monitored for 5+ years 67% 91% voluntary
How were you referred to WPHP? [CATEGORY NAME] [PERCENTAGE]
[CATEGORY NAME] [PERCENTAGE]
[CATEGORY NAME] [PERCENTAGE]
[CATEGORY NAME] [PERCENTAGE]
[CATEGORY NAME] [PERCENTAGE]
[CATEGORY NAME][CATEGORY NAME] [PERCENTAGE] [PERCENTAGE]
[CATEGORY NAME] [PERCENTAGE]
Self-reported impact of WPHP involvement…
40% improved charting, received fewer complaints and reduced errors at work 45% decreased absenteeism 50% decreased marital conflict 55% better boundaries at work 75% better satisfaction, less irritability, less stress at work 80% less burnout, improved relationships, less anxious at work 85% less stressful personal life, improved health overall 90% better work/life balance, improved lifestyle choices
In general, how would you describe your health?
Regarding your most recent monitoring experience with WPHP, how would you describe your experience with the initial contact with or referral to WPHP?
How would you describe the initial evaluation by a formal assessment program or treatment center?
How would you describe your experience undergoing treatment for substance use disorder?
n=1
63%
How would you describe your experience with non-WPHP peersupport meetings? (Examples: 12-step based meetings, Rational Recovery, Smart Recovery, Women in Recover, or others)
Wow
79%
Do you consider yourself to be “in recovery” now?
How would you describe your experience signing a monitoring agreement with WPHP?
84%
How would you rate your experience with random alcohol and drug testing?
How would you describe your experience with WPHP facilitated group meetings?
90%
How would you rate your experience with workplace monitoring?
Do you feel you were treated with courtesy and respect by WPHP staff?
Please rate the WPHP staff:
Overall, how useful was your WPHP experience?
95% 90%
Limitations Only measures the “success stories” Subjective self-report and bias Cohort effects Descriptive, univariate analysis The ship has sailed
Challenges/Barriers Resources Expertise Opportunity costs Organizational will/complacency Implementation and change management Analysis Paralysis Implications of what you might find
What Next?
Continue data collection? Improve the instrument? QI project? Discontinue?
Summary
Exit surveys demonstrate a commitment to accountability, consistency, and excellence The data generated can be used to highlight program strengths, defend against unsubstantiated criticisms, and identify opportunities for improvement Collaboration between PHP’s can help overcome challenges and limitations
THANK YOU! Chris Bundy, MD, MPH
[email protected] 800-552-7236 Charles Meredith, MD