• Can staff and patient perspectives on hospital safety predict harm-free care? An analysis of staff and patient survey data and routinely collected outcomes

      Lawton, R.; O'Hara, J.K.; Sheard, L.; Reynolds, C.; Cocks, K.; Armitage, Gerry R.; Wright, J. (2015)
      Patients have the potential to provide feedback on the safety of their care. Recently, tools have been developed that ask patients to provide feedback on those factors that are known to contribute to safety, therefore providing information that can be used proactively to manage safety in hospitals. The aim of this study was to investigate whether the safety information provided by patients is different from that provided by staff and whether it is related to safety outcomes. Data were collected from 33 hospital wards across 3 acute hospital Trusts in the UK. Staff on these wards were asked to complete the four outcome measures of the Hospital Survey of Patient Safety Culture, while patients were asked to complete the Patient Measure of Safety and the friends and family test. We also collated publicly reported safety outcome data for 'harm-free care' on each ward. This patient safety thermometer measure is used in the UK NHS to record the percentage of patients on a single day of each month on every ward who have received harm-free care (i.e. no pressure ulcers, falls, urinary tract infections and hospital acquired new venous thromboembolisms). These data were used to address questions about the relationship between measures and the extent to which patient and staff perceptions of safety predict safety outcomes. The friends and family test, a single item measure of patient experience was associated with patients' perceptions of safety, but was not associated with safety outcomes. Staff responses to the patient safety culture survey were not significantly correlated with patient responses to the patient measure of safety, but both independently predicted safety outcomes. The regression models showed that staff perceptions (adjusted r(2)=0.39) and patient perceptions (adjusted r(2)=0.30) of safety independently predicted safety outcomes. When entered together both measures accounted for 49% of the variance in safety outcomes (adjusted r(2)=0.49), suggesting that there is overlap but some unique variance is also explained by these two measures. Based on responses to the Patient Measure of Safety it was also possible to identify differences between the acute Hospital Trusts. The findings suggest that although the views of patients and staff predict some overlapping variance in patient safety outcomes, both also offer a unique perspective on patient safety, contributing independently to the prediction of safety outcomes. These findings suggest that feedback from patients about the safety of the care that they receive can be used, in addition to data from staff to drive safety improvements in healthcare. TRIAL REGISTRATION NUMBER: ISRCTN07689702.
    • Developing a reliable and valid patient measure of safety in hospitals (PMOS): A validation study

      McEachan, Rosemary; Lawton, R.; O'Hara, J.K.; Armitage, Gerry R.; Giles, S.; Parveen, Sahdia; Watt, I.S.; Wright, J.; Yorkshire Quality and Safety Research Group (2014-07)
      Introduction Patients represent an important and as yet untapped source of information about the factors that contribute to the safety of their care. The aim of the current study is to test the reliability and validity of the Patient Measure of Safety (PMOS), a brief patient-completed questionnaire that allows hospitals to proactively identify areas of safety concern and vulnerability, and to intervene before incidents occur. Methods 297 patients from 11 hospital wards completed the PMOS questionnaire during their stay; 25 completed a second 1 week later. The Agency for Healthcare Research and Quality (AHRQ) safety culture survey was completed by 190 staff on 10 of these wards. Factor structure, internal reliability, test-retest reliability, discriminant validity and convergent validity were assessed. Results Factor analyses revealed 8 key domains of safety (eg, communication and team work, access to resources, staff roles and responsibilities) explaining 58% variance of the original questionnaire. Cronbach’s α (range 0.66–0.89) and test-retest reliability (r=0.75) were good. The PMOS positive index significantly correlated with staff reported ‘perceptions of patient safety’ (r=0.79) and ‘patient safety grade’ (r=−0.81) outcomes from the AHRQ (demonstrating convergent validity). A multivariate analysis of variance (MAMOVA) revealed that three PMOS factors and one retained single item discriminated significantly across the 11 wards. Discussion The PMOS is the first patient questionnaire used to assess factors contributing to safety in hospital settings from a patient perspective. It has demonstrated acceptable reliability and validity. Such information is useful to help hospitals/units proactively improve the safety of their care.
    • Evaluating the PRASE patient safety intervention - a multi-centre, cluster trial with a qualitative process evaluation: study protocol for a randomised controlled trial.

      Sheard, L.; O'Hara, J.K.; Armitage, Gerry R.; Wright, J.; Cocks, K.; McEachan, Rosemary; Watt, I.S.; Lawton, R. (2014-10-29)
      Background Estimates show that as many as one in 10 patients are harmed while receiving hospital care. Previous strategies to improve safety have focused on developing incident reporting systems and changing systems of care and professional behaviour, with little involvement of patients. The need to engage with patients about the quality and safety of their care has never been more evident with recent high profile reviews of poor hospital care all emphasising the need to develop and support better systems for capturing and responding to the patient perspective on their care. Over the past 3 years, our research team have developed, tested and refined the PRASE (Patient Reporting and Action for a Safe Environment) intervention, which gains patient feedback about quality and safety on hospital wards. Methods/design A multi-centre, cluster, wait list design, randomised controlled trial with an embedded qualitative process evaluation. The aim is to assess the efficacy of the PRASE intervention, in achieving patient safety improvements over a 12-month period. The trial will take place across 32 hospital wards in three NHS Hospital Trusts in the North of England. The PRASE intervention comprises two tools: (1) a 44-item questionnaire which asks patients about safety concerns and issues; and (2) a proforma for patients to report (a) any specific patient safety incidents they have been involved in or witnessed and (b) any positive experiences. These two tools then provide data which are fed back to wards in a structured feedback report. Using this report, ward staff are asked to hold action planning meetings (APMs) in order to action plan, then implement their plans in line with the issues raised by patients in order to improve patient safety and the patient experience. The trial will be subjected to a rigorous qualitative process evaluation which will enable interpretation of the trial results. Methods: fieldworker diaries, ethnographic observation of APMs, structured interviews with APM lead and collection of key data about intervention wards. Intervention fidelity will be assessed primarily by adherence to the intervention via scoring based on an adapted framework. Discussion This study will be one of the largest patient safety trials ever conducted, involving 32 hospital wards. The results will further understanding about how patient feedback on the safety of care can be used to improve safety at a ward level. Incorporating the ‘patient voice’ is critical if patient feedback is to be situated as an integral part of patient safety improvements.
    • A qualitative formative evaluation of a patient centered patient safety intervention delivered in collaboration with hospital volunteers

      Louch, G.; O'Hara, J.K.; Mohammed, Mohammed A. (2017-10)
      Background: Evidence suggests that patients can meaningfully feed back to healthcare providers about the safety of their care. The PRASE (Patient Reporting and Action for a Safe Environment) intervention provides a way to systematically collect feedback from patients to support service improvement. The intervention is being implemented in acute care settings with patient feedback collected by hospital volunteers for the first time. Objective: To undertake a formative evaluation which explores the feasibility and acceptability of the PRASE intervention delivered in collaboration with hospital volunteers from the perspectives of key stakeholders. Design: A qualitative evaluation design was adopted across two acute NHS Trusts in the UK between July 2014 and November 2015. We conducted five focus groups with hospital volunteers (n = 15), voluntary services and patient experience staff (n = 3) and semistructured interviews with ward staff (n = 5). Data were interpreted using framework analysis. Results: All stakeholders were positive about the PRASE intervention as a way to support service improvement, and the benefits of involving volunteers. Volunteers felt adequate training and support would be essential for retention. Staff concentrated on the infrastructure needed for implementation and raised concerns around sustainability. Findings were fed back to the implementation team to support revisions to the intervention moving into the subsequent summative evaluation phase. Conclusion: Although there are concerns regarding sustainability in practice, the PRASE intervention delivered in collaboration with hospital volunteers is a promising approach to collect patient feedback for service improvement.