Developing a reliable and valid patient measure of safety in hospitals (PMOS): A validation study
Publication date
2014-07Author
McEachan, RosemaryLawton, R.
O'Hara, J.K.
Armitage, Gerry R.
Giles, S.
Parveen, Sahdia
Watt, I.S.
Wright, J.
Yorkshire Quality and Safety Research Group
Peer-Reviewed
Yes
Metadata
Show full item recordAbstract
Introduction Patients represent an important and as yet untapped source of information about the factors that contribute to the safety of their care. The aim of the current study is to test the reliability and validity of the Patient Measure of Safety (PMOS), a brief patient-completed questionnaire that allows hospitals to proactively identify areas of safety concern and vulnerability, and to intervene before incidents occur. Methods 297 patients from 11 hospital wards completed the PMOS questionnaire during their stay; 25 completed a second 1 week later. The Agency for Healthcare Research and Quality (AHRQ) safety culture survey was completed by 190 staff on 10 of these wards. Factor structure, internal reliability, test-retest reliability, discriminant validity and convergent validity were assessed. Results Factor analyses revealed 8 key domains of safety (eg, communication and team work, access to resources, staff roles and responsibilities) explaining 58% variance of the original questionnaire. Cronbach’s α (range 0.66–0.89) and test-retest reliability (r=0.75) were good. The PMOS positive index significantly correlated with staff reported ‘perceptions of patient safety’ (r=0.79) and ‘patient safety grade’ (r=−0.81) outcomes from the AHRQ (demonstrating convergent validity). A multivariate analysis of variance (MAMOVA) revealed that three PMOS factors and one retained single item discriminated significantly across the 11 wards. Discussion The PMOS is the first patient questionnaire used to assess factors contributing to safety in hospital settings from a patient perspective. It has demonstrated acceptable reliability and validity. Such information is useful to help hospitals/units proactively improve the safety of their care.Version
No full-text in the repositoryCitation
McEachan R, Lawton RJ, O’Hara JK et al (2014) Developing a reliable and valid patient measure of safety in hospitals (PMOS): A validation study. British Medical Journal Quality and Safety. 23 (7): 565-73.Link to Version of Record
https://doi.org/10.1136/bmjqs-2013-002312Type
Articleae974a485f413a2113503eed53cd6c53
https://doi.org/10.1136/bmjqs-2013-002312
Scopus Count
Collections
Related items
Showing items related by title, author, creator and subject.
-
A safety analysis of industrial accidents. Accident records of major coal producing countries are analysed to obtain fatal and non-fatal accident rates. Significant factors influencing these rates are identified with efficacy of preventive measures.Keller, Alf; Habibi, Ehsanollah (University of BradfordDepartment of Industrial Technology, 2010-02-12)A comprehensive study of accident records which have occured in Coal Mining Industries of Europe and U. S. A are analysed. The intention of the research was to establish relationships between the various accidents and prevention methods adopted by each country are evaluated and to assess the impact of industrial legislation in these various countries on accident rate are examined. The study analyses in paricular the fatal accident rate, and major and minor rate. The Major health hazards associated with coal mining are described in detail and discusses together with the Measurement of safety performance and its application in the Safety field. The study also examines the role of human factors in accidents also includes a summaries of fatal and major injury rates for 46 countries. Arising from the research a number of recommendations for improving safety are requires further research are indentified.
-
Evaluating the PRASE patient safety intervention - a multi-centre, cluster trial with a qualitative process evaluation: study protocol for a randomised controlled trialSheard, L.; O'Hara, J.K.; Armitage, Gerry R.; Wright, J.; Cocks, K.; McEachan, Rosemary; Watt, I.S.; Lawton, R. (2014-10-29)Estimates show that as many as one in 10 patients are harmed while receiving hospital care. Previous strategies to improve safety have focused on developing incident reporting systems and changing systems of care and professional behaviour, with little involvement of patients. The need to engage with patients about the quality and safety of their care has never been more evident with recent high profile reviews of poor hospital care all emphasising the need to develop and support better systems for capturing and responding to the patient perspective on their care. Over the past 3 years, our research team have developed, tested and refined the PRASE (Patient Reporting and Action for a Safe Environment) intervention, which gains patient feedback about quality and safety on hospital wards. Methods/design A multi-centre, cluster, wait list design, randomised controlled trial with an embedded qualitative process evaluation. The aim is to assess the efficacy of the PRASE intervention, in achieving patient safety improvements over a 12-month period. The trial will take place across 32 hospital wards in three NHS Hospital Trusts in the North of England. The PRASE intervention comprises two tools: (1) a 44-item questionnaire which asks patients about safety concerns and issues; and (2) a proforma for patients to report (a) any specific patient safety incidents they have been involved in or witnessed and (b) any positive experiences. These two tools then provide data which are fed back to wards in a structured feedback report. Using this report, ward staff are asked to hold action planning meetings (APMs) in order to action plan, then implement their plans in line with the issues raised by patients in order to improve patient safety and the patient experience. The trial will be subjected to a rigorous qualitative process evaluation which will enable interpretation of the trial results. Methods: fieldworker diaries, ethnographic observation of APMs, structured interviews with APM lead and collection of key data about intervention wards. Intervention fidelity will be assessed primarily by adherence to the intervention via scoring based on an adapted framework. Discussion This study will be one of the largest patient safety trials ever conducted, involving 32 hospital wards. The results will further understanding about how patient feedback on the safety of care can be used to improve safety at a ward level. Incorporating the ‘patient voice’ is critical if patient feedback is to be situated as an integral part of patient safety improvements.
-
Development of a health safety and environment (HSE) performance review. Methodology for the oil and gas industry in LibyaHenry, R.M.; Ahmed, Giuma A.A. (University of BradfordFaculty of Engineering and Informatics, 2016)The oil and gas industry in Libya has suffered a number of health and safety accidents including environmental disasters due to the nature of the work involved and the hazardous materials it handles in all facets of exploration and production. Such issues have hitherto not received due attention by the Libyan Authorities. The fact that strict HSE assessment standards are neither well-defined nor established in Libya is not helpful. Furthermore, oil and gas industry in new free Libya has suffered immensely during the 2011 Arab Spring and its rebuilding poses a number of critical HSE challenges. The purpose of the research is to develop and validate a HSE Performance Review Methodology for Libyan oil and gas industry based on clearly defined and measurable aspects for assessment. The thesis starts by performing a comprehensive literature review on all aspects of HSE including universal standards. The review indicates that there is a gap in respect of semi-qualitative methods for assessing HSE performance commensurate with other disciplines. The thesis then identifies four key research problems in the context of Libyan oil and gas industries. Based on these problems, an empirical research was conducted and included three distinct Stages. Stage 1 consisted of a pilot study based on an interview questionnaire with 15 experienced HSE professionals working in oil and gas companies in Libya to help identify key issues pertaining to HSE assessment. Data analysis results for Stage 2 have been used to derive a list of 12 main groups of HSE questions which have then been tested on 84 HSE professionals working in Libya stemming from 35 medium and large oil and gas companies. Modal distribution analyses have been performed to scope down the number of HSE performance factors, which would then be used in Stage 3 of the empirical research. This consisted of issuing the same 84 interviewees with a questionnaire requesting their assessment of how Critical, Important and Less Important were the 60 factors identified. Central Tendency, Variation Ratios and Indices of Diversity were used to successfully analyse the data. With the QAA Subject Review in mind as a potential model for the sought methodology, and a mapping of the four research problems with data analysis results from Stages 1, 2 and 3; six HSE Performance Review Aspects emerged: Prevention, Surveillance, Response, Achievements, Resource and HSE Management and Enhancement – judged and graded using a 1 to 4 scale. The HSE Performance Review methodology has been validated by direct application to five comprehensive studies starting from the self-assessment document written by the companies, an extensive review visit by peer-assessors and a final report showing grades, benchmarks and shortcomings. Lessons learned from the validation exercise have been used to revise the definition of the six Aspects and used to propose an appropriate implementation plan in Libya. The results of the validation exercise are very encouraging and readily confirm that the methodology can be applied to other industry sectors.