The measuring and monitoring of safety continues to be a challenge.
One of the ways we are currently being asked to do this is through looking at mortality. Assessing this can be highly subjective and requires significant experience.
The limitations and risks associated with measuring harm include:
- Patient case notes can never include every single thing that has happened to them, so the judgement is being made on incomplete data
- Outcome and hindsight bias influences the judgement of causation and preventability
- Variations in the intensity of treatment delivered to the growing population of elderly, frail, multi-comorbid patients has the potential to impact on the number of errors and the small number of deaths occurring in each hospital will inevitably result in large random error around the measure
While the estimated number of preventable hospital deaths may prove helpful in raising interest in patient safety and a commitment to improvement, overestimating the size of the problem and the risk to patients may induce unjustified levels of anxiety and fear among the public.
The problem with measuring safety:
- None of the current approaches to measure safety truly take into account the complexity of healthcare and most are focused on in-hospital care rather than across the whole healthcare system from acute care through to the patients’ home
- Relatively small numbers of incident types means that random variation can have a large influence on trend data and it is unlikely to be an indicator of whether the specialty is safer or not
- The vast majority of deaths do not involve safety problems. Even when errors of commission or omission do occur, establishing the degree to which healthcare has contributed to death is extremely difficult
In truth we don’t really know the full extent of harm; we don’t know the actual percentage of harm or things that ‘go wrong’ because it is impossible to measure.
In our current focus on ’the things that go wrong’ if we wanted to know if we were getting any better we would need a definitive baseline in order to judge. However we do not have this, we do not have a baseline of ‘things that go wrong’.
People don’t know how many mistakes they could have made but for some reason didn’t make them. They do not always recognise when they are about to get it wrong but then got it right. There are a also things that some people may consider are ‘things that have gone wrong’ but others think of as ways in which the system functions or are simply complications or side effects of the treatment. Thus we will never be able to identify and capture all of the things that ‘go wrong’ or even agree if they are things that ‘go wrong’.
We don’t capture all of the little things that do wrong everyday but that dont necessarily lead to any harm or poor outcome and we don’t capture things that go right. Therefore we cannot have a percentage of things that go wrong over things that go right or vice versa.
We don’t have that because currently it is impossible to collect. Added to this the fact that we don’t measure the things that go right every single time because we have not found a way to measure something that seems invisible. This means that we do not truly understand the whole host of reasons and determinants as to why safety may have improved or not improved, why lives may have been saved or lost and why harm has been avoided or not and whether the measures cited in fact represent the truth or reality.
Leave a Reply