Ending GP performance pay linked to decline in quality of some care
Published on 21 March 2023
Ending performance related payments for NHS GPs in Scotland was associated with a decline in the reported quality of some aspects of care, according to a new paper co-authored by researchers from the University of Dundee and Edinburgh.
The study, published today in the British Medical Journal, compared the Scottish situation with England, where financial incentives have continued. The NHS Quality and Outcomes Framework (QOF) pay-for-performance scheme began in 2004. It was designed to remunerate general practices for providing good quality care across a range of key areas such as cancer, diabetes, heart disease, mental health, and obesity.
In 2016, Scotland abolished the QOF to reduce the bureaucratic burden on GPs and to free-up their time for patients but continued collecting performance data for some QOF indicators for the next three years.
Researchers were therefore able to use this data to evaluate the impact of QOF withdrawal on the reported quality of care in Scotland compared with England over the same period. They measured changes at one year and three years after withdrawal of QOF financial incentives in Scotland across 16 quality-of-care indicators measured annually from 2013-14 to 2018-19.
Compared with England, the researchers found a significant decrease in reported performance for 12 of the 16 quality-of-care indicators in Scotland one year after QOF was abolished and for 10 of the 16 indicators three years after QOF was abolished.
The researchers, from the National Institute for Health and Care Excellence (NICE) and the Universities of Cambridge, Dundee, Edinburgh and Manchester, say further studies are required to better understand the full impact of withdrawal and the accompanying refocusing of quality improvement resources.
Dr Daniel Morales, from Dundee’s School of Medicine, said, “Whilst changes in performance appear to have occurred after QOF withdrawal in Scotland it is difficult to distinguish whether this was related to care not being recorded as opposed to not being delivered.
“It's also important to recognise that we know that although QOF did lead to some improvement in reported quality of care when introduced, it also risked 'crowding out', with less attention on other aspects of care which were not part of pay-for-performance. However, we were not able to examine whether abolishing QOF reduced these unintended effects of pay-for-performance."
Indicators included mental health care planning, foot screening for patients with diabetes, blood pressure control in patients with underlying vascular conditions, flu vaccination and anti-clotting treatment in patients with heart disease.
Reductions at one year ranged from 30 percentage points for mental health care planning to three percentage points for flu vaccination in people with heart disease.
At three years, the absolute difference between Scotland and England was largest for recording of mental health care planning (40 percentage points) and diabetic foot screening (23 percentage points).
But clinically important reductions (between 10 and 20 percentage points) were also found for other outcomes such as blood pressure control in patients with vascular conditions.
No significant differences were seen between Scotland and England three years after QOF withdrawal for flu vaccination and anti-clotting treatment for heart disease patients.
The researchers acknowledge that these are observational findings with relatively few time points, and that analysis was restricted to indicators implemented in both England and Scotland in the three years between April 2013 to March 2016.
The findings are, however, consistent with a published analysis of a different range of withdrawn indicators in England, and the researchers believe the results are likely to be generalisable.
Professor Bruce Guthrie, from the University of Edinburgh, added, “An important aspect was the foresight to collect data after QOF withdrawal, allowing the impact of changes to be evaluated and any quality improvement interventions to be based on evidence as well as opinion.
“These findings are highly relevant to designers of pay-for-performance and healthcare quality improvement programmes internationally. We recommend that data continue to be collected for a period after the withdrawal of any indicator or performance scheme to monitor the impact.”
Senior Public Affairs Officer
+44 (0)1382 384768G.Hill@dundee.ac.uk