ֱƵ

Close
Explore more Centres, Projects and Groups
Welcome
Welcome Banner
Banner
Woman using walking frame, Credit: istock

Patient reported outcome measures (PROMs)

Patients’ views are essential to achieving high-quality health care. Our PROMs research is helping to improve patient care by evaluating the performance of health care providers and guiding NHS reforms.

Bottom Content
Logo List Links
Intro Blocks List
About

Patients’ views are essential to achieving high-quality health care. Our PROMs research is helping to improve patient care by evaluating the performance of health care providers and guiding NHS reforms.

Who we are

Current staff conducting this important work are Nick Black, Sarah Smith, Joljin Hendriks, Min Hae Park, Esther Kwong, Jan van der Meulen, Andrew Hutchings, Belene Podmore and Eva Protopapa.

Resources and publications

Over 40 academic papers have stemmed from our PROMs research, some of which included the development of new PROM questionnaires.

Donations
Twitter Embedded Code
Facebook Embedded Code
About
About PROMs

Overview

Patients’ views are essential to achieving high-quality care. Their perspective complements that of clinicians, providing unique insights into perceptions of their health status (symptoms, functional status) and health-related quality of life (HRQL). It is therefore important to find ways of involving patients to report on their own health outcomes.

PROMs, which measure a patient’s health status (symptoms, function, HRQL), are gathered through short, self-completed questionnaires. PROMs may be collected before and after a procedure or at regular intervals for those with long-term conditions. This information gives an indication of the outcomes or quality of care delivered to patients.

We have been at the forefront of PROMs research for over 25 years. Our work has been instrumental in the implementation of policies which allow patients to report on their own health outcomes. We have also made major contributions to developing and psychometrically testing PROMs for a wide range of conditions and interventions.

History of PROMs research

Work on PROMs at the School started in the 1980s with studies of prostate surgery in men and hysterectomy in women. In the 1990s, experts from medicine, sociology, psychology, epidemiology and statistics developed and tested new PROMs using rigorous qualitative and quantitative methods. PROMs were developed for stress incontinence, menorrhagia, plastic surgery, multiple sclerosis, day surgery, and coronary revascularisation.

This work was complemented by studies covering a range of methodological aspects on the routine use of PROMs in health care, including the influence of patients’ preoperative health, their expectations of outcomes, the impact of non-recruitment and non-response, and comparisons of patients’ and clinicians’ views of outcomes.

Psychometric expertise

The school has been contributing work in psychometric methods for over 30 years and has become one of the best known UK groups able to undertake robust psychometric evaluation and development.  Our early work was based in Classical Test Theory but has now broadened to include modern psychometric methods based on Rasch Measurement Theory.

We have used these methods to develop and evaluate questionnaire based measurement instruments across a wide range of clinical areas (including stroke, visual impairment, intensive care, dementia, heavy menstrual bleeding, diabetic neuropathy, childhood disability, carer well-being, diabetic neuropathy, and unplanned pregnancy, prostate cancer).

We host the “Outcomes Group” – a UK wide methodological forum which meets three times a year to share, discuss and debate issues arising in health related measurement.

PROMs in elective surgery

In 2005, a systematic review of ways to assess outcomes following hip and knee replacement, varicose vein surgery, hernia repair and cataract surgery was conducted. Pre and post-operative questionnaires for the four procedures were identified, and the feasibility of their routine use in the NHS tested. The findings highlighted that it was possible to recruit patients, follow them up and make risk-adjusted comparisons of providers, all at reasonable cost.

‘A major development in the history of surgery’

These findings were reported to the Department of Health in England in 2007 which that PROMs would be mandatory for all NHS patients undergoing groin hernia operations, hip replacements, knee replacements and varicose vein operations from April 2009. This continues and since 2011, these PROMs have been included in the .

More than half a million patients participated in the programme in its first three years, representing 70% of eligible patients. Since April 2010, the outcomes for every hospital in the NHS in England have been published .

In 2011 Professor Sir Bruce Keogh, Medical Director of the NHS, told the Financial Times newspaper that the advent of PROMs ‘would shift the focus among doctors [away] from technocratic results, where an operation was deemed a success regardless of whether the patient remained in pain.’ In 2012, Professor Sir Norman Williams, then president of the Royal College of Surgeons, described PROMs as a ‘major development in the history of surgery’.

From 2010 to 2015 we have studied many methodological aspects of using PROMs to compare providers, including:

  • The relationship with patients’ views of the humanity (experience) of their care
  • Impact of differences in surgery rates between districts
  • Impact of different ways of defining outlier providers, equity of use and of outcome
  • Impact of variations in outcomes of individual surgeons.

PROMs in dementia

Since 2013, we have been working on a programme of research to measure the health-related quality of life of people with dementia and their lay carers. Building on pioneering work a decade earlier that developed PROMs both for completion by people with dementia (DEMQOL) and by their lay care-givers (DEMQOL-Proxy), we have transformed those instruments using modern psychometric methods so that proxies’ views can reliably provide an indication of patients’ views. This means, that for the first time, the health-related quality of people with severe dementia (who cannot self-report) can be estimated from the reports of their lay care-givers.

These new PROMs have been used to assess the impact of memory clinics and have shown the improvements in quality of life that result. This has shown that these services can be cost-effective (ie meet the NICE criterion of £30 000 per QALY) if services are organised and delivered in the right way.

PROMs in emergency admissions to hospital

The inevitable lack of any knowledge of a person’s health status before an emergency admission to hospital has prevented the meaningful use of PROMs in assessing the quality of the care they receive. We have shown that the use of PROMs based on patients’ recall of their pre-admission health in elective surgery can provide a valid and reliable estimation of the benefits of the intervention. Assuming the same would be true for unexpected emergency admissions for a medical condition (heart attack) and for a surgical condition (emergency laparotomy for gastro-intestinal conditions), we have demonstrated that it is feasible to ask patients to recall their state of health up to four weeks before their admission.

We now want to institute a large national programme involving up to 30 hospitals carrying out emergency laparotomy in collaboration with the National Emergency Laparotomy Audit.

Role and impact of PROMs

While there is widespread support for the introduction of PROMs as a means of supporting more patient-centred health care, there has been little attention aid to how the use of PROMs might bring about improvements. Many PROMs have been adopted without any explicit consideration of the theory and mechanisms by which either the clinical management of individual patients or the quality of services might be expected to improve.

We have been involved with colleagues at the Universities of Leeds and Oxford to carry out a realist review. This has successfully identified the three theories that underlie people’s expectations as to why PROMs will be beneficial and the nine mechanisms that people believe will result in improvements. The review considered the use of PROMs at both the level of individual patients and collectively for providers of services. It revealed the lack of empirical evidence to back up most of the widely held beliefs about the benefits. It demonstrated the need for much more research on the impact of PROMs so those of us who are enthusiastic supporters can justify the policy and persuade others.

Influence of comorbidity on outcomes of hip and knee replacement

We have used PROMs to look at the influence of comorbidities on outcomes. Secondary conditions (comorbidity) often delay access to elective joint replacement. In a study of patients who had undergone a hip or knee replacement we found that most patients with comorbidities reported similar levels of benefit from joint replacement as patients without comorbidities. We also demonstrated that while comorbidities increase the risks of the surgery, this effect is so small that for most patients with comorbidities hip and knee replacement is a very effective and safe procedure.

PROMs in prostate cancer

We are conducting studies examining how patients’ reports of their health-related quality of life differ between different treatments for prostate cancer and between different providers. A key barrier for this research is that although established disease-specific PROMs for patients with prostate cancer claim to measure health-related quality of life they are restricted to adverse effects on urinary, sexual and bowel function. Accepting this limitation, we have used PROMs collected 18 months after patients were newly diagnosed with prostate cancer to assess the adverse effects of different surgical approaches and radiotherapy regimens.

Resources & publications
Resources
Publications
Publications List
Hutchings A, Neuburger J, Gross Frie K, van der Meulen J, Black N
Health Qual Life Outcomes 2012;10:34
Grosse Frie K, van der Meulen J, Black N
Brit J Surg 2012;99:1156-63
Grosse Frie K, van der Meulen J, Black N
J Clin Epidemiol 2012;65(6):619-26
Hildon Z, Neuburger J, Allwood D, van der Meulen J, Black N
BMC Health Serv Res 2012;12(1):171
Hildon Z, Allwood D, Black N
Patient Education & Counselling 2012;88(2):298-304
Hutchings A, Grosse Frie K, Neuburger J, van der Meulen J, Black N
J Clin Epidemiol 2013;66:218-225
Black N
BMJ 2013;346:19-21
Neuburger J, Hutchings A, van der Meulen J, Black N
Med Care 2013;51(6):517-523
Black N, Varagunam M, Hutchings A
J Public Health 2014;36(3):497-503
Varagunam M, Hutchings A, Neuburger J, Black N
J Health Serv Res Pol 2014;19:77-84
Black N, Varagunam M, Hutchings A
BMJ Qual Safety 2014;23:534-42
Hutchings A, Neuburger J, van der Meulen J, Black N
BMC Health Serv Res 2014;14:66  doi:10.1186/1472-6963-14-66
Varagunam M, Hutchings A, Black N
A multi-level analysis of routine data. BMJ Qual Saf 2015;24:195-202
Varagunam M, Hutchings A, Black N
Medical Care 2015;53:310-6
Lim WC, Black N, Lamping D, Rowan K, Mays N
J Critical Care 2016;31:183-193
Kwong E, Black N
J Clin Epidemiol 2017;81:22-32
Hendriks AAJ, Smith SC, Chrysanthaki T, Black N
Int J Geriatric Psychiatry
Protopapa E, van der Meulen J, Moore C, Smith SC
BJUI. In press
Hendriks AA, Smith SC, Chrysanthaki T, Black N. (2016)
Int J Geriatr Psychiatry. Jun doi: 10.1002/gps.4515
Rowen D, Mulhern B, Banerjee S, Tait R, Watchurst C, Smith S, Young T, Knapp M, Brazier J.
Medical Decision Making, 2015, 35:68-80
Quirk A, Smith SC, Hamilton S, Lamping DL, Lelliott P, Stahl D, Pinfold V, Aandippan M.
Mental Health Review Journal. 2012. 17;(3)
Cano SJ, Lamping DL, Bamber L, Smith S. (2012)
Health and Quality of Life Outcomes. 2012. 10(120)
Mulhern B, Rowen D, Brazier J, Smith S, Romeo R, Tait R, et al
Health Technol Assess 2013;17(5)
Smith SC, Lamping DL, Maclaine GDH
Diabetes Res Clin Pract. 2012 Jun;96(3):261-70
Rowen D, Mulhern B, Banerjee S, Van Hout B, Young TA, Knapp M, Smith SC, Lamping DL, Brazier JE
Value in Health. 2012. 15:346-356
Mulhern B, Smith SC, Rowen D, Brazier J, Knapp M, Lamping DL, Loftus V, Howard R, Banerjee S
Value in Health. 2012. 15:323-333
Alavi Y, Jumbe V, Hartley S, Smith S, Lamping D, Muhit M, Masiye F, Lavy C
Disabil Rehabil. 2012. 34(20):1736-46
Smith SC, Lamping DL, Banerjee S, Harwood RH, Foley B, Smith P, Cook JC, Murray J, Prince M, Levin E, Mann A, Knapp M
Psychological Medicine. 2007., 37, 737-746
Banerjee S, Smith SC, Lamping DL, Harwood R, Foley B, Smith P, Murray J, Prince M, Levin E, Mann A, Knapp M
Journal of Neurology, Neurosurgery, and Psychiatry. 2006. 77, 146-148
Smith SC, Murray J, Banerjee S, Foley B, Cook JC, Lamping DL, Prince M, Harwood RH, Levin E, Mann A
International Journal of Geriatric Psychiatry. 2005 20, 889-895
Smith SC, Lamping DL, Banerjee S, Harwood R, Foley B, Smith P, Cook JC, Murray J, Prince M, Levin E, Mann A, Knapp M
Health Technology Assessment. 2005. 9 (10)
Hendriks AAJ, Smith SC, Chrysanthaki T, Cano SJ, Black N.
Health Qual Life Outcomes. 2017;15:164
Greenhalgh J, Dalkin S, Gibbons E, Wright J, Valderas JM, Meads D, Black N
J Health Serv Res Policy. 2018;23:57-65
Smith SC, Hendriks AAJ, Regan J, Black N
Patient Related Outcome Measures. 2018;9:221–230
Kwong E, Neuburger J, Black N
Quality of Life Research. 2018;27:1845-54
Greenhalgh J, Gooding K, Gibbons E, Dalkin SM, Wright J, Valderas JM, Black N
J Patient Reported Outcomes. 2018;2:42
Kwong E, Neuburger J, Murray D, Black N
BMJ Open Gastroenterology. 2018 5: e000238-e000238
Kwong E, Neuburger J, Black N
J Patient Reported Outcomes. 2018;2:54
Kwong E, Neuburger J, Petersen S, Black N
BMJ OpenHeart. 2019;6:e000920
Podmore B, Hutchings A, Konan S, van der Meulen J
BMC Med Res Methodol. 2019 Apr 24;19(1):87
Access to and outcomes of elective hip and knee replacement surgery for patients with comorbidities: a study using PROMs and administrative data
Podmore B (2018)
PhD. London School of Hygiene and Tropical Medicine.
Protopapa E, van der Meulen J, Moore CM, Smith SC
BJU Int. 2017 Oct;120(4):468-481
Who we are
Team Block
Profiles List