Patient Surveys - Reliable Evaluation of Doctors and Practices?

Actual experiences of patients are better evaluation tools of doctor performances and practices than surveys and ratings, claims a new research study.

The findings call into question the reliability of using surveys to evaluate practice performance.

Survey Shows That Patients Have Trust and Confidence in Their Doctors
The questions range from providing understandable information, washing or cleaning hands between touching patients

Patient surveys are used to assess the performance of doctors and practices, and they increasingly enquire about specific patient experiences (e.g. waiting time for an appointment) as well as overall satisfaction.

In the UK, general practices receive some of their income according to survey scores. It is therefore important to be sure that patients' responses act as a reliable indicator of performance, yet few studies have looked into this.

Researchers from the University of Bristol set out to explore whether responses to survey questions reflect differences between the practices, the doctors, or the patients themselves.

General Practice: Delivering Quality, Improving Outcomes
Family doctors in Scotland’s GP practices have once again demonstrated high standards of patient care in the national system that measures the quality of services

Using mathematical models, they analysed data from 4,573 patients who consulted 150 different doctors at 27 general practices in England.

They found that specific questions about patients' experiences (particularly access to care) are a more accurate measure of practice and doctor performance than are questions about patients' general satisfaction.

This is largely due to differences in people's perceptions as well as random error, and suggests that the reliability of using surveys to assess an individual doctor's performance is questionable, say the authors.

They also found that responses vary according to patient characteristics such as age, sex, and ethnicity. However, adjusting for these characteristics made very little difference to practices' scores or the ranking of individual practices.

In conclusion, they support the concept that questions about specific experiences of care provide a more discriminating measure of a practice's performance than do subjective questions about general satisfaction. And they call for their findings to be replicated in a larger sample of practices.

An accompanying editorial argues that measures of patient satisfaction need to be refined, but they are not hopelessly flawed.

Source-Eurekalert