Development of objective image quality assessment metrics

Objective measures are computer algorithms which measure the quality of an image or video and attempt to mimic or predict human judgement. Objective measures can be useful during the research and development phase of a new imaging device to optimize the selection and tuning of various acquisition, image/post processing, or display parameters.

My research in this area focuses on the development of a medical image quality metric and contribution to a general video quality metric:

Technology evaluation of medical imaging devices through assessment of diagnostic performance (ROC analysis)

The gold standard in medical image quality assessment is diagnostic performance studies - typically a receiver operating characteristic (ROC)-based assessment paradigm. These studies quantify how well users can conduct a specific task - usually their ability to discriminate between abnormal and normal cases (cases with and without lesions) - with a particular imaging system. Systems with better discriminative ability (e.g. higher AUC) are considered to have higher image quality.

My research in the area of diagnostic performance has focused on the evaluation of multi-slice (volumetric) image viewing:

  • Detection performance on single versus multislice image reading for varying background and signal content (co-author on conference paper)
  • Validation of a new digital breast tomosynthesis medical display (co-author on conference paper)

Technology evaluation of imaging devices through subjective image quality assessment (measurement of perceived quality)

Subjective quality assessment (QA) consists of measuring the user's subjective opinion of perceived images/video quality, or the user's quality preferences.

In medical imaging, subjective QA is not a replacement for diagnostic studies, since it does not measure how useful an image is at doing its job: allowing the user to conduct a specific task, such as the diagnosis of a disease. Subjective QA may still be useful during the research and development phase of an imaging device to understand the relationship between imaging parameters and the user's perception/experience, or for finding thresholds at which differences become perceptible. However, it is important to realize that subjective preference may not necessarily correlate directly with diagnostic performance - this is an interesting topic for future research.

Subjective QA plays a larger role in non-medical applications, such as television or video streaming, since typically the goal in these applications is to develop imaging systems that produce visually appealing images and video.

I have conducted and contributed to subjective quality assessment studies in 4 medical domains and 1 materials science application to research the effects of subject expertise, image content, and imaging parameters on subjective quality preferences:

  • Methodology for selecting stimuli for video quality assessment studies, applied to interventional cardiac x-ray imaging and laparoscopic surgery video (conference paper, [preprint pdf])
  • Assessment of the perceived quality of interventional cardiac x-ray sequences (co-author on conference paper)
  • Evaluation of the effects of expertise and content on the perceived quality of H.264/AVC compressed laparoscopic surgery video (conference paper, [preprint pdf])
  • Subjective quality assessment of various degradations in stereoscopic medical images (co-author on conference paper)
  • Assessment of the perceived quality of degraded digital pathology images (co-author on conference presentation)
  • Subjective assessment of mechanical wear degradation for a materials science application (co-author on journal paper)

Assessment of participant task performance and behavior in medical imaging applications

The user's performance and behavior while using an imaging device is another way to evaluate the impact of a new technology on a particular clinical task.

My research on user performance and behavior has focused on the following two applications:

  • Effect of video lag on laparoscopic surgery: correlation between performance and usability at low latencies (journal paper)
  • Image browsing and other observer behavior while reading simulated medical images (conference paper, [preprint pdf])


  • MIPS XVIII will be held July 14-17, 2019 in Salt Lake City, Utah. More info here.

  • MIPS XVII was held July 12-15, 2017 in Houston, Texas.

  • MIPS XVI was held 3-5 June 2015 in Ghent, Belgium and was hosted by myself and my colleague Ljiljana Platisa.

Recent blog posts

Read here