Tradeoffs in subjective testing methods for image and video quality assessment

An objective quality estimator for either still images or video should accurately estimate the perceived quality scores of a collection of stimuli. New applications and processing techniques will introduce novel distortions that will need to be quantified in terms of perceived quality in order to confidently evaluate an objective quality estimator. The subjective testing method used to obtain the perceived quality scores affects the accuracy and reliability of the data collected. Two common methods used to collect perceived quality scores are absolute categorical rating (ACR) and subjective assessment methodology for video quality (SAMVIQ). The ACR test method presents stimuli in a random order and uses a coarse resolution rating scale for evaluation. The SAMVIQ test method allows the observer to freely view several stimuli multiple times and uses a fine resolution rating scale for evaluation. Ease of implementation typically influences the adoption of ACR over SAMVIQ, since ACR accom...

• Type: Conference
• Year: 2010
• Where: HVEI
• Authors: David M. Rouse, Romuald Pépion, Patrick Le Callet, Sheila S. Hemami
• Keywords: Emerging Technology, HVEI 2010, Objective Quality Estimator, Quality Scores, Resolution Rating Scale