Bitrate Analytics mark Bitrate AnalyticsStandards Desk
bitrate-analytics.info · independent engineering analysis

Quality Metrics and Measurement

Compression claims are only meaningful when accompanied by a measurement method. This page surveys the objective metrics commonly used to compare video configurations and explains where each one is and is not trustworthy.

Signal-based metrics

Peak signal-to-noise ratio compares a reconstructed frame with its source on a per-sample basis. It is cheap, deterministic and universally available, and it correlates only loosely with perceived quality. Structural similarity improves on it by modelling luminance, contrast and structure, and generally tracks the eye better than a pure error metric.

Perceived quality is a property of the display and the viewer, not only the stream
Perceived quality is a property of the display and the viewer, not only the stream

Perceptual models

Modern perceptual metrics learn their mapping from large collections of human ratings. They account for masking, temporal behaviour and the fact that artefacts in flat regions are more visible than the same magnitude of error in busy texture. The trade-off is expense and calibration: a model trained on one content population may not transfer perfectly to another.

A practical measurement loop

StepActionPurpose
1Select a representative clip setAvoid overfitting a single scene
2Encode at several dial valuesBuild a rate-quality curve
3Score with one signal and one perceptual metricCross-check the ranking
4Inspect the worst frames by eyeCatch artefacts metrics miss
5Record conditions with every numberMake the result reproducible
Never compare a metric computed against a different source, scaling or colour handling. The metric is valid only within one controlled comparison.

From measurement to policy

Measurement informs the ladder and the profiles described elsewhere on this desk. A score by itself changes nothing; a score attached to a configuration and a delivery target becomes an engineering decision. See the ladder planner and the 1080p profile for where these numbers land.