Perceptual Gains for Coding of Moving Images without Visible Impairments

Abstract

We discuss the significance of perceptual effects for source coding of video signals without visible impairments. A new nonlinear spatiotemporal model of human threshold vision is proposed. Linearization yields the space-time-varying w-model. The model predicts a variety of perceptual effects accurately. Maximum bit-rate savings by irrelevancy reduction according to the w-model are evaluated for natural test pictures on the basis of the Shannon Lower Bound of rate distortion theory. Under typical viewing conditions, perceptual gains due to linear effects dominate. Maximum bit-rate savings due to the nonlinear masking effects are below 0.5 bit/sample in the average. Typically ⅓ of the masking gain is due to spatial masking, the rest is due to the presence of dark and bright areas in the picture, where the visibility of noise is reduced. Gains due to temporal masking are significant only in the first 100 ms after a scene cut.